1 Analyzing data with large language models

 

This chapter covers

  • Introduction to language models
  • Target audience and prerequisites
  • Data analysis with language models

Language models are powerful neural networks that can be used for various language processing tasks. This chapter introduces language models and shows how and why we want to use them for data analysis. You will learn about use cases, recommended background before reading this book, and challenges that arise when using language models in practice.

1.1 What can language models do?

We will start this section with a little poem and associated picture (Figure 1.1), connecting the two main topics of this book: data science and AI.

Figure 1.1 Illustration by GPT-4o for the topic “AI-Assisted Data Science”.
figure

In the realm where data’s vast oceans flow,
And mysteries in numbers softly glow,
There lies a dance, both precise and free,
A blend of man and AI’s harmony.

1.2 Who should read this book

1.3 Why you should read this book

1.4 What you will learn

1.5 How to use language models

1.6 Using language models for data analysis

1.6.1 Using language model directly on data

1.6.2 Data analysis via external tools

1.7 Model providers

1.8 Optimally using language models

1.8.1 Selecting a model configuration

1.8.2 Choosing a prompt template

1.9 Advanced software frameworks

1.10 Summary

sitemap