1 Big Picture, What is GPT?
This chapter covers
- Introducing How GPT Works in Plain Language.
- How do humans and machines represent languages differently?
- What are Generative Pretrained Transformers and Large Language Models?
- Why does ChatGPT perform so well?
- What are the limitations and concerns when using ChatGPT?
The hype around terms like machine learning (ML), deep learning (DL), and artificial intelligence (AI) has reached record levels. Much of the recent public exposure to these terms has been driven by a product called ChatGPT, built by a company called OpenAI. Seemingly overnight, the ability of computers to talk, learn, and perform complex tasks has taken a dramatic leap forward. Companies are forming, and existing firms publicly invest billions of dollars. The technology in this space is evolving at a maddening pace.
This book aims to help you make sense of this new world by dispelling the mystery behind what makes ChatGPT and related technologies work. We will cover the knowledge necessary to understand the inner workings of ChatGPT and how the components (data and algorithms) stack together to create the tools we use. We’ll also discuss various cases where this technology can form the cornerstone of a broader system and others where systems like ChatGPT may be a poor choice.