GPT
Generative Pre-trained Transformer, a family of large language models trained to generate text.
In-depth explanation
GPT models are autoregressive transformers trained to predict the next token. GPT-2 (2019) demonstrated remarkable text generation. GPT-3 (2020) with 175B parameters showed emergent capabilities like few-shot learning. GPT-4 (2023) is multimodal and powers ChatGPT. These models learn patterns from vast internet text and can perform diverse language tasks.
Examples
Related terms
More in Generative AI
Large Language Model (LLM)
AI models trained on vast text data that can generate and understand human-like text.
Prompt Engineering
The practice of crafting effective inputs to get desired outputs from AI models.
Generative Adversarial Network (GAN)
Two neural networks competing against each other to generate realistic synthetic data.
Diffusion Model
Generative models that learn to create data by reversing a gradual noising process.
RAG (Retrieval-Augmented Generation)
Combining retrieval systems with language models to generate responses grounded in external knowledge.
Hallucination
When AI models generate plausible-sounding but factually incorrect or fabricated information.
Master GPT.
Learn how to apply this concept with hands-on projects in our comprehensive AI programs.