The Evolution of LLMs, Explained Through What We Train Them to Do

TL;DR: Every leap in LLMs, from GPT-1 to today's agents, came from changing one thing: what the model is trained to do. Next-token prediction gave models knowledge. Post-training made them assistants. Reinforcement learning made them…