AI & Machine LearningLanguage Technology

The Context Window

AI can only keep a limited amount of text in mind at once

Chat with an AI long enough and it forgets what you told it at the start. Where did those words go?

You'll find out

  • How much can a chatbot read at once?
  • Why do the oldest lines drop out?
  • Why can't windows just keep growing?

Why it matters

Knowing where the window ends tells you when to remind a chatbot of a key detail.

About 3 min6 interactive slides · 5 questionsLesson 394 · Zone 44

Play this lesson

Free to play in your browser or on iPhone

More in this zone

  1. 388Behavioral EconomicsThe Unfair OfferPeople turn down free money to punish unfairness
  2. 389Stochastic ProcessesThe Drunkard's WalkRandom steps still create predictable patterns
  3. 390Game TheoryAdding a Road Can Cause More TrafficA new shortcut can make everyone's journey slower
  4. 391Hacking HistoryThe Whistle That Hacked the Phone NetworkA toy whistle from a cereal box made free calls
  5. 392Information TheoryMorse CodeThe most common letter got the shortest code
  6. 393Media CompressionHow ZIP WorksFrequent patterns get short codes, the trick Morse found first
  7. 395Oculomotor ScienceYou're Blind Several Times a SecondYour eyes jump constantly and your brain hides the gaps
  8. 396SpaceflightRockets That Land ThemselvesBoosters now fly back and land upright on a pad