AI & Machine LearningMultimodal AI

AI Describes the World

Image-to-text AI helps blind people know what's in front of them

A phone can tell someone who can't see what's in the room. How does it know, and when does it make things up?

You'll find out

  • How a picture turns into words
  • What it learned from human captions
  • Why it sometimes sees what isn't there

Why it matters

Many pictures online come with no words. AI captions open them to people who can't see, if you know their limits.

About 3 min6 interactive slides · 5 questionsLesson 578 · Zone 65

Play this lesson

Free to play in your browser or on iPhone

More in this zone

  1. 577Programming LanguagesThe $125 Million Unit Mix-upA Mars probe was lost because two teams used different units
  2. 579Discrete MathematicsThe Alabama ParadoxAdding a seat can make a state lose one
  3. 580Speech SynthesisThe Voice CloneA few seconds of your voice are enough to fake a phone call
  4. 581Physics of SoundThe Kettle Goes Quiet Before It BoilsThe loudest noise comes before boiling, not during
  5. 582ComputabilityPowerPoint Can Compute AnythingMinecraft, Excel and even PowerPoint are secretly full computers
  6. 583StatisticsThe German Tank ProblemSerial numbers on captured tanks revealed Germany's production
  7. 584Internet EconomicsThe Hundred-Millisecond AuctionEvery time a page loads, advertisers bid for your eyes
  8. 585Internet HistoryHow Sputnik Created the InternetA Soviet satellite started a chain that led to ARPANET