How to train your data
The Vergecast

How to train your data

Jun 25, 2026 · 26 min

AI recap

What’s really inside AI training data—and why companies stay vague about it

This preview, based only on the episode notes, points to a conversation about the massive datasets behind tools like Claude, ChatGPT, and Gemini. Staff writer Alex Reisner discusses where that data comes from, why transparency is limited, and whether a fairer exchange is possible.

This episode appears to dig into one of the most important and least visible parts of the AI boom: training data. Based on the show notes, the discussion centers on the enormous mix of material used to build AI systems—everything from books and blog posts to YouTube videos and Reddit comments, gathered at staggering scale. Alex Reisner, a staff writer at *The Atlantic* who has been investigating training data, joins to explain how AI companies obtain this material and why they may prefer not to be fully transparent about what’s included. If you’ve been curious about the pipeline behind generative AI, this sounds like a useful entry point into the sourcing side of the industry rather than just the products it produces. The notes also suggest the episode explores the ethical and economic question of whether training data could ever become a fair trade. That makes this a good pick for listeners interested not only in how AI works, but in who benefits, who contributes, and who may be left out of the bargain. The further reading links reinforce that focus, pointing to reporting on scraped YouTube videos, AI-generated music built from large song datasets, and the role of Common Crawl. If those topics already interest you, this episode seems likely to connect the dots between AI’s technical foundations and the broader debate over consent, compensation, and accountability. This is a preview based on the published show notes, so the full episode may add nuance beyond what’s described here.

About this episode

Training data is the raw material of the AI industry. Claude, ChatGPT, Gemini, and the rest are built on top of oceans of stuff. What is that stuff? Books. Blog posts. YouTube videos. Reddit comments. All of it and more, in virtually incomprehensible quantities. Alex Reisner, a staff writer at The Atlantic who has been investigating training data, explains how AI companies get all this data, why they'd really prefer you not know what's in it, and whether training data could ever be a fair trade. Further reading: Apple raises prices on Macs, iPads, and more by hundreds of dollars | The Verge⁠ ⁠Disney agrees to pay $50 million to YouTube TV and DirecTV subscribers | The Verge⁠ Two handlebars are better than one, right? | The Verge⁠ At Least 15 Million YouTube Videos Have Been Snatched by AI Companies⁠⁠ ⁠⁠The Hypocrisy at the Heart of the AI Industry ⁠⁠ ⁠⁠The Millions of Songs Mashed Into AI-Generated Music⁠⁠ ⁠⁠Common Crawl Is Doing the AI Industry’s Dirty Work⁠⁠ Subscribe to The Verge for unlimited access to theverge.com, subscriber-exclusive newsletters, and our ad-free podcast feed. We love hearing from you! Email your questions and thoughts to vergecast@theverge.com or call us at 866-VERGE11. Learn more about your ad choices. Visit podcastchoices.com/adchoices