The internet is running out of data. Your filing cabinet might be the fix.
Frontier AI is hitting a wall that feels almost mundane for such a futuristic technology: it is running out of human-generated data to learn from. The scarce resource it needs next may already be sitting in your archive.
Every technological boom eventually hits a wall. For the oil industry, it was the depletion of easily accessible reserves. For chipmakers, it was the physical limits of shrinking transistors. Now artificial intelligence — after years of seemingly limitless expansion — is running into a bottleneck that feels almost mundane for such a futuristic technology. It is running out of human-generated data to learn from.
01The wall every AI lab is hitting
Large language models — the systems powering chatbots, coding assistants and enterprise agents — are trained on enormous volumes of human-written material: books, articles, forums, research papers, code repositories. For years the supply seemed infinite. It is not.
According to research from Epoch AI, the stock of high-quality public text available online could be functionally exhausted for frontier AI training somewhere between 2026 and 2032. For the most advanced systems, that constraint may already be here. The models dominating today were trained on much of the internet's usable knowledge, and the next generation is being forced to look elsewhere.
The problem is not just quantity. What frontier labs actually need now is a different category of data altogether: behavioural, operational and domain-specific information that captures how professionals really make decisions, handle exceptions and get work done. Not what people say online — what they do in the real world.
02Three responses. None of them ideal.
Faced with this shortage, the industry has responded with varying degrees of creativity — and controversy.
Meta's response was perhaps the most direct: monitoring software on US employees' work computers, recording keystrokes, mouse movements, clicks and periodic screenshots across tools like Slack, GitHub and Google Docs — to teach AI agents how people actually use computers. European employees were excluded because GDPR required explicit consent. American employees were not afforded the same protection.
The obvious fix is to have models generate their own training data — cheap, scalable, effectively infinite. The problem is that it does not work at scale. A 2024 Nature study found that training on AI-generated output causes "model collapse": a degenerative process where models become progressively more generic, repetitive and error-prone over successive generations.
OpenAI and data-labelling firm Handshake AI reportedly asked contractors to upload real internal company documents — spreadsheets, presentations, code repositories — to help train systems for white-collar automation. The responsibility for determining what counted as confidential was effectively outsourced to the contractors themselves.
These approaches differ in method, but they share the same underlying problem: they are all attempts to extract more from a depleting source, rather than identifying a new one.
03The question nobody thought to ask
Here is what makes this situation interesting for enterprises: the data AI labs are most desperate for may not be on the internet at all.
Decades of expert knowledge — legal filings, engineering specifications, medical records, compliance reports, technical manuals, operational procedures — exists in a format that has been largely overlooked because it was considered too costly and complex to unlock. Paper. And its digital equivalent: scanned documents, legacy PDFs, unstructured archives.
As The Conversation noted as early as 2023, developers searching beyond the free online space should be looking at "the millions of texts published before the internet" — content that, made available digitally, could provide an entirely new source for AI projects.
"In the first phase of the AI race, scale created advantage. In the next phase, proprietary data may matter just as much."
04What this means for your business
There is a second-order effect to the data drought that most enterprises have not yet considered. If frontier AI increasingly depends on rare, proprietary, domain-specific data, then the organisations sitting on those datasets — hospitals with patient-interaction histories, law firms with decades of case records, manufacturers with operational workflows, financial institutions with transaction data — suddenly possess something AI labs cannot easily replicate.
This is where TrustedHub comes in. We digitise paper and legacy documents, extract and enrich the content, and convert it into vector embeddings — numerical representations AI and large language models can directly understand and reason over. The result is an AI attuned specifically to your organisation's knowledge: your processes, your expertise, your institutional memory.
Your data does not just become searchable. It becomes intelligent. And unlike surveillance programs or synthetic shortcuts, it is built on a foundation you already own — governed securely, with full digital rights control, in a way no competitor can replicate.
// Takeaways
- High-quality public training text may be functionally exhausted for frontier AI between 2026 and 2032.
- Surveillance, synthetic data and covert scraping all try to squeeze more from a depleting source.
- Proprietary, pre-internet, domain-specific records are scarce, uncontaminated, and hard to imitate.
- Digitised and embedded, your archive becomes an AI advantage competitors cannot copy.
The companies best positioned for the next phase of AI will not necessarily be the largest technology firms. They will be the organisations that combine deep, highly specific datasets with the operational ability to safely integrate them into AI systems. The value now lies less in raw abundance and more in information that is difficult to imitate, difficult to acquire, and grounded in how real-world work actually happens. Your filing cabinets may be worth more than you think.
Sources
- Epoch AI — "Will we run out of ML data? Evidence from projecting dataset size" (2022, updated 2024). arxiv.org/abs/2211.04325
- PBS NewsHour — "AI 'gold rush' for chatbot training data could run out of human-written text as early as 2026", Matt O'Brien / Associated Press, June 2024. pbs.org/newshour
- The Conversation — "Researchers warn we could run out of data to train AI by 2026. What then?", 2023. theconversation.com
- Nature — "AI models collapse when trained on recursively generated data", Shumailov et al. (Oxford, Cambridge, Google DeepMind), July 2024. nature.com · DOI 10.1038/s41586-024-07566-y
- Roko's Basilisk Newsletter — "AI's Data Drought", 1 June 2026. rokosbas.beehiiv.com