IDC puts a number on what enterprise data teams already know: less than 1% of available data reaches generative AI. Not because models are not ready. Because the data is not.
“Traditional manual pipelines often take six to twelve months to build and break whenever source formats change.”Winston Thomas, CDOTrends · “The 1% Problem: Why Your Enterprise Data Is Useless to AI” · November 2025
Less than 1% of enterprise data reaches AI. The gap is not model capability. It is data architecture.
Less than 1% of enterprise data currently reaches generative AI systems. IDC published this figure in late 2025, and it cuts through the noise of AI investment announcements with unusual clarity. The models are ready. The data is not.
The 99% sitting outside AI’s reach is not missing because of model limitations. It is missing because enterprise data was never built to be machine-readable in the way AI requires. The rows-and-columns world of SQL databases and BI tools represents a small fraction of what enterprises actually know. Contracts, policy documents, call transcripts, technical manuals, and email threads that carry institutional knowledge exist in formats that standard data pipelines were not designed to handle.
Three compounding problems explain the gap: pipeline fragility, context-destroying document chunking, and governance failures that create liability every time an AI agent retrieves content it should not see. Each is familiar to data teams individually. Together they explain why enterprises can invest heavily in AI infrastructure and still find their agents answering questions with a fraction of the data available to them.
The data problem is not a quantity problem. It is a structure and governance problem. Adding more storage or more capable models does not close it. The gap closes when there is a semantic layer between data systems and AI agents that understands what data means, who can access it, and how conflicting definitions across systems get resolved before a query runs.
“Traditional manual pipelines often take six to twelve months to build and break whenever source formats change.”
Winston Thomas, CDOTrends · November 2025Enterprises are running AI on infrastructure built for a world where data was tidy and static.
Building a data pipeline to feed AI takes six to twelve months. That is a real investment before a single agent query runs reliably. The fragility is the core problem, not the timeline.
When a vendor changes a file format, a system migration alters a schema, or a new product line adds data categories absent from the original specification, the pipeline breaks. Months of engineering become an ongoing maintenance obligation rather than a one-time investment. Enterprises end up with AI systems that are technically deployed but operationally stalled, waiting for pipelines to catch up with a business that keeps moving.
Traditional ETL was built for known, stable schemas: move data from A to B when both A and B have predictable shapes. Enterprise data today spans CRM systems, ERP layers, MongoDB document collections, legacy databases, and cloud data warehouses, each with its own conventions about what a field name means and how records relate. A pipeline ingesting from three of those systems simultaneously is actually managing three different semantic assumptions about the same underlying business reality.
Every field mapping, every business rule encoded in pipeline logic, every exception handler represents a human decision about what data means. That decision lives inside the pipeline itself. When the pipeline breaks or the team that built it moves on, the decision disappears. The next team rebuilds from scratch, making slightly different assumptions, introducing the kind of metric drift that corrupts AI answers months after deployment with no visible warning.
The 6-12 month build time is not a symptom of poor execution. It is the cost of manually encoding semantic understanding into infrastructure that was never designed to carry it. The answer is not to build faster pipelines. It is to separate semantic governance from pipeline plumbing: capture what data means once, in a governed layer above the systems, and let pipelines do the mechanical work they were always built for. This is what LazyFox's AI-powered data catalog automates: it scans databases, document stores, and PDFs, infers relationships, and generates the semantic metadata in minutes rather than months of pipeline engineering.
“Six months to prep data that becomes obsolete the moment a vendor changes a file format. It’s the enterprise equivalent of building a bridge that collapses every time it rains.”
Winston Thomas, CDOTrends · November 2025Same enterprise, same data. Two architectures. What reaches the AI depends entirely on what sits between the data systems and the agent.
Grounding models in real documents sounds like the answer. Arbitrary chunking makes it wrong in practice.
Retrieval-augmented generation arrived as the enterprise answer to AI hallucination. Instead of relying on what a model learned in training, ground it in real documents. Let it retrieve relevant content and answer from evidence. The logic is sound. The implementation problem lies in what “retrieve” actually means.
Standard RAG implementations chunk documents into fixed-size text blocks and embed them as vectors. A query arrives, the system finds the most similar chunks, and feeds them to the model. For simple question-answering against homogeneous text, this produces acceptable results. When the answer depends on document structure, it fails in ways that are hard to diagnose and harder to explain to business stakeholders who only see the wrong answer.
Financial policy documents have tables. Those tables have column headers that determine what the numbers mean. Technical manuals have procedures where the sequence of steps matters. Contracts have clauses that reference definitions established earlier in the document. Chunk these at arbitrary text boundaries and you separate context from content. The model receives a number without the column header. A step without the procedure name. A clause without the definition it depends on. The result is not hallucination in the model-training sense; it is comprehension failure caused by structurally degraded input.
Enhanced approaches that extract tables, hierarchies, and semantic relations before vectorization improve accuracy meaningfully. This is genuine progress. But even these approaches answer the wrong question. They ask: which chunks of text are most relevant to this query? They do not ask: what does this enterprise mean by “contract value” in this document, from this business unit, under this fiscal-year convention? That is not a retrieval question. It is a governance question, and vector similarity cannot resolve it.
MongoDB handles documents natively at scale, storing contracts, records, and operational data in flexible formats without forcing schema rigidity on source systems. But the question of what those documents mean, which version of a definition is authoritative, and which records a given AI agent is permitted to access, those questions require a semantic governance layer above the database. The database tells you where the data is. The governance layer tells AI what the data means and how to use it reliably.
“Most RAG implementations treat documents like word salad, chunking text arbitrarily and losing critical context.”
Winston Thomas, CDOTrends · November 2025The same metric, defined four different ways across four connected systems. Without a governance layer, every AI query resolves this conflict on its own, differently each time.
The missing 99% is not waiting for a better model. It is waiting for infrastructure that makes it governable.
The governance problem is where enterprise AI risk actually lives. What happens when an AI agent retrieves a document it was not supposed to see? And the more insidious companion: what happens when it answers a query using a metric definition from one system that conflicts with the authoritative definition in another?
In any enterprise running more than two data systems, metric definitions diverge naturally over time. Finance defines revenue one way. The data warehouse uses a slightly different calculation. The CRM captures a third variant that reflects a different moment in the customer lifecycle. For human analysts, this is managed through institutional knowledge, escalation paths, and periodic reconciliation meetings. For an AI agent, it is a disambiguation problem with no built-in resolver unless the architecture provides one.
The answer most enterprises reach for is lineage tracking, role-based access controls, and governed metadata. These are the right categories. But implementing them at the pipeline level, adding permission checks to each ETL job, annotating metadata on each ingestion run, maintaining lineage records per dataset, scales poorly. Every new system connected to the AI stack requires another round of governance engineering. The result is a governance posture that lags behind the data stack it is supposed to govern, often by months.
The architectural shift that resolves this is not a tooling upgrade. It is a structural one. Governance needs to be a layer, not a property of individual pipelines. It needs to sit above all data systems simultaneously, reconcile their different definitions of meaning and access, and serve that governed interpretation to every AI query through a single path. When MongoDB stores operational documents and records at scale, the governance layer above it knows which documents carry access restrictions, how fields map to enterprise-wide metric definitions, and which version of a business rule applies in the current context.
The 99% of enterprise data currently invisible to AI is not waiting for a more capable model. It is waiting for the infrastructure that makes it governable. The bottleneck is not compute. It is semantic architecture, and the organizations that close this gap first will be running AI agents that can be trusted with decisions that actually matter to the business.
This architecture already runs in production. A MongoDB-native LazyFox customer, a European fintech, ships governed AI reporting on unstructured MongoDB data to its own users, with every metric resolved through governed definitions rather than raw field names. Since going live it has grown to 167% net revenue retention, without building the custom RAG pipeline such a product would otherwise require. LazyFox connected read-only to the systems already in place; nothing migrated.
“Once enterprises have consolidated and enriched their unstructured data, the vision is building fully agentic AI systems that can search, reason and act on the organization’s entire corpus.”
Winston Thomas, CDOTrends · November 2025“The real question is no longer about whether enterprises can unlock their unstructured data. It’s whether they can afford not to.”Winston Thomas, CDOTrends · “The 1% Problem: Why Your Enterprise Data Is Useless to AI” · November 2025
How to tell whether your architecture is feeding AI the 1% or the 100%.
For a mid-market or enterprise evaluation, the practical step is to treat data readiness as an architecture question and score it before committing the next AI budget. Gartner expects organizations to abandon 60% of AI projects through 2026 precisely because their data is not AI-ready. Five questions separate the projects that survive from the ones that stall:
Teams that can answer all five are already running governed AI. Teams that cannot are running AI on the 1%, and the gap between the two is a semantic layer, not a bigger model.
LazyFox gives your AI agents governed access to what your enterprise actually knows. It connects read-only to the systems you already run. Nothing migrates, nothing gets rebuilt.