CDOTrends · Research

The Data Is There.
Your AI Gets 1% of It.

IDC puts a number on what enterprise data teams already know: less than 1% of available data reaches generative AI. Not because models are not ready. Because the data is not.

Alexander Braun · November 2025 · 10 min read
Key Insights
In this article
“Traditional manual pipelines often take six to twelve months to build and break whenever source formats change.”
Winston Thomas, CDOTrends · “The 1% Problem: Why Your Enterprise Data Is Useless to AI” · November 2025
<1%
of enterprise data currently reaches generative AI systems. The rest sits in formats and structures AI cannot interpret without a semantic layer above them.
IDC, via CDOTrends · Nov 2025
90%
of enterprise-generated data is unstructured: emails, contracts, PDFs, technical manuals, call transcripts. Traditional ETL pipelines were not designed for any of it.
IDC, via CDOTrends · Nov 2025
6-12mo
to build a single AI data pipeline from scratch. A vendor format change can break it in a day, resetting months of engineering investment with no warning.
CDOTrends · Nov 2025
167%
Net revenue retention from a MongoDB-native LazyFox customer, a European fintech that ships governed AI reporting on unstructured MongoDB data to its own users, with no custom RAG pipeline.
LazyFox customer data · 2026
Executive Summary
Key Finding
Despite years of AI investment, less than 1% of enterprise data reaches generative AI systems. The other 99% sits in formats AI cannot interpret: contracts, manuals, call transcripts, and policy documents that carry the institutional knowledge organizations want AI to act on.
Root Cause
Enterprise data is structurally inaccessible to AI. 90% is unstructured, and traditional data pipelines were not built for it. RAG implementations chunk documents arbitrarily, stripping tables, hierarchies, and conditional business rules. What reaches the model is context-free fragments of data that was rich and meaningful at the source.
Market Requirement
Enterprises need a semantic architecture that understands document structure before AI touches it, enforces governed access, reconciles conflicting definitions across systems, and does not require six months of pipeline work to connect each new data source.
How LazyFox Delivers on This LazyFox
Structural and Logical Context Before the Model Sees Data
LazyFox's structural layer maps every connected system's schema and data relationships. The logical layer captures business metric definitions as governed, versioned code. When MongoDB stores documents and operational records, LazyFox ensures AI has governed definitions of what those records mean, before any query runs.
Contextual Indexing of Tribal Knowledge
The 99% of data that stays dark is not only unstructured at the file level. Much of it is conditional: which system is authoritative for which deals, which metric definition applies to which fiscal year, which regional exception overrides the global rule. LazyFox's contextual layer captures these business rules in natural language and serves them to agents at runtime without re-processing on each call.
Cross-System Governance Without Data Migration
LazyFox sits above existing data systems without requiring data to move. MongoDB handles document storage and unstructured data at scale; LazyFox governs how AI interprets what is inside. Access controls, semantic filters, and role-based permissions flow through the governance layer, not through brittle pipeline logic that breaks when a format changes.
Token Efficiency & Vendor Independence
Business context is indexed once. Every subsequent agent query runs from governed code, with no re-tokenization per call and no organizational knowledge migrating into a model provider's weights. The semantic governance layer is a company asset. Swapping model providers does not restart institutional memory.
Read the full analysis below
The Problem

Your Data Speaks. Your AI Isn’t Listening.

Less than 1% of enterprise data reaches AI. The gap is not model capability. It is data architecture.

Less than 1% of enterprise data currently reaches generative AI systems. IDC published this figure in late 2025, and it cuts through the noise of AI investment announcements with unusual clarity. The models are ready. The data is not.

The 99% sitting outside AI’s reach is not missing because of model limitations. It is missing because enterprise data was never built to be machine-readable in the way AI requires. The rows-and-columns world of SQL databases and BI tools represents a small fraction of what enterprises actually know. Contracts, policy documents, call transcripts, technical manuals, and email threads that carry institutional knowledge exist in formats that standard data pipelines were not designed to handle.

Three compounding problems explain the gap: pipeline fragility, context-destroying document chunking, and governance failures that create liability every time an AI agent retrieves content it should not see. Each is familiar to data teams individually. Together they explain why enterprises can invest heavily in AI infrastructure and still find their agents answering questions with a fraction of the data available to them.

The data problem is not a quantity problem. It is a structure and governance problem. Adding more storage or more capable models does not close it. The gap closes when there is a semantic layer between data systems and AI agents that understands what data means, who can access it, and how conflicting definitions across systems get resolved before a query runs.

“Traditional manual pipelines often take six to twelve months to build and break whenever source formats change.”

Winston Thomas, CDOTrends · November 2025
Finding 1

Six Months to Build. One Format Change to Break.

Enterprises are running AI on infrastructure built for a world where data was tidy and static.

Building a data pipeline to feed AI takes six to twelve months. That is a real investment before a single agent query runs reliably. The fragility is the core problem, not the timeline.

When a vendor changes a file format, a system migration alters a schema, or a new product line adds data categories absent from the original specification, the pipeline breaks. Months of engineering become an ongoing maintenance obligation rather than a one-time investment. Enterprises end up with AI systems that are technically deployed but operationally stalled, waiting for pipelines to catch up with a business that keeps moving.

Traditional ETL was built for known, stable schemas: move data from A to B when both A and B have predictable shapes. Enterprise data today spans CRM systems, ERP layers, MongoDB document collections, legacy databases, and cloud data warehouses, each with its own conventions about what a field name means and how records relate. A pipeline ingesting from three of those systems simultaneously is actually managing three different semantic assumptions about the same underlying business reality.

Every field mapping, every business rule encoded in pipeline logic, every exception handler represents a human decision about what data means. That decision lives inside the pipeline itself. When the pipeline breaks or the team that built it moves on, the decision disappears. The next team rebuilds from scratch, making slightly different assumptions, introducing the kind of metric drift that corrupts AI answers months after deployment with no visible warning.

The 6-12 month build time is not a symptom of poor execution. It is the cost of manually encoding semantic understanding into infrastructure that was never designed to carry it. The answer is not to build faster pipelines. It is to separate semantic governance from pipeline plumbing: capture what data means once, in a governed layer above the systems, and let pipelines do the mechanical work they were always built for. This is what LazyFox's AI-powered data catalog automates: it scans databases, document stores, and PDFs, infers relationships, and generates the semantic metadata in minutes rather than months of pipeline engineering.

“Six months to prep data that becomes obsolete the moment a vendor changes a file format. It’s the enterprise equivalent of building a bridge that collapses every time it rains.”

Winston Thomas, CDOTrends · November 2025

Same enterprise, same data. Two architectures. What reaches the AI depends entirely on what sits between the data systems and the agent.

Without Semantic Governance
Enterprise data systems
MongoDB docs, CRM records, ERP tables, PDF contracts
Manual pipeline (6-12 months)
Encodes semantic assumptions inside brittle ETL code
Breaks on format change
Arbitrary document chunking
Tables split from headers. Clauses divorced from definitions. Context stripped.
No structural understanding
AI agent query
Receives less than 1% of enterprise data, with structural context removed
Answer may be statistically plausible. Governance failures are invisible until they surface in a decision that matters.
With LazyFox Semantic Governance
Enterprise data systems
MongoDB docs, CRM records, ERP tables, PDF contracts
LazyFox Semantic Layer
Structural + Logical + Contextual layers index meaning once at ingestion, across all connected systems
Indexed once. Governed always.
Governed metric definitions
Business rules, access controls, and cross-system reconciliation resolved before any query
AI agent query
Receives governed context from the full data corpus, not arbitrary text chunks
Answer grounded in governed definitions. Access controls enforced. Conflicting metrics reconciled before the model sees them.
Without a semantic governance layer, each pipeline encodes its own assumptions about what data means. Those assumptions drift, conflict, and break under change, silently.
LazyFox captures meaning at indexing time, once, across all connected systems. Pipelines move data. The governance layer tells AI what it means.
Finding 2

RAG Was Supposed to Fix This.

Grounding models in real documents sounds like the answer. Arbitrary chunking makes it wrong in practice.

Retrieval-augmented generation arrived as the enterprise answer to AI hallucination. Instead of relying on what a model learned in training, ground it in real documents. Let it retrieve relevant content and answer from evidence. The logic is sound. The implementation problem lies in what “retrieve” actually means.

Standard RAG implementations chunk documents into fixed-size text blocks and embed them as vectors. A query arrives, the system finds the most similar chunks, and feeds them to the model. For simple question-answering against homogeneous text, this produces acceptable results. When the answer depends on document structure, it fails in ways that are hard to diagnose and harder to explain to business stakeholders who only see the wrong answer.

Financial policy documents have tables. Those tables have column headers that determine what the numbers mean. Technical manuals have procedures where the sequence of steps matters. Contracts have clauses that reference definitions established earlier in the document. Chunk these at arbitrary text boundaries and you separate context from content. The model receives a number without the column header. A step without the procedure name. A clause without the definition it depends on. The result is not hallucination in the model-training sense; it is comprehension failure caused by structurally degraded input.

Enhanced approaches that extract tables, hierarchies, and semantic relations before vectorization improve accuracy meaningfully. This is genuine progress. But even these approaches answer the wrong question. They ask: which chunks of text are most relevant to this query? They do not ask: what does this enterprise mean by “contract value” in this document, from this business unit, under this fiscal-year convention? That is not a retrieval question. It is a governance question, and vector similarity cannot resolve it.

MongoDB handles documents natively at scale, storing contracts, records, and operational data in flexible formats without forcing schema rigidity on source systems. But the question of what those documents mean, which version of a definition is authoritative, and which records a given AI agent is permitted to access, those questions require a semantic governance layer above the database. The database tells you where the data is. The governance layer tells AI what the data means and how to use it reliably.

“Most RAG implementations treat documents like word salad, chunking text arbitrarily and losing critical context.”

Winston Thomas, CDOTrends · November 2025
Read the deep dive: LazyFox vs. RAG, why retrieval isn't governance

The same metric, defined four different ways across four connected systems. Without a governance layer, every AI query resolves this conflict on its own, differently each time.

MongoDB
Contract Value
Total committed ARR from signed_contracts collection, all status values included
Includes cancelled
CRM (Salesforce)
Contract Value
Closed-won opportunity value, excluding expansions logged after close date
Missing expansions
ERP
Contract Value
Invoiced amount this fiscal year, net of discounts, per GL account mapping
Invoiced ≠ committed
Data Warehouse
Contract Value
fct_revenue snapshot from last refresh; fiscal Q definition varies by region
Stale + regional drift
🦊
Semantic Governance Layer
LazyFox: Structural + Logical + Contextual
Cross-system reconciliation at indexing time
Served to every agent query from governed code
Governed Definition: served to AI agent
Contract Value
Net-new ARR from active contracts in MongoDB signed_contracts (status = active, churned excluded). Expansion ARR logged after close date included per 2025 policy. Source of truth: fct_revenue post-Q1 migration. Regional fiscal calendars normalized to global March 31 close date.
One answer. Four systems. Zero ambiguity at query time.
The Opportunity

Governance Is the Architecture, Not the Afterthought

The missing 99% is not waiting for a better model. It is waiting for infrastructure that makes it governable.

The governance problem is where enterprise AI risk actually lives. What happens when an AI agent retrieves a document it was not supposed to see? And the more insidious companion: what happens when it answers a query using a metric definition from one system that conflicts with the authoritative definition in another?

In any enterprise running more than two data systems, metric definitions diverge naturally over time. Finance defines revenue one way. The data warehouse uses a slightly different calculation. The CRM captures a third variant that reflects a different moment in the customer lifecycle. For human analysts, this is managed through institutional knowledge, escalation paths, and periodic reconciliation meetings. For an AI agent, it is a disambiguation problem with no built-in resolver unless the architecture provides one.

The answer most enterprises reach for is lineage tracking, role-based access controls, and governed metadata. These are the right categories. But implementing them at the pipeline level, adding permission checks to each ETL job, annotating metadata on each ingestion run, maintaining lineage records per dataset, scales poorly. Every new system connected to the AI stack requires another round of governance engineering. The result is a governance posture that lags behind the data stack it is supposed to govern, often by months.

The architectural shift that resolves this is not a tooling upgrade. It is a structural one. Governance needs to be a layer, not a property of individual pipelines. It needs to sit above all data systems simultaneously, reconcile their different definitions of meaning and access, and serve that governed interpretation to every AI query through a single path. When MongoDB stores operational documents and records at scale, the governance layer above it knows which documents carry access restrictions, how fields map to enterprise-wide metric definitions, and which version of a business rule applies in the current context.

The 99% of enterprise data currently invisible to AI is not waiting for a more capable model. It is waiting for the infrastructure that makes it governable. The bottleneck is not compute. It is semantic architecture, and the organizations that close this gap first will be running AI agents that can be trusted with decisions that actually matter to the business.

This architecture already runs in production. A MongoDB-native LazyFox customer, a European fintech, ships governed AI reporting on unstructured MongoDB data to its own users, with every metric resolved through governed definitions rather than raw field names. Since going live it has grown to 167% net revenue retention, without building the custom RAG pipeline such a product would otherwise require. LazyFox connected read-only to the systems already in place; nothing migrated.

“Once enterprises have consolidated and enriched their unstructured data, the vision is building fully agentic AI systems that can search, reason and act on the organization’s entire corpus.”

Winston Thomas, CDOTrends · November 2025
“The real question is no longer about whether enterprises can unlock their unstructured data. It’s whether they can afford not to.”
Winston Thomas, CDOTrends · “The 1% Problem: Why Your Enterprise Data Is Useless to AI” · November 2025
The Takeaway

Five Questions Before Your Next AI Data Initiative

How to tell whether your architecture is feeding AI the 1% or the 100%.

For a mid-market or enterprise evaluation, the practical step is to treat data readiness as an architecture question and score it before committing the next AI budget. Gartner expects organizations to abandon 60% of AI projects through 2026 precisely because their data is not AI-ready. Five questions separate the projects that survive from the ones that stall:

  • How much of your data can your AI agents actually reach today? If the honest answer is anywhere near IDC's 1%, the constraint is architecture, not model choice.
  • What breaks when a source format changes? If the answer is a pipeline and months of rework, semantic assumptions are living in the wrong layer.
  • Does your retrieval preserve document structure? Tables split from headers and clauses split from definitions produce confident wrong answers, not obvious failures.
  • Which definition of each core metric is authoritative, and where is that recorded? A wiki page or a Slack thread is not governance.
  • What stops an agent from retrieving a document it should not see? Access control belongs in a layer above the data systems, not re-implemented inside every pipeline.

Teams that can answer all five are already running governed AI. Teams that cannot are running AI on the 1%, and the gap between the two is a semantic layer, not a bigger model.

Share this article

Ready to govern the 99%?

LazyFox gives your AI agents governed access to what your enterprise actually knows. It connects read-only to the systems you already run. Nothing migrates, nothing gets rebuilt.