Semantic layers have become critical to financial institutions as they have expanded the use of artificial intelligence agents and widened staff access to them. The sophisticated interfaces give non-technical users the ability to guide agents to interact with their firms’ data and build efficient workflows.
And yet, few organisations have really got their teeth into the technology. At A-Team Group’s most recent Data Management Insight webinar, capital markets participants in the audience indicated they were far from deploying the structures at scale.
In a survey, none said they had fully implemented semantic layers, while the largest proportion of respondents – a little more than half of them – said the technology was still a work in progress or at the proof-of-concept stage.
A surprisingly high 44% said they were still exploring the use of semantic layers in their tech stacks.
Compound Errors
While the results indicated the immaturity of the technology, the webinar‘s panel of experts said that the primary hurdle to enterprise adoption is non-technical: achieving consensus across disparate business units regarding core definitions.
When building semantic assets to support automated workflows, any ambiguity in a business definition causes compound errors downstream within automated agents.
Chief data officers are advised to avoid attempting comprehensive, organisation-wide coverage from the outset, the webinar heard. A more effective strategy focuses on “prioritising definition quality over model breadth”, the experts said.
Essential Tools
The webinar, which saw Jez Davies, Chief Information Architect at Northern Trust and Matej Matoulek, Senior Product Manager at Ataccama, join moderator Sarah Underwood, an editor at Data Management Insight, established that semantic layers are essential to capital markets.
While natural language interfaces allow business users and quantitative analysts to query complex datasets without writing structured query language, language models operate as probabilistic engines that lack inherent domain understanding.
In an industry where regulatory reporting to bodies such as the Financial Conduct Authority or the Federal Reserve demands absolute numerical precision, relying solely on unguided model outputs introduces unacceptable risk.
To bridge this gap between probabilistic software and deterministic enterprise reporting, financial institutions are implementing semantic layers.
These consist of digital instructions and semantic models that define enterprise metrics, facts and numerical dimensions. They serve as an intermediary between non-technical end-users and complex underlying technology stacks.
In the context of capital markets, where identical terms such as exposure or net yield can carry differing definitions across trading desks, risk functions, and accounting units, the semantic layer provides a unified business definition. This structure is especially critical when deploying artificial intelligence agents that translate natural language requests into database queries.
Construction Challenges
Building an effective semantic framework requires modernising the underlying data architecture. Capital markets institutions have progressed from monolithic data warehouses and uncurated data lakes toward hybrid data mesh models supported by modern cloud platforms. However, building semantic layers is proving difficult for market participants, a further poll found.
When questioned on what they found to be the biggest hurdle to adopting the technology, webinar attendees offered a plurality of reasons, which were given roughly equal weighting.
The most common impediment cited was the technical complexity of building semantic layers and the cost and return on investment they offered. A slightly lower proportion said they lacked the skills and resources to implement them and fewer still said political or cultural issues were roadblocks.
A persistent challenge for financial technology leaders is avoiding vendor lock-in across fragmented technology estates. Proprietary semantic definitions locked within specific business intelligence tools or platform vendors impede metadata mobility across enterprise catalogues, transformation engines and analytical front-ends.
To establish vendor-neutral metadata exchange, a coalition of major financial institutions – including Northern Trust, BlackRock, JPMorgan, and Bloomberg – co-founded the Open Semantic Interchange under the Apache Software Foundation.
By establishing an open, YAML-based standard, Apache OSI permits semantic models to be defined once and translated seamlessly across diverse platforms. Software providers are increasingly contributing converters to this framework, ensuring that business definitions and trust signals flow uninhibited across the entire data estate.
The transition towards natural language interfaces and autonomous software agents represents a fundamental shift in how capital markets professionals interact with data. However, automated intelligence is only as reliable as the semantic foundation supporting it.
By establishing clear business definitions, embedding semantic models directly into execution platforms, and committing to open metadata standards, financial technology leaders can deploy automated agents that deliver consistent, regulatory-grade insights across the enterprise.
Subscribe to our newsletter
