About a-team Marketing Services
The knowledge platform for the financial technology industry
The knowledge platform for the financial technology industry

A-Team Insight Blogs

Opinion: Data Management – Taking the Bus Without a Map?

Subscribe to our newsletter

Nick Jones, Senior Consultant, Citisoft PLC.

The first maps were probably scratched with sticks on the ground for people from the same locality who knew the surrounding area. Now when travelling we use satellite navigation. But when navigating data it feels as if we are still scratching around. We use electronic documents, not sticks, but we do still need data ‘locals’ to interpret the data geography. Isn’t it time that we had data maps to direct us?

Sticks in the Mud

Locals just know where things are; the landmarks and routes between them. The same is true with older systems that you work with. You know where the data you want is, and how to get to it. You also know that the direct route would be a tunnel through the data mountain; but that the slow narrow track around is the only current option.

Here Be Dragons

Outside your local area, in unfamiliar territory, you rely on previous visitors’ accounts. Regrettably, this is as far as data navigation gets many organisations. Like mediaeval maps, our own data maps show only the outlines of continents: entity and reference data surrounded by oceans of accounting and transaction flows. There are large areas of positional and valuation data where the shores are known, but the interiors are marked ‘Here be dragons’. And sadly, when expeditions are undertaken into these lesser-known areas the knowledge gained is not then added to the map. (The explorers are sent on another expedition, and sketches or notes they leave behind are lost or ignored!)

So, can data mapping move closer to the standardised mapping that emerged from the UK’s Ordnance Survey? If so, where could it go from there?

Ordnance Survey – the Paper Maps and the Parallels

When the UK Ordnance Survey (OS) started “…Europe was in turmoil, and there were real fears that the French Revolution might sweep across the English Channel. Realising the danger, the government ordered its defence ministry – the Board of Ordnance – to begin a survey of England’s vulnerable southern coasts.”

Post-2008, the financial services sector is under threat from the costs of regulation and downward pressure on margins. A rational response to this threat is to understand and document areas of vulnerability.

The OS’s mapping didn’t end at the south coast of England. Once maps had been produced they proved valuable for other purposes. Further mapping was driven first by taxation (FATCA now?) and then by the growth of the railways, whose engineers needed detailed maps (a need to access and integrate more volume and variety with more velocity today?).

The OS’s early work used new technology – a large theodolite capable of measuring angles and elevations very precisely. Now tools to provide data navigators with a clearer picture of their landscape are available. The OS also integrated existing and developing technologies. Photographic apparatus produced maps at different scales, and a method of producing printing plates (photo zincography) was developed. Now there is already scope for existing ETL frameworks and Model Driven Development tools to be used and there are BI and visualisation tools for exploring a data landscape.

However, there are too few detailed data maps around which these technologies can coalesce. Data groundwork, surveying, mapping and publication are needed to ensure that a whole organisation can refer to the same map. It is not necessary to survey the whole landscape to make progress. Properly surveying and mapping one or two ‘threat’ areas should be sufficient to show the benefits. Once the map exists data navigators can set off in the right direction and know roughly how long the journey will take.

Take the Bus?

Putting data on the Enterprise Service Bus (ESB) can make good sense. An ESB efficiently delivers its data passengers to all subscriber stops along its route; but without a good route map there is a risk that data passengers will be loaded onto the bus ‘just in case’. They will then be taken on unnecessary journeys. At each stop they will disembark, find they are lost, and travel on until reaching a destination where they are expected and welcomed.

The bus moves data passengers quickly and economically, but without a data map it can end up moving the wrong data to the wrong places (as well as the correct data to the correct places). With a data landscape map it becomes possible to plan data passenger journeys to maximise transport efficiency.

Subscribe to our newsletter

Related content

WEBINAR

Recorded Webinar: How to simplify and modernize data architecture to unleash data value and innovation

The data needs of financial institutions are growing at pace as new formats and greater volumes of information are integrated into their systems. With this has come greater complexity in managing and governing that data, amplifying pain points along data pipelines. In response, innovative new streamlined and flexible architectures have emerged that can absorb and...

BLOG

AI is Helping to Solve New ESG Data Challenges: ESG Briefing Review

The peculiar demands that ESG data integration places on capital markets participants requires powerful techniques that are increasingly being provided through artificial intelligence, A-Team Group’s recent ESG Data and Tech Briefing London heard. From data quality monitoring and analytics to supply chain analysis and investment management, AI-based tools are already offering automated solutions to some...

EVENT

Data Management Summit London

Now in its 16th year, the Data Management Summit (DMS) in London brings together the European capital markets enterprise data management community, to explore how data strategy is evolving to drive business outcomes and speed to market in changing times.

GUIDE

AI in Capital Markets: Practical Insight for a Transforming Industry – Free Handbook

AI is no longer on the horizon – it’s embedded in the infrastructure of modern capital markets. But separating real impact from inflated promises requires a grounded, practical understanding. The AI in Capital Markets Handbook 2025 provides exactly that. Designed for data-driven professionals across the trade life-cycle, compliance, infrastructure, and strategy, this handbook goes beyond...