About a-team Marketing Services
The knowledge platform for the financial technology industry

A-Team Insight Blogs

How to Tackle the Exorbitant Cost of Sourcing and Cleansing Market Data

Subscribe to our newsletter

The financial industry spends $28.5 billion on externally sourced market data and a further $2-3 billion cleaning it up so that is can be used internally. Why is this so difficult and costly, and what can the industry and market participants do about it?

Peter Moss, CEO of the SmartStream Reference Data Utility (RDU), will discuss the problems of market data and some potential solutions during a keynote presentation at A-Team Group’s London Data Management Summit on Thursday 21 March 2019.

Moss suggests that in a market where products are defined by data and traded using data mechanisms, the data should be standardised – but this is not the case due to factors such as differences in securities identifiers, a lack of identifiers in some capital markets, data attributes represented differently across data sources, problems with classification, and different identifiers for market participants – the LEI, by way of example, is a global identifier that is only mandated across Europe, so adoption has been patchy outside Europe.

On top of these problems, Moss notes the fluidity of capital markets, in which products are created and dropped on a continuous basis, and the impact on equity data of a constant stream of corporate actions.

He says: “It is very difficult to maintain all the data that is required in a straightforward way across an organisation. The truth is that data standards are not precise enough in an environment where data comes from a huge number of sources. Data vendors pull some of the data together, but it is not possible for a firm to get all required data from one source, which becomes a challenge for the firm.”

As well as considering these challenges during his keynote, Moss will discuss industry initiatives and firms efforts’ to improve matters, and the potential of utilities to short circuit some of the problems and provide firms with cleansed data.

Subscribe to our newsletter

Related content

WEBINAR

Recorded Webinar: Executing the Migration to Cloud to Enable Scalability and Innovation

Cloud-based services and processing have become essential to financial institutions as their data management demands have become more complex and expansive. Thousands of organisations have made the jump from their limited on-premises tech stacks to the near-infinite scalability opportunities of public and private clouds. They have also been motivated by the need to modernise their...

BLOG

3forge Seeks to Simplify the Complexity of Modern Data Management Demands

The high level of data and data product use-case customisation among financial institutions offers an insight into the challenges that technology teams face in managing their organisations’ data. Observability has become more difficult as each data user tailors their tech provisions to their own business needs and data provisioning must be similarly responsive at a...

EVENT

Data Management Summit London

Now in its 17th year, Data Management Summit (DMS) London returns In April 2027, to explore how to use data and AI to drive measurable business outcomes reliably, repeatedly and at scale.

GUIDE

Regulatory Data Handbook 2026 – Fourteenth Edition

Welcome to the fourteenth edition of A-Team Group’s Regulatory Data Handbook. Supervisors increasingly expect firms to demonstrate which rules apply, which data supports each obligation, who owns the control and how exceptions are identified and resolved. Policies and implementation programmes must now be supported by records that can withstand regulatory scrutiny. This edition examines material...