About a-team Marketing Services
The knowledge platform for the financial technology industry

A-Team Insight Blogs

How to Tackle the Exorbitant Cost of Sourcing and Cleansing Market Data

Subscribe to our newsletter

The financial industry spends $28.5 billion on externally sourced market data and a further $2-3 billion cleaning it up so that is can be used internally. Why is this so difficult and costly, and what can the industry and market participants do about it?

Peter Moss, CEO of the SmartStream Reference Data Utility (RDU), will discuss the problems of market data and some potential solutions during a keynote presentation at A-Team Group’s London Data Management Summit on Thursday 21 March 2019.

Moss suggests that in a market where products are defined by data and traded using data mechanisms, the data should be standardised – but this is not the case due to factors such as differences in securities identifiers, a lack of identifiers in some capital markets, data attributes represented differently across data sources, problems with classification, and different identifiers for market participants – the LEI, by way of example, is a global identifier that is only mandated across Europe, so adoption has been patchy outside Europe.

On top of these problems, Moss notes the fluidity of capital markets, in which products are created and dropped on a continuous basis, and the impact on equity data of a constant stream of corporate actions.

He says: “It is very difficult to maintain all the data that is required in a straightforward way across an organisation. The truth is that data standards are not precise enough in an environment where data comes from a huge number of sources. Data vendors pull some of the data together, but it is not possible for a firm to get all required data from one source, which becomes a challenge for the firm.”

As well as considering these challenges during his keynote, Moss will discuss industry initiatives and firms efforts’ to improve matters, and the potential of utilities to short circuit some of the problems and provide firms with cleansed data.

Subscribe to our newsletter

Related content

WEBINAR

Recorded Webinar: The Data Office at a Crossroads — AI Governance, Organisational Design, and the Evolving Mandate of the CDO

Who owns AI governance in a capital markets firm – and is the Data Office structured to bear that weight? These questions sit at the heart of A-Team Research’s latest findings, presented here for the first time: the combined results of two landmark surveys examining the role of the Data Office in AI governance and...

BLOG

Scaling the Unstructured: 10 Leaders in Intelligent Data Processing

Huge swaths of critical financial information, from private credit agreements and ESG disclosures to complex tax documentation, is locked in unstructured formats such as digital documents and PDFs. The manual bottleneck this creates for the middle and back office eats into valuable resources. A key means to achieving this, Intelligent Data Processing (IDP), represent a...

EVENT

TEST Event page 2

Now in its 15th year the TradingTech Summit London brings together the European trading technology capital markets industry and examines the latest changes and innovations in trading technology and explores how technology is being deployed to create an edge in sell side and buy side capital markets financial institutions.

GUIDE

Regulatory Data Handbook 2026 – Fourteenth Edition

Welcome to the fourteenth edition of A-Team Group’s Regulatory Data Handbook. Supervisors increasingly expect firms to demonstrate which rules apply, which data supports each obligation, who owns the control and how exceptions are identified and resolved. Policies and implementation programmes must now be supported by records that can withstand regulatory scrutiny. This edition examines material...