The leading knowledge platform for the financial technology industry
The leading knowledge platform for the financial technology industry

A-Team Insight Blogs

The Challenges and Opportunities of Data Lineage

Data lineage is driven by regulation and impeded by technology complexity and poor understanding, although once these impediments are tackled, successful implementation can yield significant business and operational benefits.

The challenges and opportunities of establishing a sustainable solution for data lineage were discussed during a recent A-Team Group webinar that was hosted by A-Team editor Sarah Underwood and joined by Johann van Biljon, data governance specialist at Rabobank; James Longstaff, vice president at Deutsche Bank; and Olivier Kenji Mathurin, head of strategic research at AIM Software.

Setting the scene for discussion an audience poll considered the drivers of data lineage. Regulation was named by respondents as the key driver, ahead of data value, client requests and market data costs. A second poll asked the webinar audience what is delaying data lineage projects. The results of this poll showed 46% of respondents identifying technology complexity as a problem, 20% noting a poor understanding of data lineage, and 15% noting either an absence of management buy-in or a lack of budget and resources.

The webinar speakers broadly agreed with the drivers noted in the first audience poll, saying data lineage is key to BCBS 239, but also an important factor of other regulations such as Dodd-Frank, European Market Infrastructure Regulation (EMIR), Markets in Financial Instruments Directive II (MiFID II) and the Fundamental Review of the Trading Book.

They described the essential elements of data lineage as meta data, glossaries, data management, data governance and automation, and noted challenges arising from high volumes of data, siloed data, and difficulties in mining outsourced and automated data.

Implementation, the speakers suggested, should start small and grow over time with a clear focus on end goals, including which parts of the organisation will access data lineage and what it will be used for. A successful implementation will optimise data flows, provide better insight into data, and allow redundant systems and data services to be identified and switched off.

Listen to the webinar to find out more about:

  • Drivers behind data lineage
  • Barriers to implementation
  • How to build and sustain data lineage
  • Outstanding challenges
  • Beneficial outcomes

Related content

WEBINAR

Recorded Webinar: Managing the transaction reporting landscape post Brexit: MiFID II, SFTR, EMIR

The transaction reporting landscape has, for many financial institutions, expanded considerably in size since the end of the UK’s Brexit transition period on 31 December 2020 and the resulting need for double reporting of some transactions to both EU and UK authorities. It has also changed dramatically following the UK government’s failure to reach equivalence...

BLOG

A-Team Group Names Winners of Data Management Insight Awards 2020

A-Team Group has announced the winners of its prestigious Data Management Insight Awards 2020. The annual awards, now in their eighth year, recognise leading providers of data management solutions, services and consultancy to capital markets participants. The award winners were announced online across categories ranging from best sell-side and buy-side data management platforms to best...

EVENT

RegTech Summit New York City

Now in its 5th year, the RegTech Summit in NYC explores how the North American financial services industry can leverage technology to drive innovation, cut costs and support regulatory change.

GUIDE

Entity Data Management Handbook – Seventh Edition

Sourcing entity data and ensuring efficient and effective entity data management is a challenge for many financial institutions as volumes of data rise, more regulations require entity data in reporting, and the fight again financial crime is escalated by bad actors using increasingly sophisticated techniques to attack processes and systems. That said, based on best...