The leading knowledge platform for the financial technology industry
The leading knowledge platform for the financial technology industry

A-Team Insight Blogs

The Challenges and Opportunities of Data Lineage

Data lineage is driven by regulation and impeded by technology complexity and poor understanding, although once these impediments are tackled, successful implementation can yield significant business and operational benefits.

The challenges and opportunities of establishing a sustainable solution for data lineage were discussed during a recent A-Team Group webinar that was hosted by A-Team editor Sarah Underwood and joined by Johann van Biljon, data governance specialist at Rabobank; James Longstaff, vice president at Deutsche Bank; and Olivier Kenji Mathurin, head of strategic research at AIM Software.

Setting the scene for discussion an audience poll considered the drivers of data lineage. Regulation was named by respondents as the key driver, ahead of data value, client requests and market data costs. A second poll asked the webinar audience what is delaying data lineage projects. The results of this poll showed 46% of respondents identifying technology complexity as a problem, 20% noting a poor understanding of data lineage, and 15% noting either an absence of management buy-in or a lack of budget and resources.

The webinar speakers broadly agreed with the drivers noted in the first audience poll, saying data lineage is key to BCBS 239, but also an important factor of other regulations such as Dodd-Frank, European Market Infrastructure Regulation (EMIR), Markets in Financial Instruments Directive II (MiFID II) and the Fundamental Review of the Trading Book.

They described the essential elements of data lineage as meta data, glossaries, data management, data governance and automation, and noted challenges arising from high volumes of data, siloed data, and difficulties in mining outsourced and automated data.

Implementation, the speakers suggested, should start small and grow over time with a clear focus on end goals, including which parts of the organisation will access data lineage and what it will be used for. A successful implementation will optimise data flows, provide better insight into data, and allow redundant systems and data services to be identified and switched off.

Listen to the webinar to find out more about:

  • Drivers behind data lineage
  • Barriers to implementation
  • How to build and sustain data lineage
  • Outstanding challenges
  • Beneficial outcomes

Related content

WEBINAR

Recorded Webinar: Data management for ESG requirements

Environmental, Social and Governance (ESG) investing is moving into the mainstream, requiring asset managers to develop ESG strategies that deliver for both the firm and its investors. While these strategies can outperform those that do not include ESG factors, there is no clear route to success in an immature market that is only just beginning...

BLOG

Surveillance 2.0 – Turn Up the Signal, Wipe Out the Noise

By Joseph Schifano, Global Head of Regulatory Affairs, Eventus Systems. Trade surveillance is a complex discipline, dependent on the processing and filtering of masses of data. Its mandate is constantly increasing too, with the relentless iterations of regulatory and market change demanding the monitoring of more asset classes across more business lines and against an...

EVENT

Data Management Summit Europe Virtual

The Data Management Summit Europe Virtual brings together the European data management community to explore the latest challenges, opportunities and data innovations facing sell side and buy side financial institutions.

GUIDE

Entity Data Management Handbook – Seventh Edition

Sourcing entity data and ensuring efficient and effective entity data management is a challenge for many financial institutions as volumes of data rise, more regulations require entity data in reporting, and the fight again financial crime is escalated by bad actors using increasingly sophisticated techniques to attack processes and systems. That said, based on best...