About a-team Marketing Services
The knowledge platform for the financial technology industry
The knowledge platform for the financial technology industry

A-Team Insight Blogs

The Challenges and Opportunities of Data Lineage

Subscribe to our newsletter

Data lineage is driven by regulation and impeded by technology complexity and poor understanding, although once these impediments are tackled, successful implementation can yield significant business and operational benefits.

The challenges and opportunities of establishing a sustainable solution for data lineage were discussed during a recent A-Team Group webinar that was hosted by A-Team editor Sarah Underwood and joined by Johann van Biljon, data governance specialist at Rabobank; James Longstaff, vice president at Deutsche Bank; and Olivier Kenji Mathurin, head of strategic research at AIM Software.

Setting the scene for discussion an audience poll considered the drivers of data lineage. Regulation was named by respondents as the key driver, ahead of data value, client requests and market data costs. A second poll asked the webinar audience what is delaying data lineage projects. The results of this poll showed 46% of respondents identifying technology complexity as a problem, 20% noting a poor understanding of data lineage, and 15% noting either an absence of management buy-in or a lack of budget and resources.

The webinar speakers broadly agreed with the drivers noted in the first audience poll, saying data lineage is key to BCBS 239, but also an important factor of other regulations such as Dodd-Frank, European Market Infrastructure Regulation (EMIR), Markets in Financial Instruments Directive II (MiFID II) and the Fundamental Review of the Trading Book.

They described the essential elements of data lineage as meta data, glossaries, data management, data governance and automation, and noted challenges arising from high volumes of data, siloed data, and difficulties in mining outsourced and automated data.

Implementation, the speakers suggested, should start small and grow over time with a clear focus on end goals, including which parts of the organisation will access data lineage and what it will be used for. A successful implementation will optimise data flows, provide better insight into data, and allow redundant systems and data services to be identified and switched off.

Listen to the webinar to find out more about:

  • Drivers behind data lineage
  • Barriers to implementation
  • How to build and sustain data lineage
  • Outstanding challenges
  • Beneficial outcomes
Subscribe to our newsletter

Related content

WEBINAR

Recorded Webinar: End-to-End Lineage for Financial Services: The Missing Link for Both Compliance and AI Readiness

The importance of complete robust end-to-end data lineage in financial services and capital markets cannot be overstated. Without the ability to trace and verify data across its lifecycle, many critical workflows – from trade reconciliation to risk management – cannot be executed effectively. At the top of the list is regulatory compliance. Regulators demand a...

BLOG

Growing Modern Data Platforms Adoption Seen as Benefits Become Apparent: Webinar Review

Take-up of modern data platforms (MDPs) is expected to accelerate in the next few years as financial institutions realise the greater agility, scalability and deeper insights offered by the innovation. Organisations that have so far been relatively slow to adopt the streamlined platforms – because they have been unsure of the technologies’ benefits – will...

EVENT

Buy AND Build: The Future of Capital Markets Technology

Buy AND Build: The Future of Capital Markets Technology London examines the latest changes and innovations in trading technology and explores how technology is being deployed to create an edge in sell side and buy side capital markets financial institutions.

GUIDE

The DORA Implementation Playbook: A Practitioner’s Guide to Demonstrating Resilience Beyond the Deadline

The Digital Operational Resilience Act (DORA) has fundamentally reshaped the European Union’s financial regulatory landscape, with its full application beginning on January 17, 2025. This regulation goes beyond traditional risk management, explicitly acknowledging that digital incidents can threaten the stability of the entire financial system. As the deadline has passed, the focus is now shifting...