About a-team Marketing Services
The knowledge platform for the financial technology industry
The knowledge platform for the financial technology industry

A-Team Insight Blogs

The Challenges and Opportunities of Data Lineage

Subscribe to our newsletter

Data lineage is driven by regulation and impeded by technology complexity and poor understanding, although once these impediments are tackled, successful implementation can yield significant business and operational benefits.

The challenges and opportunities of establishing a sustainable solution for data lineage were discussed during a recent A-Team Group webinar that was hosted by A-Team editor Sarah Underwood and joined by Johann van Biljon, data governance specialist at Rabobank; James Longstaff, vice president at Deutsche Bank; and Olivier Kenji Mathurin, head of strategic research at AIM Software.

Setting the scene for discussion an audience poll considered the drivers of data lineage. Regulation was named by respondents as the key driver, ahead of data value, client requests and market data costs. A second poll asked the webinar audience what is delaying data lineage projects. The results of this poll showed 46% of respondents identifying technology complexity as a problem, 20% noting a poor understanding of data lineage, and 15% noting either an absence of management buy-in or a lack of budget and resources.

The webinar speakers broadly agreed with the drivers noted in the first audience poll, saying data lineage is key to BCBS 239, but also an important factor of other regulations such as Dodd-Frank, European Market Infrastructure Regulation (EMIR), Markets in Financial Instruments Directive II (MiFID II) and the Fundamental Review of the Trading Book.

They described the essential elements of data lineage as meta data, glossaries, data management, data governance and automation, and noted challenges arising from high volumes of data, siloed data, and difficulties in mining outsourced and automated data.

Implementation, the speakers suggested, should start small and grow over time with a clear focus on end goals, including which parts of the organisation will access data lineage and what it will be used for. A successful implementation will optimise data flows, provide better insight into data, and allow redundant systems and data services to be identified and switched off.

Listen to the webinar to find out more about:

  • Drivers behind data lineage
  • Barriers to implementation
  • How to build and sustain data lineage
  • Outstanding challenges
  • Beneficial outcomes
Subscribe to our newsletter

Related content

WEBINAR

Recorded Webinar: New opportunities to scale data operations

Faced with tough competition and ongoing pressure on margins, many firms are reviewing their operating models and assessing whether they can reallocate more resources to high-value projects by outsourcing commoditised processes including data operations. This webinar will explore the different approaches that buy-side and sell-side firms are adopting to scale their data operations, including market...

BLOG

FactSet Releases LLM-Based Knowledge Agent for Junior Bankers

FactSet, a digital platform and enterprise solutions provider, has released the beta version of FactSet Mercury, a knowledge agent based on a large language model (LLM) and designed to power digital workflows and enhance fact-based decision making. The solution optimises company research workflows for junior bankers, offering a single, trusted conversational interface to access key...

EVENT

Buy AND Build: The Future of Capital Markets Technology, London

Buy AND Build: The Future of Capital Markets Technology London on September 19th at Marriott Hotel Canary Wharf London examines the latest changes and innovations in trading technology and explores how technology is being deployed to create an edge in sell side and buy side capital markets financial institutions.

GUIDE

Regulatory Data Handbook 2023 – Eleventh Edition

Welcome to the eleventh edition of A-Team Group’s Regulatory Data Handbook, a popular publication that covers new regulations in capital markets, tracks regulatory change, and provides advice on the data, data management and implementation requirements of more than 30 regulations across UK, European, US and Asia-Pacific capital markets. This edition of the handbook includes new...