About a-team Marketing Services
The knowledge platform for the financial technology industry
The knowledge platform for the financial technology industry

A-Team Insight Blogs

How to Get Data Lineage Right for Regulatory Compliance and Change

Subscribe to our newsletter

Data lineage for regulatory compliance continues to be a challenge, with financial institutions citing problems including managing lineage across multiple systems and new and changing regulatory requirements during a recent A-Team Group webinar on tracking data lineage for regulatory compliance and change.

If these are the challenges, a poll of the webinar audience showed that the benefits of getting data lineage right go beyond avoiding the wrath of the regulator and can encompass a better understanding of data, improved operations and new business opportunities. Also, the ability to identify and shut down redundant systems to reduce costs.

The webinar was hosted by A-Team editor Sarah Underwood and joined by Mike Smith, head of data strategy, governance and privacy at Citi USCCM; Duncan Cooper, application specialist at Bloomberg PolarLake; Simon Hankinson, global financial services market lead at Collibra; and Sue Habas, vice president, strategic technologies at ASG Technologies.

The speakers discussed progress financial institutions have made on data lineage and the regulatory drivers behind its development. Cooper commented: “Regulations have always hinted at data lineage requirements, but BCBS 239 makes it front and centre as it requires more insight into, and investment in, data quality to ensure business decisions can be tracked.”

Adding to the data management challenges of data lineage noted above, Cooper described the need to consolidate all data in a standardised way so that it can be tracked and traced. Hankinson talked about tactical approaches and manual processes used to capture lineage at some firms, and suggested that when these issues are resolved, firms should consider first how to organise and maintain data lineage such that it is useful to the organisation. Looking at how to tackle the challenges, he said: “Firms have realised that documenting lineage, often in Excel, is neither efficient or sustainable. Best practice realises the value of data lineage to the business and makes it easy for consumers to find data.”

Considering a step-by-step approach to lineage, Habas explained: “The scope of data lineage has to be well defined and you need a blueprint of the systems landscape. You can then tackle selected applications. If you trace lineage backwards it is easier than tracing from source. Then, take an iterative approach and once lineage is complete don’t stop. Instead, take steps to industrialise the process.”

The webinar speakers moved on to discuss the capabilities to look for when choosing a data lineage provider and the relationships between lineage, governance and quality. Offering some final words of advice to data practitioners working on data lineage, Smith said: “Define where in the business data lineage needs to be understood, run an automated proof of concept against manual processes, and evaluate the outcomes. Aim to achieve small wins.”

Habas added: “Make sure you have a baseline, a before and after picture, and a good data strategy that will support quick wins and help you move through the challenges.”

Hankinson commented: “On its own, data lineage has a relatively low value. The opportunity is to improve the reliability of data for the business.” Cooper concluded: “Offer examples of how data lineage could help your firm make money and mitigate risk, then start with something small, but important, to the business and build out from there.”

Listen to the webinar to find out about:

  • Progress on data lineage
  • Regulatory requirements
  • Data Management challenges
  • Best practice approaches
  • Benefits beyond compliance
Subscribe to our newsletter

Related content


Recorded Webinar: Best practice approaches to integrating legacy data with the cloud

Acceleration of cloud adoption, increasing demand for digital transformation and real-time data management have led financial institutions to rethink their data infrastructure to enable more agile operating models that can respond faster to change and make data a competitive advantage. For many, integrating data from legacy systems and data across the business landscape with a...


BTP is on a mission to build trust in capital markets, Chronicle is its digital provenance solution

Provenance can be a problem, but there are answers as vendors such as BTP move into the space with solutions that help financial institutions gain confidence in the provenance of capital markets related assets such as data, financial instruments, commodities, and regulatory reports. The company’s digital provenance solution, Chronicle, was made generally available in autumn...


RegTech Summit London

Now in its 8th year, the RegTech Summit in London will bring together the RegTech ecosystem to explore how the European capital markets financial industry can leverage technology to drive innovation, cut costs and support regulatory change.


Regulatory Data Handbook 2023 – Eleventh Edition

Welcome to the eleventh edition of A-Team Group’s Regulatory Data Handbook, a popular publication that covers new regulations in capital markets, tracks regulatory change, and provides advice on the data, data management and implementation requirements of more than 30 regulations across UK, European, US and Asia-Pacific capital markets. This edition of the handbook includes new...