The leading knowledge platform for the financial technology industry
The leading knowledge platform for the financial technology industry

A-Team Insight Blogs

MarkLogic Responds to the Data Management Challenges of GDPR

This week’s big reveal of the ICO’s intention to fine British Airways £183.39 million for infringements of General Data Protection Regulation (GDPR) sent shock waves through industry, with an aftershock coming later in the week when the ICO issued a second notice, this time noting its intention to fine Marriott International £99,200,396 for GDPR breaches.

The Information Commissioner’s Office (ICO) made its first enforcement notice on July 6, 2018 on AggregateIQ Services, a Canadian company located outside the EU, but still holding and processing the data of UK citizens after GDPR and the Data Protection Act (DPA) 2018 came into force on May, 25 2018. This notice and 64 further enforcement actions by the ICO since GDPR and the DPA went live have gone pretty much unnoticed, leading industry participants to suggest the ICO would not bare its teeth.

These latest notices tell another story and hammer home the need to ensure data privacy and compliance with both GDPR and the DPA. But how best can this be achieved in the financial services industry, which holds enormous amounts of sensitive personal data? We recently caught up with David Gorbet, senior vice president of engineering at MarkLogic, to discuss the ongoing data management challenges of GDPR and their potential solutions.

The challenges of GDPR are well rehearsed and require organisations to fully understand how their client data is being used, where it is stored and who has access to it. From a data management perspective, challenges include the ability to track and trace personal data to prove what it is used for, access and share the data with data subjects in a timely manner, and ensure the ability to erase data across the organisation when a data subject brings the right to be forgotten into play – the whole underpinned by accurate and high quality data.

Gorbet notes the key requirements of GDPR compliance as data, integration and metadata, with metadata of an entity model being used to define what data is subject to GDPR policy and individual records being tracked to assure consent has been given to the use of personal data and adhere to policy.

He says: “The problem found in most database systems is that they use and consume data and relationships, but can’t store metadata for consent, which has to be handled elsewhere.” The MarkLogic data hub, essentially an enterprise NoSQL database platform that is designed to integrate, store, manage, and search huge amounts of data, addresses this problem by integrating all customer data and enriching it with metadata for consent.

A recent MarkLogic 360 event included user demonstrations of the platform as a means of achieving GDPR. Airbus, by way of example, described how it has attached metadata to its employee data model to understand the sensitivities of the data from a GDPR perspective. An insurance firm demonstrated how it uses the MarkLogic platform to track data, understand when and how it is transformed, and ensure all systems can see every piece of GDPR related data.

Gorbet comments: “Customers using our data hub and building data integration have a head start. They can leverage their investment to achieve GDPR compliance well and turn cost into benefit.”

Beyond GDPR, Gorbet says the data hub provides value by offering vertical use cases and solving technology problems horizontally. It is being used in capital markets to respond to regulatory reporting on a broad rather than regulation-by-regulation basis. He cites ABN Amro, which initially implemented the data hub for MiFID II compliance and is now using it to support other regulations. Customer 360 is another popular use case.

Coming soon from MarkLogic is a machine learning capability that is designed to make the hub smarter and allow models using data in the hub to be built and executed in real-time based on data coming into the hub. Suggested use cases include fraud prevention, perhaps through the identification of two records of the same person. The company now also offers a hosted version of the data hub.

Related content

WEBINAR

Recorded Webinar: Evolution of data management for the buy-side 2021

The buy-side faced a barrage of regulation in 2020 and is now under pressure to make post-Brexit adjustments and complete LIBOR transition by the end of 2021. To ensure compliance and ease the burden of in-house data management, many firms turned to outsourcing and managed services. But there is more to come, as buy-side firms...

BLOG

KX Takes kdb+ to the Next Level with KX Insights Cloud Native Streaming Analytics

KX has released KX Insights, a cloud native streaming analytics solution that provides fast, scalable real-time data insights without the capex and maintenance burden of on-premise infrastructure. KX Insights is built on the company’s cloud version of the kdb+ time series database and uses a microservices architecture that supports not only new KX users but...

EVENT

Data Management Summit USA Virtual

Now in its 11th year, the Data Management Summit USA Virtual explores the shift to the new world where data is redefining the operating model and firms are seeking to unlock value via data transformation projects for enterprise gain and competitive edge.

GUIDE

ESG Handbook 2021

A-Team Group’s ESG Handbook 2021 is a ‘must read’ for all capital markets participants, data vendors and solutions providers involved in Environmental, Social and Governance (ESG) investing and product development. It includes extensive coverage of all elements of ESG, from an initial definition and why ESG is important, to existing and emerging regulations, data challenges...