About a-team Marketing Services
The knowledge platform for the financial technology industry
The knowledge platform for the financial technology industry

A-Team Insight Blogs

A-Team DMS Tackles Challenges of Big Data, Regulation, Data Value and More

Subscribe to our newsletter

A-Team Group’s New York City Data Management Summit (DMS) kicked off with a keynote presentation on the 800lb gorilla of big data, and panel discussions dedicated to regulation and the data management response for 2017, and challenges that are keeping chief data officers (CDOs) awake at night.

Michael Stonebraker, adjunct professor at MIT and co-founder of Tamr, presented the summit’s first keynote – The 800lb Gorilla of Big Data – noting the ongoing issues of big data including the problem of managing large volumes of data, the difficulty of handling data velocity, and the challenges of integrating data variety.

He said the problems of big data for traditional business intelligence purposes can be solved using the right data warehouse platform, but suggested that when there are enough data scientists in the market, big data will become more of a data science than business intelligence element of the data management environment.

Considering the volume problem of big data, Stonebraker noted growing interest in the Spark engine for large-scale data processing, perhaps a challenger to Hadoop, but pointed out that, so far, Spark technology is flawed and provides poor performance. A better solution is tighter integration of big data with data management. He viewed big data velocity as a complex event processing issue and said there are commercial solutions in the market that process fast enough to ensure firms never lose a message.

Stonebraker described the issues of volume and velocity as 50lb gorillas, with data variety being the 800lb gorilla in the corner of the room. Data integration at scale is a big issue that can’t be solved using ETL tools and can only begin to be resolved using technologies such as machine learning and domain experts rather than programming experts. Stonebraker concluded with advice to focus on the 800lb gorilla and not on the 50lb gorillas that are a lesser challenge.

Navigating the regulatory landscape

The first panel discussion of the summit was dedicated to the regulatory landscape and data management responses for 2017. The session was moderated by Andrew Delaney, chief content officer at A-Team, and joined by Robin Doyle, managing director of the office of regulatory affairs at JPMorgan Chase; Peggy Tsai, data innovation lead at AIG; David Blaszkowsky, former senior vice president and head of data governance at State Street; and Roger Fahy, vice president and chief operating officer at CUSIP Global Services.

The panel discussed the rising tide of regulation and named incoming regulations Markets in Financial Instruments Directive II (MiFID II) and General Data Protection Regulation (GDPR) as key concerns for 2017, along with existing regulations including the Basel Committee’s BCBS 239 and Solvency II in the insurance industry. Regulatory requirements including the Legal Entity Identifier (LEI) and the extension of ISINs to cover derivatives under MiFID II were also in the frame.

Panel members agreed that a move towards data standards, strong data governance programmes and increased capability in managing commonalities across regulations will ease the burden of regulatory compliance, and floated the idea of building one reference data database to support regulatory compliance.

What’s keeping data leaders awake at night?

Challenges including regulatory reporting and a lack of common definitions across regulations, managing data variety including privacy and licence issues, sticking to the data management mandate, and preparing for the need to transform organisations are just some of the issues that keep CDOs and data leaders awake at night.

The panel reviewing these challenges was moderated by Predrag Dizdarevic, a partner at Element 22; and included Marc Alvarez, CDO at Mizuho Securities; Randall Gordon, managing director of data operations and governance at Moody’s Corporation; Risë Zaiser, CDO at Sumitomo Mitsui Banking Corporation; and Peter Giordano, managing director at Oppenheimer & Co.

Other challenges identified by the panel included data governance and the difficulties of aligning practices and controls across an enterprise. Opinion differed on whether data governance should be a corporate or federated function, but concurred on the need for strong governance in response to BCBS 239.

Conversation about how to improve the business value of data and justify data management programmes suggested the need for better systems integration and control to maximise data usage, provision of more fit-for-purpose data for analysts, and a focus on data mining rather than management to enable actionable intelligence.

Subscribe to our newsletter

Related content

WEBINAR

Upcoming Webinar: How to leverage Generative AI and Large Language Models for regulatory compliance

Date: 8 May 2024 Time: 10:00am ET / 3:00pm London / 4:00pm CET Duration: 50 minutes Generative AI (GenAI) and Large Language Models (LLMs) offer huge potential for change across capital markets, not least in regulatory compliance where they have the capability to help firms understand and interpret regulations, automate compliance, monitor transactions in real...

BLOG

Solidatus Joins AWS Marketplace

Solidatus has joined the Amazon Web Services (AWS) Marketplace to bring connected data governance to AWS customers. With integrations to AWS services such as S3 and Redshift, and partnerships and integrations with data management vendors including Collibra, Snowflake, Alteryx, Google BigQuery, BigID, Denodo, Informatica, Oracle, Microsoft, and IBM Redhat, Solidatus can deliver an integrated data...

EVENT

Buy AND Build: The Future of Capital Markets Technology, London

Buy AND Build: The Future of Capital Markets Technology London on September 19th at Marriott Hotel Canary Wharf London examines the latest changes and innovations in trading technology and explores how technology is being deployed to create an edge in sell side and buy side capital markets financial institutions.

GUIDE

Regulatory Data Handbook 2023 – Eleventh Edition

Welcome to the eleventh edition of A-Team Group’s Regulatory Data Handbook, a popular publication that covers new regulations in capital markets, tracks regulatory change, and provides advice on the data, data management and implementation requirements of more than 30 regulations across UK, European, US and Asia-Pacific capital markets. This edition of the handbook includes new...