About a-team Marketing Services
The knowledge platform for the financial technology industry
The knowledge platform for the financial technology industry

A-Team Insight Blogs

A-Team DMS Tackles Challenges of Big Data, Regulation, Data Value and More

Subscribe to our newsletter

A-Team Group’s New York City Data Management Summit (DMS) kicked off with a keynote presentation on the 800lb gorilla of big data, and panel discussions dedicated to regulation and the data management response for 2017, and challenges that are keeping chief data officers (CDOs) awake at night.

Michael Stonebraker, adjunct professor at MIT and co-founder of Tamr, presented the summit’s first keynote – The 800lb Gorilla of Big Data – noting the ongoing issues of big data including the problem of managing large volumes of data, the difficulty of handling data velocity, and the challenges of integrating data variety.

He said the problems of big data for traditional business intelligence purposes can be solved using the right data warehouse platform, but suggested that when there are enough data scientists in the market, big data will become more of a data science than business intelligence element of the data management environment.

Considering the volume problem of big data, Stonebraker noted growing interest in the Spark engine for large-scale data processing, perhaps a challenger to Hadoop, but pointed out that, so far, Spark technology is flawed and provides poor performance. A better solution is tighter integration of big data with data management. He viewed big data velocity as a complex event processing issue and said there are commercial solutions in the market that process fast enough to ensure firms never lose a message.

Stonebraker described the issues of volume and velocity as 50lb gorillas, with data variety being the 800lb gorilla in the corner of the room. Data integration at scale is a big issue that can’t be solved using ETL tools and can only begin to be resolved using technologies such as machine learning and domain experts rather than programming experts. Stonebraker concluded with advice to focus on the 800lb gorilla and not on the 50lb gorillas that are a lesser challenge.

Navigating the regulatory landscape

The first panel discussion of the summit was dedicated to the regulatory landscape and data management responses for 2017. The session was moderated by Andrew Delaney, chief content officer at A-Team, and joined by Robin Doyle, managing director of the office of regulatory affairs at JPMorgan Chase; Peggy Tsai, data innovation lead at AIG; David Blaszkowsky, former senior vice president and head of data governance at State Street; and Roger Fahy, vice president and chief operating officer at CUSIP Global Services.

The panel discussed the rising tide of regulation and named incoming regulations Markets in Financial Instruments Directive II (MiFID II) and General Data Protection Regulation (GDPR) as key concerns for 2017, along with existing regulations including the Basel Committee’s BCBS 239 and Solvency II in the insurance industry. Regulatory requirements including the Legal Entity Identifier (LEI) and the extension of ISINs to cover derivatives under MiFID II were also in the frame.

Panel members agreed that a move towards data standards, strong data governance programmes and increased capability in managing commonalities across regulations will ease the burden of regulatory compliance, and floated the idea of building one reference data database to support regulatory compliance.

What’s keeping data leaders awake at night?

Challenges including regulatory reporting and a lack of common definitions across regulations, managing data variety including privacy and licence issues, sticking to the data management mandate, and preparing for the need to transform organisations are just some of the issues that keep CDOs and data leaders awake at night.

The panel reviewing these challenges was moderated by Predrag Dizdarevic, a partner at Element 22; and included Marc Alvarez, CDO at Mizuho Securities; Randall Gordon, managing director of data operations and governance at Moody’s Corporation; Risë Zaiser, CDO at Sumitomo Mitsui Banking Corporation; and Peter Giordano, managing director at Oppenheimer & Co.

Other challenges identified by the panel included data governance and the difficulties of aligning practices and controls across an enterprise. Opinion differed on whether data governance should be a corporate or federated function, but concurred on the need for strong governance in response to BCBS 239.

Conversation about how to improve the business value of data and justify data management programmes suggested the need for better systems integration and control to maximise data usage, provision of more fit-for-purpose data for analysts, and a focus on data mining rather than management to enable actionable intelligence.

Subscribe to our newsletter

Related content

WEBINAR

Recorded Webinar: End-to-End Lineage for Financial Services: The Missing Link for Both Compliance and AI Readiness

The importance of complete robust end-to-end data lineage in financial services and capital markets cannot be overstated. Without the ability to trace and verify data across its lifecycle, many critical workflows – from trade reconciliation to risk management – cannot be executed effectively. At the top of the list is regulatory compliance. Regulators demand a...

BLOG

A-Team Insight Announces RegTech Award Winners as APAC Navigates Compliance Complexity

A-Team Group is proud to reveal the winners of our inaugural Capital Markets Technology APAC Awards 2025, recognising the firms and solutions demonstrating exceptional innovation across the Asia Pacific region. Alongside this announcement, we have launched our in-depth annual report, “The State of Capital Markets Technology in Asia Pacific 2025”, which examines the key trends...

EVENT

TradingTech Summit New York

Our TradingTech Briefing in New York is aimed at senior-level decision makers in trading technology, electronic execution, trading architecture and offers a day packed with insight from practitioners and from innovative suppliers happy to share their experiences in dealing with the enterprise challenges facing our marketplace.

GUIDE

Regulatory Data Handbook 2025 – Thirteenth Edition

Welcome to the thirteenth edition of A-Team Group’s Regulatory Data Handbook, a unique and practical guide to capital markets regulation, regulatory change, and the data and data management requirements of compliance across Europe, the UK, US and Asia-Pacific. This year’s edition lands at a moment of accelerating regulatory divergence and intensifying data focused supervision. Inside,...