About a-team Marketing Services
The knowledge platform for the financial technology industry
The knowledge platform for the financial technology industry

A-Team Insight Blogs

A-Team DMS Tackles Challenges of Big Data, Regulation, Data Value and More

Subscribe to our newsletter

A-Team Group’s New York City Data Management Summit (DMS) kicked off with a keynote presentation on the 800lb gorilla of big data, and panel discussions dedicated to regulation and the data management response for 2017, and challenges that are keeping chief data officers (CDOs) awake at night.

Michael Stonebraker, adjunct professor at MIT and co-founder of Tamr, presented the summit’s first keynote – The 800lb Gorilla of Big Data – noting the ongoing issues of big data including the problem of managing large volumes of data, the difficulty of handling data velocity, and the challenges of integrating data variety.

He said the problems of big data for traditional business intelligence purposes can be solved using the right data warehouse platform, but suggested that when there are enough data scientists in the market, big data will become more of a data science than business intelligence element of the data management environment.

Considering the volume problem of big data, Stonebraker noted growing interest in the Spark engine for large-scale data processing, perhaps a challenger to Hadoop, but pointed out that, so far, Spark technology is flawed and provides poor performance. A better solution is tighter integration of big data with data management. He viewed big data velocity as a complex event processing issue and said there are commercial solutions in the market that process fast enough to ensure firms never lose a message.

Stonebraker described the issues of volume and velocity as 50lb gorillas, with data variety being the 800lb gorilla in the corner of the room. Data integration at scale is a big issue that can’t be solved using ETL tools and can only begin to be resolved using technologies such as machine learning and domain experts rather than programming experts. Stonebraker concluded with advice to focus on the 800lb gorilla and not on the 50lb gorillas that are a lesser challenge.

Navigating the regulatory landscape

The first panel discussion of the summit was dedicated to the regulatory landscape and data management responses for 2017. The session was moderated by Andrew Delaney, chief content officer at A-Team, and joined by Robin Doyle, managing director of the office of regulatory affairs at JPMorgan Chase; Peggy Tsai, data innovation lead at AIG; David Blaszkowsky, former senior vice president and head of data governance at State Street; and Roger Fahy, vice president and chief operating officer at CUSIP Global Services.

The panel discussed the rising tide of regulation and named incoming regulations Markets in Financial Instruments Directive II (MiFID II) and General Data Protection Regulation (GDPR) as key concerns for 2017, along with existing regulations including the Basel Committee’s BCBS 239 and Solvency II in the insurance industry. Regulatory requirements including the Legal Entity Identifier (LEI) and the extension of ISINs to cover derivatives under MiFID II were also in the frame.

Panel members agreed that a move towards data standards, strong data governance programmes and increased capability in managing commonalities across regulations will ease the burden of regulatory compliance, and floated the idea of building one reference data database to support regulatory compliance.

What’s keeping data leaders awake at night?

Challenges including regulatory reporting and a lack of common definitions across regulations, managing data variety including privacy and licence issues, sticking to the data management mandate, and preparing for the need to transform organisations are just some of the issues that keep CDOs and data leaders awake at night.

The panel reviewing these challenges was moderated by Predrag Dizdarevic, a partner at Element 22; and included Marc Alvarez, CDO at Mizuho Securities; Randall Gordon, managing director of data operations and governance at Moody’s Corporation; Risë Zaiser, CDO at Sumitomo Mitsui Banking Corporation; and Peter Giordano, managing director at Oppenheimer & Co.

Other challenges identified by the panel included data governance and the difficulties of aligning practices and controls across an enterprise. Opinion differed on whether data governance should be a corporate or federated function, but concurred on the need for strong governance in response to BCBS 239.

Conversation about how to improve the business value of data and justify data management programmes suggested the need for better systems integration and control to maximise data usage, provision of more fit-for-purpose data for analysts, and a focus on data mining rather than management to enable actionable intelligence.

Subscribe to our newsletter

Related content

WEBINAR

Upcoming Webinar: Best approaches for trade and transaction reporting

11 September 2025 10:00am ET | 3:00pm London | 4:00pm CET Duration: 50 Minutes Compliance practitioners and technology leaders in capital markets face mounting pressure to ensure that reporting processes are efficient, accurate, and aligned with global standards. Market developments and jurisdictional nuances in regulatory frameworks like MiFID II, EMIR, SFTR and MAS create a...

BLOG

Interoperability and Innovation: Building a Unified Defence Against Global Fraud

By Josh Vowles-Dent, Business Strategy and Partnerships Manager, ComplyCube. The global regulatory landscape has become far more demanding over the past few years, leaving firms vulnerable to the costly penalties and reputational damage that come with non-compliance. Regulations have become increasingly complex as a result of the dynamic nature of fraud and its fast-paced evolution....

EVENT

TradingTech Summit MENA

The inaugural TradingTech Summit MENA takes place in November and examines the latest changes and innovations in trading technology and explores how technology is being deployed to create an edge in sell side and buy side capital markets financial institutions in the region.

GUIDE

AI in Capital Markets: Practical Insight for a Transforming Industry – Free Handbook

AI is no longer on the horizon – it’s embedded in the infrastructure of modern capital markets. But separating real impact from inflated promises requires a grounded, practical understanding. The AI in Capital Markets Handbook 2025 provides exactly that. Designed for data-driven professionals across the trade life-cycle, compliance, infrastructure, and strategy, this handbook goes beyond...