About a-team Marketing Services
The knowledge platform for the financial technology industry
The knowledge platform for the financial technology industry

A-Team Insight Blogs

Is Big Data Just a Big Distraction?

Subscribe to our newsletter

By Chris Ford, Capco
www.capco.com

Everyone is talking about big data. But the hype around the big data concept clouds a clear discussion on the current and actual needs of the financial services sector. The temptation of any new technology is to embrace it and then go looking for a problem to solve. More appropriately, banks should identify a prioritised business agenda, and then go looking for the right solutions.

Generally speaking, data housed by financial institutions just isn’t large or complex enough to require new technology. Big data may be intriguing, but for financial services it is a solution that is mismatched to the majority of problems that banks face. If your bank cannot reliably identify the same customer across lines of business, you are probably not ready for big data. If your bank cannot determine the profitability of targeted products and offers over their lifetime, you are probably not ready for big data.

The majority of information held by financial institutions comes in the form of structured data, most notably the information about its customers and their relationship to the accounts and products offered. In my experience, the volume and complexity of these data sets, even for the largest banks in the world, does not require new technology. Sure, new big data technology could be used to store, extract and process this data, but why implement a costly new system when conventional technology could be used as a cheaper and less risky solution?

One reason why big data solutions may seem appealing is that many institutions simply do not have effective strategies in place to properly manage their existing data, and in response believe the only solution is new technology. As a counterpoint to that idea, I work with one of the financial world’s most sophisticated analytics groups, and they make tremendous use of their data to understand customers, the marketing effectiveness, the profitability and risk – all because they made a significant investment in conventional technologies. As a point of comparison, the group I am referring to stores and exploits tenfold more data than similarly sized competitors. As this group demonstrates, there is no need for big data technology to gain these insights; traditional tools do work, and can be used extremely well with the right strategy in place. As outliers, there are some niche domains in financial services where big data technology is more apt to be applicable such as fraud detection based on customer behavior and time-sensitive risk calculations in capital markets. Opportunities in these areas should be evaluated in the context of a solid business case.

This then begs the question: if structured data can be generally managed without the use of big data solutions, what about unstructured data? After all, organisations such as Google and Facebook are using big data technology to gain incredible insight from the massive amounts of unstructured data they receive every day. For banks who are high up on the data management maturity curve, there are emerging big data investment opportunities. Software firms like Attensity are delivering integrated analytics solutions that interpret public-domain social media data in the context of channel activity. The key question for banks considering this technology is whether it addresses an actual priority. For most banks, our hypothesis is that there will be lower hanging fruit elsewhere.

Simply put, while the concept has its place in many industries, the financial sector shouldn’t jump at the chance to be an early adopter of big data technology. With other industries testing the waters, financial services can reduce the risks associated with early adoption by allowing others to oversee its development and let the industry as a whole mature. At the same time, we are urging our clients to focus their efforts on developing an effective data management strategy and better leverage the proven, cost-effective tools they already have. Big data may have a transformative effect on the financial industry in the future, but right now for most banks, it’s just an unnecessary distraction.

Subscribe to our newsletter

Related content

WEBINAR

Recorded Webinar: Best practices for buy-side data management across structured and unstructured data

Data management is central to asset management, but it can also be a challenge as firms face increased volumes of data, data complexity and the need to consolidate structured and unstructured data to gain valuable insights, improve decision-making, step up customer acquisition and compliance, and ultimately, gain competitive advantage in a market characterised by tight...

BLOG

Gulf Between AI Ambitions and Capabilities Remains Wide, Surveys Find

Many financial institutions and service providers remain encumbered by creaking technology systems that are preventing many from taking advantage of artificial intelligence (AI) data innovations. Despite organisations’ overwhelming desire to make use of AI to give them a competitive edge, many say also that they lack the data management expertise to adopt applications that are...

EVENT

RegTech Summit New York

Now in its 9th year, the RegTech Summit in New York will bring together the RegTech ecosystem to explore how the North American capital markets financial industry can leverage technology to drive innovation, cut costs and support regulatory change.

GUIDE

Risk & Compliance

The current financial climate has meant that risk management and compliance requirements are never far from the minds of the boards of financial institutions. In order to meet the slew of regulations on the horizon, firms are being compelled to invest in their systems in order to cope with the new requirements. Data management is...