About a-team Marketing Services
The knowledge platform for the financial technology industry
The knowledge platform for the financial technology industry

A-Team Insight Blogs

How Machine Learning is Changing Data Management and Investment Processes for Active Managers

Subscribe to our newsletter

By Martijn Groot, Vice President of Marketing and Strategy, Asset Control.

Artificial Intelligence (AI) and machine learning techniques are finding their way into financial services. Ranging from operational efficiencies to more effective detection of fraud and money laundering, firms are embracing techniques that find patterns, learn from them, and can subsequently act on signals coming out of large volumes of data. The most promising, and potentially lucrative, use cases are in investment management.

Among the groups that benefit most are hedge fund managers and other active investors that increasingly rely on AI and machine learning to analyse large data sets for actionable signals that support a faster, better-informed decision-making process. Helping this trend is the increased availability of data sets that provide additional colour and complement typical market data feeds from aggregators such as Bloomberg or Refinitiv. These data sets range from data gathered from web scraping to textual analysis of news, social media and earnings calls. Data is also gathered through transactional information from credit card data, email receipts and point of sale data.

The ability to analyse data has progressed to applying natural language processing to earnings call transcripts to assess whether the tone of the CEO or CFO being interviewed is positive or negative. Revenue can be estimated from transactional information to gauge a company’s financials ahead of official earnings announcements and with potentially greater accuracy than analyst forecasts.

If, based on this analysis, a fund believes the next reported earnings are going to materially differ from the consensus analyst forecast, it can act on this. Satellite information on crops and weather forecasts can help predicting commodity prices.

These are just a few examples of the data sets available. The variety in structure and volume of data now available is such that analysing it using traditional techniques is becoming increasingly unrealistic. Moreover, some data has a limited shelf life and can quickly become out of date.

Scoping the challenge

Setting up a properly resourced team to assess and process this type of data is costly. The best approach is to more effectively assess and prepare the data for machine learning so that the algorithms can get to work quickly. Data scientists can then focus on analysis rather than data preparation. Part of that process is feature engineering, essentially selecting the aspects of the data to feed to a machine learning algorithm. This curation process involves selecting the relevant dimensions of the data, discarding for instance redundant data sets or constant parameters, and plugging gaps in the data where needed.

An active manager could potentially analyse hundreds of data sets per year. The procedure to analyse and onboard new data should be cost-effective and have a quick turnaround time to manage the short shelf life of some of the data sets.

Addressing these challenges means that traditional data management (the structured processes to ingest, integrate, quality-proof and distribute information) has to evolve.  It needs to extend data ingestion and managing data quality into a more sophisticated cross-referencing of feeds looking for gaps in the data, implausible movements and inconsistency between two feeds.

For instance, speed of data loading is becoming more important as volumes increase. With much of the data unstructured, hedge funds should be conscious of needing to do more with the data to make it usable. More sophisticated data mastering will also be key in making machine learning work effectively for hedge funds.

This functionality, coupled with the capability to quickly onboard new data sets for machine learning, will enable funds to save money and especially time in the data analysis process. It will allow data scientists to focus on what they do best and generate more actionable insight for investment professionals.

Reaping the rewards

Machine learning clearly has huge potential to bring a raft of benefits to hedge funds, both in reducing the time and cost of the data analysis process, and in driving faster time to insight. It also gives firms the opportunity to achieve differentiation and business advantage. Hedge funds need to show returns to attract investment in an increasingly competitive space, machine learning supported by high quality data management offers a positive way forward.

Subscribe to our newsletter

Related content

WEBINAR

Recorded Webinar: How to simplify and modernize data architecture to unleash data value and innovation

The data needs of financial institutions are growing at pace as new formats and greater volumes of information are integrated into their systems. With this has come greater complexity in managing and governing that data, amplifying pain points along data pipelines. In response, innovative new streamlined and flexible architectures have emerged that can absorb and...

BLOG

Rethinking ‘Cloud First’: Why IT Leaders are Repatriating from Public Cloud

By Stewart Laing, chief executive, Asanti. Since 2013 “Cloud First” has been the guiding mantra for countless IT leaders, promising agility, scalability, and a low barrier to entry. Public cloud providers like AWS, Microsoft Azure and Google Cloud Platform have touted their services as one-size-fits-all solutions, offering organisations access to cutting-edge technology without substantial upfront...

EVENT

RegTech Summit London

Now in its 9th year, the RegTech Summit in London will bring together the RegTech ecosystem to explore how the European capital markets financial industry can leverage technology to drive innovation, cut costs and support regulatory change.

GUIDE

AI in Capital Markets: Practical Insight for a Transforming Industry – Free Handbook

AI is no longer on the horizon – it’s embedded in the infrastructure of modern capital markets. But separating real impact from inflated promises requires a grounded, practical understanding. The AI in Capital Markets Handbook 2025 provides exactly that. Designed for data-driven professionals across the trade life-cycle, compliance, infrastructure, and strategy, this handbook goes beyond...