About a-team Marketing Services
The knowledge platform for the financial technology industry
The knowledge platform for the financial technology industry

A-Team Insight Blogs

How Machine Learning is Changing Data Management and Investment Processes for Active Managers

Subscribe to our newsletter

By Martijn Groot, Vice President of Marketing and Strategy, Asset Control.

Artificial Intelligence (AI) and machine learning techniques are finding their way into financial services. Ranging from operational efficiencies to more effective detection of fraud and money laundering, firms are embracing techniques that find patterns, learn from them, and can subsequently act on signals coming out of large volumes of data. The most promising, and potentially lucrative, use cases are in investment management.

Among the groups that benefit most are hedge fund managers and other active investors that increasingly rely on AI and machine learning to analyse large data sets for actionable signals that support a faster, better-informed decision-making process. Helping this trend is the increased availability of data sets that provide additional colour and complement typical market data feeds from aggregators such as Bloomberg or Refinitiv. These data sets range from data gathered from web scraping to textual analysis of news, social media and earnings calls. Data is also gathered through transactional information from credit card data, email receipts and point of sale data.

The ability to analyse data has progressed to applying natural language processing to earnings call transcripts to assess whether the tone of the CEO or CFO being interviewed is positive or negative. Revenue can be estimated from transactional information to gauge a company’s financials ahead of official earnings announcements and with potentially greater accuracy than analyst forecasts.

If, based on this analysis, a fund believes the next reported earnings are going to materially differ from the consensus analyst forecast, it can act on this. Satellite information on crops and weather forecasts can help predicting commodity prices.

These are just a few examples of the data sets available. The variety in structure and volume of data now available is such that analysing it using traditional techniques is becoming increasingly unrealistic. Moreover, some data has a limited shelf life and can quickly become out of date.

Scoping the challenge

Setting up a properly resourced team to assess and process this type of data is costly. The best approach is to more effectively assess and prepare the data for machine learning so that the algorithms can get to work quickly. Data scientists can then focus on analysis rather than data preparation. Part of that process is feature engineering, essentially selecting the aspects of the data to feed to a machine learning algorithm. This curation process involves selecting the relevant dimensions of the data, discarding for instance redundant data sets or constant parameters, and plugging gaps in the data where needed.

An active manager could potentially analyse hundreds of data sets per year. The procedure to analyse and onboard new data should be cost-effective and have a quick turnaround time to manage the short shelf life of some of the data sets.

Addressing these challenges means that traditional data management (the structured processes to ingest, integrate, quality-proof and distribute information) has to evolve.  It needs to extend data ingestion and managing data quality into a more sophisticated cross-referencing of feeds looking for gaps in the data, implausible movements and inconsistency between two feeds.

For instance, speed of data loading is becoming more important as volumes increase. With much of the data unstructured, hedge funds should be conscious of needing to do more with the data to make it usable. More sophisticated data mastering will also be key in making machine learning work effectively for hedge funds.

This functionality, coupled with the capability to quickly onboard new data sets for machine learning, will enable funds to save money and especially time in the data analysis process. It will allow data scientists to focus on what they do best and generate more actionable insight for investment professionals.

Reaping the rewards

Machine learning clearly has huge potential to bring a raft of benefits to hedge funds, both in reducing the time and cost of the data analysis process, and in driving faster time to insight. It also gives firms the opportunity to achieve differentiation and business advantage. Hedge funds need to show returns to attract investment in an increasingly competitive space, machine learning supported by high quality data management offers a positive way forward.

Subscribe to our newsletter

Related content

WEBINAR

Upcoming Webinar: An Agile Approach to Investment Management Platforms for Private Markets and the Total Portfolio View

11 June 2025 10:00am ET | 3:00pm London | 4:00pm CET Duration: 50 Minutes Data and operations professionals at private market institutions face significant data and analytical challenges managing private assets data. With investors clamouring for advice and analysis of private markets in their search for returns, investment managers are looking at ways to gain...

BLOG

Data’s Role in AI Transition and Value Creation: Data Management Summit London Preview

The rapid adoption of artificial intelligence by financial institutions has required a heavy data management uplift as organisations have upgraded their systems to incorporate the new technology. It has also provided greater opportunity to squeeze even more value from data by enabling its efficient deployment across enterprises. Just how companies manage data for AI to...

EVENT

Future of Capital Markets Tech Summit: Buy AND Build, London

Buy AND Build: The Future of Capital Markets Technology London examines the latest changes and innovations in trading technology and explores how technology is being deployed to create an edge in sell side and buy side capital markets financial institutions.

GUIDE

AI in Capital Markets: Practical Insight for a Transforming Industry – Free Handbook

AI is no longer on the horizon – it’s embedded in the infrastructure of modern capital markets. But separating real impact from inflated promises requires a grounded, practical understanding. The AI in Capital Markets Handbook 2025 provides exactly that. Designed for data-driven professionals across the trade life-cycle, compliance, infrastructure, and strategy, this handbook goes beyond...