About a-team Marketing Services
The knowledge platform for the financial technology industry
The knowledge platform for the financial technology industry

A-Team Insight Blogs

How Machine Learning is Changing Data Management and Investment Processes for Active Managers

Subscribe to our newsletter

By Martijn Groot, Vice President of Marketing and Strategy, Asset Control.

Artificial Intelligence (AI) and machine learning techniques are finding their way into financial services. Ranging from operational efficiencies to more effective detection of fraud and money laundering, firms are embracing techniques that find patterns, learn from them, and can subsequently act on signals coming out of large volumes of data. The most promising, and potentially lucrative, use cases are in investment management.

Among the groups that benefit most are hedge fund managers and other active investors that increasingly rely on AI and machine learning to analyse large data sets for actionable signals that support a faster, better-informed decision-making process. Helping this trend is the increased availability of data sets that provide additional colour and complement typical market data feeds from aggregators such as Bloomberg or Refinitiv. These data sets range from data gathered from web scraping to textual analysis of news, social media and earnings calls. Data is also gathered through transactional information from credit card data, email receipts and point of sale data.

The ability to analyse data has progressed to applying natural language processing to earnings call transcripts to assess whether the tone of the CEO or CFO being interviewed is positive or negative. Revenue can be estimated from transactional information to gauge a company’s financials ahead of official earnings announcements and with potentially greater accuracy than analyst forecasts.

If, based on this analysis, a fund believes the next reported earnings are going to materially differ from the consensus analyst forecast, it can act on this. Satellite information on crops and weather forecasts can help predicting commodity prices.

These are just a few examples of the data sets available. The variety in structure and volume of data now available is such that analysing it using traditional techniques is becoming increasingly unrealistic. Moreover, some data has a limited shelf life and can quickly become out of date.

Scoping the challenge

Setting up a properly resourced team to assess and process this type of data is costly. The best approach is to more effectively assess and prepare the data for machine learning so that the algorithms can get to work quickly. Data scientists can then focus on analysis rather than data preparation. Part of that process is feature engineering, essentially selecting the aspects of the data to feed to a machine learning algorithm. This curation process involves selecting the relevant dimensions of the data, discarding for instance redundant data sets or constant parameters, and plugging gaps in the data where needed.

An active manager could potentially analyse hundreds of data sets per year. The procedure to analyse and onboard new data should be cost-effective and have a quick turnaround time to manage the short shelf life of some of the data sets.

Addressing these challenges means that traditional data management (the structured processes to ingest, integrate, quality-proof and distribute information) has to evolve.  It needs to extend data ingestion and managing data quality into a more sophisticated cross-referencing of feeds looking for gaps in the data, implausible movements and inconsistency between two feeds.

For instance, speed of data loading is becoming more important as volumes increase. With much of the data unstructured, hedge funds should be conscious of needing to do more with the data to make it usable. More sophisticated data mastering will also be key in making machine learning work effectively for hedge funds.

This functionality, coupled with the capability to quickly onboard new data sets for machine learning, will enable funds to save money and especially time in the data analysis process. It will allow data scientists to focus on what they do best and generate more actionable insight for investment professionals.

Reaping the rewards

Machine learning clearly has huge potential to bring a raft of benefits to hedge funds, both in reducing the time and cost of the data analysis process, and in driving faster time to insight. It also gives firms the opportunity to achieve differentiation and business advantage. Hedge funds need to show returns to attract investment in an increasingly competitive space, machine learning supported by high quality data management offers a positive way forward.

Subscribe to our newsletter

Related content

WEBINAR

Upcoming Webinar: Hearing from the Experts: AI Governance Best Practices

9 September 2025 10:00am ET | 3:00pm London | 4:00pm CET Duration: 50 Minutes The rapid spread of artificial intelligence in the financial industry presents data teams with novel challenges. AI’s ability to harvest and utilize vast amounts of data has raised concerns about the privacy and security of sensitive proprietary data and the ethical...

BLOG

Buy-Side Faces Structured, Unstructured Data Challenge: A-Team Group Webinar

Buy-side firms are far from satisfied with their present data management strategies and are still struggling to deal with hoary old challenges such as data silos and legacy tech stacks that are inadequate for their modern needs, according to the latest polling from A-Team Group. Only a fifth of respondents feel positively about how they...

EVENT

TradingTech Briefing New York

Our TradingTech Briefing in New York is aimed at senior-level decision makers in trading technology, electronic execution, trading architecture and offers a day packed with insight from practitioners and from innovative suppliers happy to share their experiences in dealing with the enterprise challenges facing our marketplace.

GUIDE

AI in Capital Markets: Practical Insight for a Transforming Industry – Free Handbook

AI is no longer on the horizon – it’s embedded in the infrastructure of modern capital markets. But separating real impact from inflated promises requires a grounded, practical understanding. The AI in Capital Markets Handbook 2025 provides exactly that. Designed for data-driven professionals across the trade life-cycle, compliance, infrastructure, and strategy, this handbook goes beyond...