About a-team Marketing Services
The knowledge platform for the financial technology industry

A-Team Insight Blogs

The Potential and Pitfalls of Large Language Models

Subscribe to our newsletter

By Tony Seale, Knowledge Graph Engineer at Tier 1 Bank.

Large Language Models (LLMs) like ChatGPT possess enormous power, stemming from their capability to ingest and compress vast amounts of general information gathered from the web. However, this capability is general rather than tailored to your specific business needs. To effectively utilise these models in a context relevant to your business, it’s essential to provide them with specific information and data related to your sector and niche. After all, if the general LLM knows everything your business knows – what’s the point of your business? But here’s the kicker: if you put garbage in, you get garbage out. Disorganised data will result in vague or even inaccurate answers.

We can state that the quality of your AI offering will directly depend on the quality of the data you input into the LLM. In other words, the quality, connectivity, organisation, and availability of information within your organisation are key factors in determining the success of your main generative AI use cases. However, there is a harsh truth to acknowledge; the data estates of most large organisations are currently very disorganised.

Given that the organisation of our data is directly related to the quality of our LLM’s responses, perhaps our primary AI strategy should actually be to double down on our data strategy!

Organising your total data estate is no trivial task, but I believe the great AI acceleration will soon make it necessary. While there are no simple answers, here are some links offering insights into building a semantic data mesh, an architectural blueprint that could help you navigate this complex journey:

Subscribe to our newsletter

Related content

WEBINAR

Upcoming Webinar: Generative and Agentic AI in Financial Markets: What the Data Really Shows

Date: 15 October 2026 Time: 10:00am ET / 3:00pm London / 4:00pm CET Duration: 50 minutes Artificial intelligence is reshaping financial markets – but the reality on the ground is more nuanced, more uneven, and more instructive than the headlines suggest. A new A-Team Insight research programme, drawing on responses from senior AI decision-makers at...

BLOG

NetApp Q&A: Intelligent Storage Helps Overcome Silo Challenges

NetApp is a cloud-native data storage and AI solutions provider that is based in San Jose, California. Data Management Insight spoke to chief marketing officer Gabie Boko to learn more about how the company helps financial institutions. Data Management Insight: When was NetApp formed, and how do you service financial institutions and financial services companies?...

EVENT

Digital Assets & Tokenisation Briefing, New York

A-Team Group’s Digital Assets & Tokenisation Briefing assembles an exclusive group of CxOs and senior technology innovators. These leading market practitioners and infrastructure providers are collectively building the digital rails and decentralised networks that will power Wall Street 2.0.

GUIDE

Regulatory Data Handbook 2026 – Fourteenth Edition

Welcome to the fourteenth edition of A-Team Group’s Regulatory Data Handbook. Supervisors increasingly expect firms to demonstrate which rules apply, which data supports each obligation, who owns the control and how exceptions are identified and resolved. Policies and implementation programmes must now be supported by records that can withstand regulatory scrutiny. This edition examines material...