The leading knowledge platform for the financial technology industry
The leading knowledge platform for the financial technology industry

A-Team Insight Blogs

Benchmarking the Benchmarks

In the world of low latency, it seems that benchmarks are headline news. Having readily available figures showing xxx microseconds and yyy hundreds of thousands of updates per second is a pretty sure way to get some press coverage for one’s product. Indeed, I find myself asking of vendors who are pushing their new datafeed handler, or complex event processing engine, “So, got any benchmarks for it?”

Until recently, the only game in town for benchmarks was Peter Lankford’s imposingly named (and cleverly named) Securities Technology Analysis Center (Stac), which makes a business out of running independent benchmarks for vendors, detailing the exact software and hardware components (or stack) used in the benchmark test.

Of course, while Stac is independent, not all of the benchmarks it runs are published. If the results don’t stack up so well (excuse the pun), then the vendor sponsoring the benchmark isn’t likely to make them public. So the news from Stac, while authentic and useful, is really just the good news. Indeed, Stac’s Lankford does point out that the published benchmarks should augment, not replace, specific benchmarks conducted by end users.

Intel has now come on stream with its own Low Latency Lab, with StreamBase partner Datastream Analysis making use of it to benchmark calculations for algorithmic trading. Again, useful data to have. But since the lab is there to assist partners in porting their applications to the Intel architecture, one expects that any published results will show such endevours in good light.

It’s probably a pipe dream to expect any independent body to emerge that will really shake down low latency components and publish the results – the good, the bad and the ugly. For one thing, I suspect that support from vendors would be difficult to obtain.

But perhaps the next step might be the creation of some common benchmark standards, with input from financial markets practitioners, that would allow vendors, independent testers and end users to perform and compare results. Useful, and newsworthy, no?

Until next time … here’s some good music.

[tags]stac,securities technology analysis center,intel,data stream analysis,dsal,benchmarks[/tags]

Related content

WEBINAR

Upcoming Webinar: Integrating Intelligent Machine Readable News

Date: 30 November 2021 Time: 10:00am ET / 3:00pm London / 4:00pm CET Duration: 50 minutes Intelligent machine readable news is a powerful tool in the arsenals of trading and investment firms seeking competitive advantage. It turns unstructured data into actionable insight and can be used, for example, to uncover market trends, identify correlations and...

BLOG

IPSX Creates Integrated Technology Framework Ahead of First Admission

UK-based IPSX, which describes itself as the world’s first regulated stock exchange dedicated to real estate assets, has pulled together an integrated technology environment and a set of standardised data workflows ahead of its first ‘Intention to Float’ (ITF) on its IPSX Wholesale market, scheduled for next month. IPSX has been working with a plethora...

EVENT

Virtual Briefing: ESG Data Management – A Strategic Imperative

This briefing will explore challenges around assembling and evaluating ESG data for reporting and the impact of regulatory measures and industry collaboration on transparency and standardisation efforts. Expert speakers will address how the evolving market infrastructure is developing and the role of new technologies and alternative data in improving insight and filling data gaps.

GUIDE

Trading Regulations Handbook 2021

In these unprecedented times, a carefully crafted trading infrastructure is crucial for capital markets participants. Yet, the impact of trading regulations on infrastructure can be difficult to manage. The Trading Regulations Handbook 2021 can help. It provides all the essentials you need to know about regulations impacting trading operations, data and technology. A-Team Group’s Trading...