About a-team Marketing Services
The knowledge platform for the financial technology industry
The knowledge platform for the financial technology industry

A-Team Insight Blogs

A Tale of Two Benchmarks – for STAC-M3 and kdb+

Subscribe to our newsletter

This week saw the publication of two “M3” benchmarks conducted by STAC, covering time-series management solutions. And while both relate to Kx Systems’ kdb+ database (apparently to date the only database to have published M3 benchmarks), comparing them would be an apples to oranges exercise.

STAC-M3 is focused on solutions that manage large amounts of market data. The benchmark tests have been defined by represenatives of trading firms that are members of STAC’s Benchmark Council, and have been designed to mimic real-life queries – incorporating both computationally-intensive and and I/O-oriented tests. Tests include calculating the NBBO (National Best Bid and Offer) for a specific day, calculating volume curves over 20 days and a theoretical P&L, among others.

While the two benchmarks published this week both include the kdb+ 2.7 release, running on Red Hat’s Linux 6 operating system, other components of the “stack under test” were very different:

1) HP ProLiant DL980 G7 server (with 8 * Intel X7560 8-core processors, running at 2.27GHz, and 1TB DRAM), 8 * HP StorageWorks Array D2700 (with a total of 144 hard drives), Serial Attached SCSI interface.

Presumably to keep the configuration to one that’s generally affordable, physical hard drives were deployed, instead of more costly, but higher performance solid state disks (SSDs).

2) Dell-Kove R910 Appliance (with 4 * 10-core Intel E7-4850 processors, running at 2GHz, and 1TB DRAM) , Kove XPD2 Storage System, Mellanox InfiniBand interface.

The Dell-Kove R910 Appliance is a purpose-built Dell PowerEdgeR910 server, while the Kove XPD2 contains 2TB of DRAM (and hard drives for persistence), and is capable of data reads in six , and writes in eight, microseconds.

Unsurprisingly, given one benchmark was against hard drives, and the other against DRAM, the results showed very different performance. As one example, the STAC market snapshot test resulted in a mean time to complete of nearly five seconds on the HP system, and just 360 milliseconds on the Dell/Kove system.

Commenting on the HP benchmarks, Kx’s chief strategist Simon Garland notes the current day norm of commodity servers with 64 cores and 1TB of DRAM, a configuration that would have been an expensive one even just a year ago. And with regard to the Dell/Kove benchmarks, he points to the lack of I/O bottleneck: “all the cores were able to work at maximum speed, rather than having to wait for the drives.”

Garland reckons that both benchmarks are useful as demonstrating the performance of different solutions designed to tackle different data requirements, in terms of realtime capture and volumes. To handle some real-life scenarios, such as receipt and storage of options data over a period, a hybrid DRAM, SSD and hard drive configuration might be required, he suggests.

For its part, Kove is pointing to its M3 benchmarks as representing the fastest results to date. The Chicago-based company founded in 2004 has established business in academic, HPC and bioinformatics markets, but has yet to land its first major account in the financial markets vertical. That should be soon, says the company’s CEO John Overton.

Subscribe to our newsletter

Related content

WEBINAR

Recorded Webinar: Re-architecting the trading platform for interoperability, resilience and profitability

Trading platforms have come a long way since the days of exchanging paper certificates and shouting across trading floors, pits and desks in the early 2000s, but there is progress still to be made as firms strive to reduce risk, increase profitability, and make their mark in digital assets trading. This webinar will review the...

BLOG

Overbond and interop.io Partner to Enhance Fixed Income Trading Workflows

Overbond, the fixed income data, analytics and trade automation solutions provider, has partnered with interoperability specialist Interop.io, to improve fixed income trader workflows through FDC3 interoperability. The partnership aims to address the prevalent challenges of data silos and liquidity fragmentation in the credit markets, by enabling clients to integrate various applications and features into one...

EVENT

RegTech Summit New York

Now in its 8th year, the RegTech Summit in New York will bring together the regtech ecosystem to explore how the North American capital markets financial industry can leverage technology to drive innovation, cut costs and support regulatory change.

GUIDE

Trading Regulations Handbook 2021

In these unprecedented times, a carefully crafted trading infrastructure is crucial for capital markets participants. Yet, the impact of trading regulations on infrastructure can be difficult to manage. The Trading Regulations Handbook 2021 can help. It provides all the essentials you need to know about regulations impacting trading operations, data and technology. A-Team Group’s Trading...