The leading knowledge platform for the financial technology industry
The leading knowledge platform for the financial technology industry

A-Team Insight Blogs

Talend MDM Stretches Beyond 100 Million Master Record Milestone on Commodity Server

Talend, a global open source software leader, today announced that Talend MDM Enterprise Edition, the leading open source Master Data Management (MDM) solution, can now scale to master more than 100 million records on a single $1200 server, providing the ability to accommodate virtually any volume of master data. Released in 2010, Talend MDM is the first comprehensive MDM solution that includes data integration, data quality, master data and data stewardship built on a single platform and available at a fraction of the cost of traditionally complex and dissociated solutions.

“Choosing an MDM solution is a daunting task for most organisations. Very few MDM offerings can meet the demands of a 100 million record environment with consistent, sub-second response times, and none can do it affordably, as they require clusters of expensive hardware and a license cost based on record counts and number of domains,” said Fabrice Bonan, co-founder and chief operating officer, Talend. “Talend MDM continues to democratise the data management space with a flexible and affordable alternative to master any amount of data across multiple domains, on a single hub running on commodity hardware.”

Speed and Implementation
MDM has received growing attention recently as an essential component of information management alongside data governance and data quality. Many organisations are eager to adopt an enterprise-wide MDM solution, but have to wait a year or more before the implementation starts to provide value. MDM is so vital to operational efficiency and profitability, that the faster it is implemented and integrated with existing systems the better.

Talend MDM reduces the time and cost it takes to implement an MDM project. With one license, it provides complete MDM functions across profiling, integration, quality, modeling and workflow. This single MDM platform simplifies the implementation and greatly increases time-to-value and reduces the number of resources required to implement.

Scalability and Performance
In order to show that Talend MDM can easily scale to the highest range of data sources and records, the solution was benchmarked to obtain key performance numbers. Several tests were performed – all with positive results. Most notably, Talend MDM delivered sub-second response times across 100 million records for a single record access, free form search for any entity across the entire hub, insertion of a record and browsing of records.

One other key indicator of Talend MDM’s high performance and scalability was the calculation of load times. With Talend MDM, the load performs a full index search and ran from 2000 records per second for 5 million records to1600 records per second for 100 million records. This means that an average MDM hub can be loaded in just a few hours.

The benchmark was run on a standard “commodity” server, with an Intel Xeon X3430 2.40 Ghz quad core processor, 8 GB RAM and a 7200 rpm SATA HD. The list price for this configuration is approximately $1200.

Related content

WEBINAR

Upcoming Webinar: Sanctions – The new pre-trade challenge for the buy-side

Date: 22 September 2021 Time: 10:00am ET / 3:00pm London / 4:00pm CET Duration: 50 minutes Sanctions screening at the security level is a relatively recent requirement for the buy-side. It dives deeper than traditional KYC and AML screening and is immensely challenging as firms must monitor frequently changing sanctions lists, source up-to-date sanctions data...

BLOG

2021 Predictions: Change is Afoot

By Marc Murphy, CEO, Fenergo. It almost feels like the financial industry went to bed in March 2020 and woke up in 2030. Prior to the pandemic, financial institutions had been falling behind when it came to digital transformation, only increasing resources when absolutely necessary. But now, the pandemic has forced financial institutions to make...

EVENT

Data Management Summit Virtual

The Data Management Summit Virtual will bring together the global data management community to share lessons learned, best practice guidance and latest innovations to emerge from the recent crisis. Join us online to hear from leading data practitioners and innovators from the UK, US and Europe who will share insights into how they are pushing the boundaries with data to deliver value with flexible but resilient data driven strategies.

GUIDE

Entity Data Management Handbook – Seventh Edition

Sourcing entity data and ensuring efficient and effective entity data management is a challenge for many financial institutions as volumes of data rise, more regulations require entity data in reporting, and the fight again financial crime is escalated by bad actors using increasingly sophisticated techniques to attack processes and systems. That said, based on best...