About a-team Marketing Services
The knowledge platform for the financial technology industry
The knowledge platform for the financial technology industry

A-Team Insight Blogs

Pivotal Taps NYSE for Data Dispatch Middleware

Subscribe to our newsletter

Pivotal – the EMC/VMware analytics spinout – has released Pivotal Data Dispatch (PDD), a platform for discovery of and analytical processing on data stored in disparate repositories. The product was developed at NYSE Euronext for its internal surveillance and regulatory purposes and has been in use there since 2007.

According to product documentation, PDD provides “on-demand access to big data while supporting existing visualisation and analytical tools. installed as a middleware service on a commodity linux cluster, Pivotal Data Dispatch enables it administrators to set up data sources, analytical platforms, business metadata and access policies.” Data extracted from sources can then be fed into Hadoop or an MPP database for analytic processing.

Key features:

* Provisioning at Terabytes Per Hour – PDD gathers user-requested data from multiple sources, translates it to the destination format, applies user-defined and policy-driven transformations, and loads the data onto an analytical platform.

* Analytics Workflows – PDD includes a web-based workflow tool, so data workers can create multistep analytics workflows that include data movement, transformation and analytics.

* Heterogeneous Data Platform Support – PDD includes native adapters and resource monitoring for multiple platforms, including Pivotal HD and HAWQ, Pivotal greenplum Database (GPDB), Apache Hadoop, IBM Netezza, Oracle and SQL Server. It can also connect with any database through JDBC, and with most distributed file systems, such as NFS.

The NYSE/Pivotal collaboration came about when the exchange chose the Greenplum MPP database for its regulatory and surveillance needs, and built the middleware to populate the Greenplum analytics database from various internal data repositories. Greenplum was since aquired by EMC, and is now offered by Pivotal. EMC also provides storage for the Community Platform cloud offering, from NYSE Technologies, the exchange group’s commercial technology unit.

Says NYSE Euronext Chief Data Officer Steven Hirsch: “Pivotal Data Dispatch solves complex market surveillance and regulatory data needs, and is heavily utilised across NYSE Euronext production systems today. Together, we understand the pressures of managing big data, and the processing power behind Pivotal Data Dispatch technology allows us and their customers to store data reliably at significant scale and easily adapt to fast-paced changes in the big data universe.”

Subscribe to our newsletter

Related content

WEBINAR

Upcoming Webinar: Leveraging interoperability: Laying the foundations for unique best-of-breed trading solutions

Date: 23 May 2024 Time: 10:00am ET / 3:00pm London / 4:00pm CET Duration: 50 minutes Interoperability on the trading desk promises more actionable insights, real-time decision making, faster workflows and reduced errors by ensuring data consistency across frequently used applications. But how can these promises be kept in an environment characterised by multiple applications...

BLOG

Global Screening Services Raises $47 Million, Moves into Operational Phase

Global Screening Services (GSS), a provider of transaction screening, has completed a Series A2 funding round raising over $47 million (£37 million). The investment will support the London-based company’s transition from a development to operational phase as its cloud-native platform prepares to go live with inaugural clients. Originally incubated by AlixPartners, GSS tackles the complexity...

EVENT

Buy AND Build: The Future of Capital Markets Technology, London

Buy AND Build: The Future of Capital Markets Technology London on September 19th at Marriott Hotel Canary Wharf London examines the latest changes and innovations in trading technology and explores how technology is being deployed to create an edge in sell side and buy side capital markets financial institutions.

GUIDE

Regulatory Data Handbook 2023 – Eleventh Edition

Welcome to the eleventh edition of A-Team Group’s Regulatory Data Handbook, a popular publication that covers new regulations in capital markets, tracks regulatory change, and provides advice on the data, data management and implementation requirements of more than 30 regulations across UK, European, US and Asia-Pacific capital markets. This edition of the handbook includes new...