The leading knowledge platform for the financial technology industry
The leading knowledge platform for the financial technology industry

A-Team Insight Blogs

Intel Enters Hadoop Fray

Intel has introduced its own distribution of Hadoop, incorporating enterprise level features for security, performance and management. The IT giant has also announced a number of partners for its offering, which it will sell on a subscription basis, ranging from the likes of Cisco Systems and Dell, to MarkLogic, SAP and Teradata.

As part of its distribution, Intel has made software updates to a number of Hadoop components, including the HDFS file system, Yarn distributed processing framework, Hive SQL interface and HBase columnar store.  These updates have been contributed back to the Apache open source project, on which Intel’s distribution is based.

Performance enhancements include optimisation for solid state disks and cache acceleration, and hardware-based encryption and decryption leveraging the AES instructions of Intel chips.

Intel has also introduced a proprietary module – Intel Manager for Apache Hadoop – which provides additional functionality for deployment, management, monitoring and security.

As well as its own Hadoop distribution, Intel is continuing to develop its Graph Builder visualisation tool for analysing Hadoop-based data. It has also made investments in 10gen and its MongoDB NoSQL database and in operational analytics specialist Guavus.

In introducing its own distribution, Intel expects to accelerate deployment of Hadoop – and sales of its microprocessors, SSDs and networking products alongside.  That will mean increased competition for the big three Hadoop startups – Cloudera, Hortonworks and MapR Technologies, who all offer distributions with their own added features and functionality.

Related content

WEBINAR

Recorded Webinar: Market data in the cloud

The Covid-19 pandemic has created new demand for financial information delivery infrastructure to accommodate the many trading and support personnel now working from home (WFH). For many firms, new cloud delivery and hosting capabilities offer a viable solution for supporting these staff, accelerating demand for cloud-based market data delivery infrastructures. This development has thrown up...

BLOG

SteelEye Teams with txtsmarter for Messaging Data Capture

Financial compliance and analytics specialist SteelEye is adding txtsmarter’s messaging capture and archiving capability to its communications surveillance solution, giving clients access to native messaging data sourced from Android SMS/MMS, WhatsApp and – uniquely – Apple iMessage, in real time. The combined solution adds mobile phone messages to the range of electronic communications that users...

EVENT

Data Management Summit Virtual

The Data Management Summit Virtual will bring together the global data management community to share lessons learned, best practice guidance and latest innovations to emerge from the recent crisis. Join us online to hear from leading data practitioners and innovators from the UK, US and Europe who will share insights into how they are pushing the boundaries with data to deliver value with flexible but resilient data driven strategies.

GUIDE

FRTB Special Report

FRTB is one of the most sweeping and transformative pieces of regulation to hit the financial markets in the last two decades. With the deadline confirmed as January 2022, this Special Report provides a detailed insight into exactly what the data requirements are for FRTB in its latest (and final) incarnation, and explores what needs to be done in order to meet these needs on a cost-effective and company-wide basis.