The leading knowledge platform for the financial technology industry
The leading knowledge platform for the financial technology industry

A-Team Insight Blogs

Bloor Research Profiles Data Discovery Vendors, Singles Out Rever, Trillium and CA

Consultancy firm Bloor Research has released the first of four market updates profiling the data management vendor community. The report profiles the ‘data discovery’ vendor community, which it indicates is a new sector that has distinguished itself from data profiling. Data discovery deals with: “the discovery of relationships between data elements, regardless of where the data is stored,” says the report.

Data discovery is not as closely linked to data quality, according to Bloor, and is more important in the implementation of master data management (MDM) solutions. “It can be used to complement data modelling tools, it may be employed for business intelligence purposes; and it has a significant role to play in supporting data migrations, data archival and data governance,” the report explains. The discovery of data relationships can be achieved via four different approaches, says Bloor: data modelling; data profiling; structured search; and an approach based on a model driven architecture. Each of these approaches has their benefits and drawbacks and the 30 main vendors in the space have each adopted one or more of these methods. Bloor spoke to 21 of the vendors and their feedback is incorporated into the report. The data modelling approach, which Bloor describes as the “oldest and least efficient”, involves reverse engineering of existing database schemas. According to the report, this approach is not sufficient to fully support data discovery because it analyses metadata rather than the data itself. Data profiling tools perform statistical analysis against data sources that are specifically designed to assist data cleansing processes. The vendors that have adopted this approach have often failed to view data discovery as significant on its own terms and instead seen it as a function of data quality, says Bloor, and this is a drawback for the area. The approach is also heavily manual and has all the associated issues with manual processing, says the report. Structured search uses a federated platform that enables vendors to query multiple, heterogeneous data sources via virtual views. Indexes are built via an automated process against the tables that the firm is interested in and then a search is implemented on the front end. “This sort of approach has the advantage that it can be used for both business intelligence and data discovery purposes. Similarly, it can be employed by both business analysts and data management personnel,” says the report. There is only one vendor that uses a model driven architecture approach, says Bloor, which involves the reverse engineering of databases using physical, logical and conceptual data models. The approach by Rever is useful for migration projects between databases and it allows for the comparison of hierarchical and network databases with relational ones. Three of the main vendors in the space, Sybase, Oracle and Human Inference, did not agree to participate in the report, says Bloor. Of those that participated: CA and Embarcadero are in the data modelling space; Composite Software is in the structured search space; Rever uses the model driven architecture approach; and the rest all use data profiling. This last group comprises: BDQ, Datiris, Exeros, Sypherlink, x88, Ataccama, Datactics, Datamentors, Trillium, Data?ux, Global IDs, IBM, Informatica, Microsoft, Pervasive, SAP Business Objects and Talend. The report concludes: “Most of the leading products in this update, from a technical perspective, are offered by smaller vendors. However, such suppliers have obvious drawbacks such as limited geographic coverage, as a result of which many users will continue to prefer a big name provider.” Bloor highlights a number of the larger vendors to watch in the space, including Trillium, which it describes as “some way ahead of its major competitors”. It also points to Informatica as a possible contender to consider, along with CA, which it describes as a “clear leader”. “Of the smaller players in the data discovery space we would single out Exeros, Global IDs, Sypherlink and x88 (which is very new and therefore has the potential for greater things) amongst the data pro?ling vendors, as well as Ataccama, particularly when used in conjunction with iWay’s Integration Server for real-time processing,” the report adds. It also singles out Rever as an important one to watch due to its innovative approach.

Related content

WEBINAR

Recorded Webinar: Practical Applications of the Global LEI – Client On-Boarding and Beyond

This webinar has passed, but you can view the recording here. With the March ‘launch’ of the global legal entity identifier (LEI), the marketplace now officially has a standard it can use for managing entity data. Post-Credit Crunch, the lack of such a standard has forced firms to embark on their own initiatives to create...

BLOG

Blackmore Capital’s Collaboration with OTCfin Completes Integration of ESG Factors into Investment Process

Blackmore Capital, a Melbourne-based asset manager set up in 2018, and New York-based OTCfin have completed the integration of ESG factors with financial data for all Blackmore portfolios. By incorporating ESG factors into Blackmore’s investment process, OTCfin’s risk and regulatory reporting solution will help the asset manager’s team improve portfolio monitoring from both a financial...

EVENT

TradingTech Summit London

TradingTech Summit London will explore how trading firms are innovating in today’s cloud and digital based environment to create flexible, scalable trading platforms to support speed to market and business agility. Leveraging the cloud, AI and ML technologies to get an edge, automate processes and simplify operations in a cost effective way is the name of the game and will share practical insight from practitioners and technology leaders who are innovating and driving forward change in trading operations.

GUIDE

The Global LEI System – A Solution for Entity Data?

The Global LEI System – or GLEIS – has been in development since the middle of last year. Development has been patchy at times, but much has been done, leaving fewer outstanding issues, but also raising new questions. What’s emerging is a structure for the GLEIS going forward, complete with a mechanism for registering and...