PolarLake had added grid computing capabilities to its Reference Data Distribution (RDD) platform in order to increase its scalability for downstream uses. John Randles, CEO of the vendor, explains that the enhancements have been added to PolarLake RDD to allow firms’ enterprise data management (EDM) platforms to support more than two or three downstream systems.
“By adding this capability to PolarLake RDD we have taken away a lot of the technical complexity of scaling up a distribution application where the alternative is to custom build in an extract, transform and load (ETL) tool or code,” claims Randles. “The particular complexities of the distribution processes in the reference data world can lead to lots of bespoke, specialised engineering work, particularly when scaling to grid technologies.”
PolarLake RDD’s data distribution and streaming capabilities are therefore available on grid technology to allow for firms to deal with larger volumes of reference data at a faster speed, says the vendor. The solution also includes five new grid-enabled features: distributed delivery agents, initial seeds, store and forward, resource optimisation and delivery agent’s dashboard.
The distributed delivery agents enable the separation of processing and transformation from the delivery process while maintaining the solution’s data streaming capabilities, says the vendor. The solution also allows for the initial setup of a downstream systems and recovery in a fatal outage of a downstream system.
The store and forward function allows the delivery agent to store up messages until a downstream system comes back online and automatically re-synchronise the data once this has happened. The solution also allows for unused computing resources on the grid to take on the work of distribution and therefore optimise resources, says PolarLake.
The delivery agent’s dashboard enables operations personnel to view and monitor in real time the operation of PolarLake RDD across the grid and to remediate any distribution problems that may arise.
