Cirata integrates Data Migrator 2.5 with Databricks Unity Catalog

Cirata has announced the integration of its latest Data Migrator with Databricks' Unity Catalog, enhancing the capabilities for data governance and access control for enterprises. The Cirata Data Migrator 2.5 aims to simplify the management and utilisation of Hadoop data in cloud environments, marking a significant expansion in the partnership between Cirata and Databricks.

The Databricks Unity Catalog is a comprehensive governance layer for both data and artificial intelligence (AI) capabilities within the Databricks Data Intelligence Platform. This functionality allows organisations to govern a wide range of data types, including structured, unstructured data, machine learning modules, notebooks, dashboards, and files, across multiple cloud platforms.

The new integration with Unity Catalog enables Cirata Data Migrator users to execute analytics tasks almost immediately and modernise their data operations in the cloud. It supports advanced data operations, access control, and search functionalities. Furthermore, Cirata Data Migrator facilitates the transfer of large-scale data and metadata from existing data lakes to cloud storage and databases without disrupting ongoing changes being made by source applications.

"As a long-standing partner, Cirata has helped many customers in their legacy Hadoop to Databricks migrations," said Siva Abbaraju, Go-to-Market Leader, Migrations at Databricks. "Now, the seamless integration of Cirata Data Migrator with Unity Catalog enables enterprises to capitalise on our Data and AI capabilities to drive productivity and accelerate their business value."

Paul Scott-Murphy, Chief Technology Officer at Cirata, expressed enthusiasm about the integration, noting that it benefits customers by facilitating the wider adoption of data analytics, AI, and machine learning (ML). "By unlocking a critical benefit for our customers, we are furthering the adoption of data analytics, AI, and ML and empowering data teams to drive more meaningful data insights and outcomes," he said.

This new development builds on prior collaborations between Cirata and Databricks. In 2021, both companies partnered to streamline metadata and data migration to Databricks and Delta Lake on the Databricks platform. The integration minimised the need for constructing and maintaining data pipelines to transform, filter, and adjust data, also reducing the significant planning and staging efforts generally required.

With Cirata Data Migrator 2.5, users have the added capability to select the Databricks agent and define the use of Unity Catalog with Databricks SQL Warehouse. This new feature enables data science and engineering teams to maximise their data estate while leveraging their preferred metadata technologies within Databricks.

The Cirata Data Migrator is known for its fully automated solutions that handle Hadoop data transfer and integration. The tool moves data from on-premises HDFS, Hive metadata, local filesystems, or cloud data sources to any preferred cloud or on-premises environment. Remarkably, it does so without requiring changes to the applications or business operations and without downtime or disruption, ensuring no risk of data loss.

Cirata is urging interested parties to learn more about this innovation in their upcoming webinar titled "Accelerate Hadoop Migration to Databricks," scheduled for 27 June 2024.