The CNE IT Data and Analytics team recommends a Cloud Data Lakehouse Platform to find the right solution for CNE. This will include data integrations, connection to a CDP, reporting, and Data Science. CNE currently has an Azure Subscription that has two data platforms available, Databricks and Synapse. Both platforms are leading solutions for data storage, processing, and analytics. We would like to evaluate and choose one of these platforms for CNE’s new Data Lakehouse Infrastructure and Data Catalog based on a few factors. The Product must… use one copy of data. be able to use data stored in Azure Data Lake Storage Gen 2 in Delta format. have a Data Catalog included. support the use of SQL. use Serverless Compute on Apache Spark. support real-time co-authoring of notebooks along with automated version control. support notebook integrations with GitHub. use Lakehouse Architecture. support real-time streaming to Delta formatted files. support role-based access control.
