8/31/2023 0 Comments Data lakehouse access control![]() The federation includes the ability to map and query data from sources like MySQL, Redshift, Snowflake, and BigQuery, in addition to Databricks. These new features enable customers to locate, query, and govern data across all connected systems from a single interface, without the necessity of moving or duplicating the data. On the governance front, Databricks released new federation capabilities in its Unity Catalog service that break down silos between data systems on the platform. This feature enables data stored in Delta Lake data tables to be read as if it were in Apache Iceberg or Apache Hudi format. The key innovation in Delta Lake 3.0 is its new Universal Format, or " UniForm", capability. "There's all this talk about format wars, and it's actually really unfortunate," Databricks CEO and co-founder Ali Ghodsi said. Delta Lake competes with other open-source standards like the Apache Foundation's Iceberg and Hudi. Among the tools were LakehouseIQ, a "knowledge engine" that uses AI to understand a company's unique data, culture, and language in order to improve natural language interfaces like chatbots.ĭatabricks updated its Delta Lake standard for the analytic data tables in data-lake systems. The Data and AI company Databricks recently unveiled Lakehouse AI, a suite of tools for building and governing generative AI models, including large language models (LLMs), within the Databricks platform. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |