In-Short
- Databricks introduces DBRX, a new standard for open large language models with efficient training and high performance.
- Unity Catalog, an open-source data governance tool, is launched to manage data sprawl and access controls across platforms.
- Databricks AI/BI and Mosaic AI are new products for enhanced data analysis and machine learning application management.
- The Data Intelligence Platform underpins these innovations, combining data lakes and warehouses for AI-driven data management.
Summary
In a recent interview, Ivo Everts from Databricks discussed the company’s latest advancements in open-source AI and data governance. The DBRX model, a new benchmark for open large language models, stands out for its superior performance and efficient training. It aims to democratize the training of custom LLMs, making it accessible and cost-effective for a broader range of organizations.
Databricks has also contributed to open ecosystems by open-sourcing Unity Catalog, a tool designed to tackle data sprawl and inconsistent access controls. It offers centralized data access management, Role-Based Access Control, data lineage, auditing, and support for multi-cloud and hybrid environments, ensuring uniform data governance.
The company’s new business intelligence product, Databricks AI/BI, leverages generative AI to improve data exploration and visualization. It features AI-powered dashboards and Genie, a conversational interface for natural language queries. Mosaic AI, another new platform, provides a comprehensive solution for building, deploying, and managing machine learning and generative AI applications, with a focus on cost-effective custom LLMs and centralized model management.
At the core of these innovations is the Data Intelligence Platform, which revolutionizes data management by leveraging AI to gain insights into enterprise data semantics. It combines the features of data lakes and warehouses, uses Delta Lake technology for real-time data processing, and facilitates secure data exchange with Delta Sharing.
Databricks will be showcasing these open-source AI and data governance solutions at the upcoming AI & Big Data Expo Europe. Attendees can visit Databricks’ booth to learn more about their offerings and see the GenAI app in action.
For more detailed insights, visit the original source.
