CIO Insider

CIOInsider India Magazine

Separator

Databricks Introduces AI Assistant that Enables Customers to Ask Complex Inquiries

CIO Insider Team | Thursday, 29 June, 2023
Separator

Databricks unveiled an AI assistant that enables business customers to ask challenging inquiries about their corporate data in everyday language.

Several digital businesses, including Adobe Inc. and Intel Corp., are vying to utilize chatbots that can hold human-like conversations to filter through business data like sales transactions or written reports in search of solutions.

One such company is Databricks, a San Francisco-based startup with a most recent valuation of $38 billion.

The main offering from Databricks is technology for storing enormous amounts of company data in a form that makes it simple to access and analyze. But in order to achieve that, a data scientist must often create computer code that locates and works with the data.

Instead of utilizing computer code, the new approach, called LakehouseIQ, will allow people to ask inquiries intuitively. An AI system will comprehend the query, gather the required information, read it, and generate an answer in the background.

The first of its type knowledge engine, LakehouseIQ, directly addresses this issue by automatically picking up on the business and data ideas unique to your company. Utilizing the distinctive end-to-end nature of the Databricks platform, it uses signals from throughout the Databricks Lakehouse platform, including Unity Catalog, dashboards, notebooks, data pipelines, and documents, to observe how data is used in practice.

Since the AI system would be trained on a company's own data rather than generic data from the internet, Ali Ghodsi, chief executive of Databricks, expects that it will be especially helpful.

According to Databricks, this could help the AI swiftly catch up on essential information such as the dates of the company's fiscal year or industry-specific lingo.

"There's lots of three letter acronyms in any organization. They mean lots of different things, and not even everyone in the company knows it," Ghodsi said. By training on the customer's specific data, the new Databricks offering "understands the jargon. It understands the domain you're working in."

Undoubtedly, large language models have promised to bring language interfaces to data, and every data firm is adding an AI assistant, but in practice, many of these solutions fall short when it comes to enterprise data. Every organization needs specific statistics, vocabulary, and internal expertise to answer its business questions, therefore contacting an LLM with Internet-based training to do so will produce inaccurate answers. According to the corporation, even seemingly straightforward things like the definition of a "customer" or the fiscal year differ between different businesses.

The first of its type knowledge engine, LakehouseIQ, directly addresses this issue by automatically picking up on the business and data ideas unique to your company. Utilizing the distinctive end-to-end nature of the Databricks platform, it uses signals from throughout the Databricks Lakehouse platform, including Unity Catalog, dashboards, notebooks, data pipelines, and documents, to observe how data is used in practice. As a result, LakehouseIQ can create highly precise customised models for your company.



Current Issue
Trust Is At The Center of BFSI Transformation