Delivering Personalized & Realtime Context for LLM: Databricks Feature & Function Serving

Wednesday, October 11, 3:10pm - 3:35pm (CDT)

Time shown in-05:00 America, Chicago

Speaker: Aakrati Talati, Mingyang Ge

Large Language Model (LLM) performance can be greatly improved by providing relevant context for the problem the model is employed to solve. In this talk we show how you can harness Databricks Feature and Function Serving powered by data in your Lakehouse to provide real-time context ingestion and retrieval for your LLMs, thus improving accuracy and relevance in Natural
Language Processing applications. Furthermore, the Lakehouse architecture offers robust security and governance features, ensuring protection from data leaks in external systems.

Add to Calendar 2023/10/11 13:10:00 2023/10/11 13:35:00 America/Los_Angeles Delivering Personalized & Realtime Context for LLM: Databricks Feature & Function Serving Speaker: Aakrati Talati, Mingyang Ge

Large Language Model (LLM) performance can be greatly improved by providing relevant context for the problem the model is employed to solve. In this talk we show how you can harness Databricks Feature and Function Serving powered by data in your Lakehouse to provide real-time context ingestion and retrieval for your LLMs, thus improving accuracy and relevance in Natural
Language Processing applications. Furthermore, the Lakehouse architecture offers robust security and governance features, ensuring protection from data leaks in external systems. false MM/DD/YYYY 60 OPAQUE apQfLtmRnzOiFbgoNmal132273

Link: