LLM-based Embedding Monitoring: Track LLM Performance by Monitoring Drift

Generative AI and LLMOps

ML Model Monitoring

Table of content

Learn how to track the performance of LLM-based embeddings from OpenAI, Cohere, Anthropic, and other LLMs by monitoring drift using Fiddler.

GIF illustrating LLM-based Embedding Monitoring: Tracking LLM performance with the Fiddler platform, featuring a drift versus average value graph for the newsgroup model and displaying prediction drift, feature impact, and other metrics.

Video transcript