• Tracking Drift to Monitor LLM Performance

  • Dec 12 2024
  • Duración: 12 m
  • Podcast

Tracking Drift to Monitor LLM Performance

Escúchala gratis

Ver detalles del espectáculo

  • Resumen

  • In this episode, we discuss how to monitor the performance of Large Language Models (LLMs) in production environments. We explore common enterprise approaches to LLM deployment and evaluate the importance of monitoring for LLM quality or the quality of LLM responses over time. We discuss strategies for "drift monitoring" — tracking changes in both input prompts and output responses — allowing for proactive troubleshooting and improvement via techniques like fine-tuning or augmenting data sources.

    Read the article by Fiddler AI and explore additional resources on how AI observability can help developers build trust into AI services.
    Más Menos
Más Menos
adbl_web_global_use_to_activate_webcro768_stickypopup

Lo que los oyentes dicen sobre Tracking Drift to Monitor LLM Performance

Calificaciones medias de los clientes

Reseñas - Selecciona las pestañas a continuación para cambiar el origen de las reseñas.

Reseñas de Audible.com

Opiniones de Amazon
No hay comentarios disponibles