Monitoring LLMs in Production with Hugging Face and WhyLabs

Monitoring LLMs in Production with Hugging Face and WhyLabs

Actions Panel

Learn how to monitor, evaluate, and test LLMs in production with WhyLabs LangKit + Hugging Face models

By WhyLabsFollow

Date and time

Thursday, November 30 · 10 – 11am PST

Location

Online

About this event

  • 1 hour
  • Mobile eTicket

Join this hands-on workshop to implement ML monitoring on Hugging Face models with WhyLabs LangKit.

The ability to effectively monitor and manage large language models (LLMs) like GPT from OpenAI has become essential in the rapidly advancing field of AI. WhyLabs, in response to the growing demand, has created a powerful new tool, LangKit, to ensure LLM applications are monitored continuously and operated responsibly.

Join our workshop designed to equip you with the knowledge and skills to use LangKit with Hugging Face models. Guided by our team of experienced AI practitioners, you’ll learn how to evaluate, troubleshoot, and monitor large language models more effectively.

Once completed, you’ll also receive a certificate!

This workshop will cover how to:

  • Evaluate user interactions to monitor prompts, responses, and user interactions
  • Configure acceptable limits to indicate things like malicious prompts, toxic responses, hallucinations, and jailbreak attempts.
  • Set up monitors and alerts to help prevent undesirable behavior

What you’ll need:

  • A free WhyLabs account (https://whylabs.ai/free)
  • A Google account (for saving a Google Colab)

Who should attend:

Anyone interested in building applications with LLMs, AI Observability, Model monitoring, MLOps, and DataOps! This workshop is designed to be approachable for most skill levels. Familiarity with machine learning and Python will be useful, but it’s not required to attend.

By the end of this workshop, you’ll be able to implement ML monitoring techniques to your large language models (LLMs) to catch deviations and biases.

Bring your curiosity and your questions. By the end of the workshop, you’ll leave with a new level of comfort and familiarity with LangKit and be ready to take your language model development and monitoring to the next level.

About WhyLabs:

WhyLabs.ai is an AI observability platform that prevents data & model performance degradation by allowing you to monitor your data and machine learning models in production. https://whylabs.ai/

Check out our open-source data & ML monitoring project: https://github.com/whylabs/whylogs

Do you want to connect with the community, learn about WhyLabs, or get project support? Join the WhyLabs + Robust & Responsible AI community Slack: https://bit.ly/rsqrd-slack

Report this event
https://www.eventbrite.com/e/monitoring-llms-in-production-with-hugging-face-and-whylabs-tickets-753492956717

Other events you may like