Watch Your Models Learn: Real-Time AI/ML Experiments with Visdom

Training an AI model can take minutes, hours or days. Waiting until the end to inspect a log file is often too late: loss may already be diverging, gradients may be behaving unexpectedly, validation performance may have stopped improving, or a data pipeline may simply be producing the wrong results.

Visdom provides an open-source way to see what is happening while an experiment is running.

In this session, Norbert Preining will show how Python applications and machine-learning workflows can send live data to Visdom and turn a running experiment into an interactive dashboard. Starting with only a few lines of Python, we will look at streaming loss and accuracy curves, NumPy data, images and model outputs directly into the browser.

The session will then move from individual plots to complete ML workflows: monitoring PyTorch and PyTorch Lightning training, collecting TensorFlow/Keras metrics, organizing experiments, recording hyperparameters and comparing runs. We will also look at how Visdom can be used to inspect images, embeddings and other intermediate results while a model is still training.

A key idea behind Visdom is that visualization should remain separate from the computation itself. Your training framework computes the metrics; Visdom receives, stores and visualizes them. This keeps the integration small, makes Visdom usable with many different frameworks and allows developers to run the visualization server locally, on their own infrastructure or alongside…