AI Foundry lab

NO DATA

—

Start here

New to the lab?Create your account, start Claude on a lab machine, give it one line. Known problemsWhat trips people up, and the requests for the lab lead. Chip diagramThe ET-SoC-1, interactively. The reportsThe observability hub.

Live

◆ AI Foundry lab // live telemetry · history: hour / day / week ↗—

Alerts

Card use

A bar runs from a program's first open of a card to its last close, coloured by login; hatched spans were not logged. Lab time. Hover a bar for its details.

Live, last 15 minutes

Last 24 hours

By person and card

LoginCardHeldOf 24 hRunsProgramsLast use

The last 7 days

People

Everyone logged in, running processes or holding a card. “Doing” is a coarse kind of activity: no commands or files leave the machine.

LoginStatusDoingMachinesIdleCard nowCard use, 24 hProcesses

Machines and cards

Click a card for every number and its source.

Last 48 hours

One check every 10 minutes. — Hover a bar for its times.

Die temperature ↗
Board power ↗
Sessions per machine

About this page

A collector on aifoundry2 reads the three machines every 10 minutes, read-only (/proc, sysfs counters, et-who, et-lab-health, et-usage) and republishes when something changed, at least every 60 minutes; an open tab reloads itself. It never opens a card's device node.

It names the lab's users. Per person: login, session and process counts, idle time, coarse activity, card holds and use; never commands, files, addresses or where anyone connects from.

Something wrong or stale on this page? Tell the maintainer, who runs the collector.

For the maintainer (the maintainer): updating and checking it
  • On aifoundry2, in the checkout: tools/lab/dashboard/update.sh now collects, rebuilds and republishes at once; open tabs update within seconds. update.sh now --card-sample also takes a card telemetry sample, behind every rule of the card etiquette. update.sh status shows the last runs and deploys, a halt, and the space's visibility.
  • From another machine: ssh aifoundry2 claude/et-soc1-prototyping/tools/lab/dashboard/update.sh now; or ask Claude in the aifoundry2 session to refresh the lab dashboard.
  • A machine that shows "approval needed": run ssh aifoundry1 true (or aifoundry3) on aifoundry2, approve the address it prints, then update.sh now.
  • Silence a known alert: update.sh ack <alert id> [days] [note] (the id is in each alert's detail).
  • After a halt (the private mode only: the space was, or may have been, readable without signing in): check the space, then update.sh resume; nothing resumes deploying by itself.

This version

—

—

Design and code: tools/lab/dashboard/DESIGN.md.