Skip to content
Tools

Tools

Free, open-source interpretability tools that run real language models behind a web page: tokenizers, attention patterns and the logit lens.

Web appLive

attnlab

A set of labs, walked in order, that run real TransformerLens models behind a web page. Type a prompt, pick a model, and see how it is tokenized, where every head attends, and when the model knows its answer.

  • Mechanistic interpretability
  • TransformerLens
  • Attention