Interpretability & Visualization Tools

Visualize, inspect, and debug behavior of LLMs and other ML models.

  1. Interactive Prompt Debugging with Sequence Salience
    Interactive Prompt Debugging with Sequence Salience
    Ian Tenney, Ryan Mullins, Bin Du, Shree Pandya, Minsuk Kahng, and Lucas Dixon
    arXiv preprint, 2024
  2. LLM Comparator: Visual Analytics for Side-by-Side Evaluation of Large Language Models
    LLM Comparator: Visual Analytics for Side-by-Side Evaluation of Large Language Models
    Minsuk Kahng, Ian Tenney, Mahima Pushkarna, Michael Xieyang Liu, James Wexler, Emily Reif, Krystal Kallarackal, Minsuk Chang, Michael Terry, and Lucas Dixon
    IEEE Transactions on Visualization and Computer Graphics, 2024
  3. The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Models
    The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Models
    Ian Tenney, James Wexler, Jasmijn Bastings, Tolga Bolukbasi, Andy Coenen, Sebastian Gehrmann, Ellen Jiang, Mahima Pushkarna, Carey Radebaugh, Emily Reif, and Ann Yuan
    In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, 2020