Inspect Logs MCP Server

Local setup required. This server has to be cloned and prepared on your machine before you register it in Claude Code.
1

Set the server up locally

Run this once to clone and prepare the server before adding it to Claude Code.

Run in terminal
git clone https://github.com/PranshuSrivastava/inspect-logs-mcp.git
cd inspect-logs-mcp
pip install -e .
2

Register it in Claude Code

After the local setup is done, run this command to point Claude Code at the built server.

Run in terminal
claude mcp add inspect-logs -- node "<FULL_PATH_TO_INSPECT_LOGS_MCP>/dist/index.js"

Replace <FULL_PATH_TO_INSPECT_LOGS_MCP>/dist/index.js with the actual folder you prepared in step 1.

README.md

Explore and analyze inspect_ai evaluation logs directly from LLMs

inspect-logs-mcp

MCP server for exploring inspect_ai evaluation logs from Claude Code.

What it does

This MCP server gives Claude Code, Cursor, and other LLMs direct access to your inspect_ai evaluation logs, allowing you to:

  • List logs: See all your evaluation runs with metadata
  • View summaries: Get detailed evaluation results, scores, and token usage
  • Inspect samples: View full conversation history for any sample
  • Search & filter: Find logs by task, model, date, or status
  • Compare runs: Side-by-side comparison of two evaluation runs
  • Aggregate stats: Get statistics across multiple runs

Installation

Currently only source installation is supported.

git clone https://github.com/PranshuSrivastava/inspect-logs-mcp.git
cd inspect-logs-mcp
pip install -e .

Configuration

To use with Claude code in your current directory, run the following command:

claude mcp add --transport stdio inspect-logs inspect-logs-mcp

To use with Claude code in your global configuration, run the following command:

claude mcp add --scope user --transport stdio inspect-logs inspect-logs-mcp

To use with Cursor, Antigravity or other IDEs, add the following to your mcp config file:

{
    "mcpServers": {
        "inspect-logs": {
            "command": "inspect-logs-mcp",
            "env": {
                "INSPECT_LOG_DIR": "./logs"
            }
        }
    }
}

Environment Variables

Variable Description Default
INSPECT_LOG_DIR Directory containing .eval log files ./logs
INSPECT_LOGS_MCP_DEFAULT_LIMIT Default number of logs limit 50
INSPECT_LOGS_MCP_MAX_LIMIT Maximum number of logs limit 500

How it Works

The server reads .eval files (which are ZIP archives containing JSON) using the inspect_ai.log API. All file operations happen in memory - no files are extracted to disk, so your logs directory stays clean.

Requirements

  • Python 3.10+
  • inspect-ai >= 0.3.70
  • mcp >= 1.0.0

Tools (3)

list_logsList all evaluation runs with metadata
view_summaryGet detailed evaluation results, scores, and token usage for a specific log
inspect_sampleView full conversation history for a specific sample within a log

Environment Variables

INSPECT_LOG_DIRDirectory containing .eval log files
INSPECT_LOGS_MCP_DEFAULT_LIMITDefault number of logs limit
INSPECT_LOGS_MCP_MAX_LIMITMaximum number of logs limit

Configuration

claude_desktop_config.json
{"mcpServers": {"inspect-logs": {"command": "inspect-logs-mcp", "env": {"INSPECT_LOG_DIR": "./logs"}}}}

Try it

List the most recent evaluation runs from my logs directory.
Show me the summary and token usage for the latest evaluation run.
Inspect the conversation history for sample ID 5 in the latest evaluation log.
Compare the results of my last two evaluation runs.

Frequently Asked Questions

What are the key features of Inspect Logs?

List evaluation runs with associated metadata. Retrieve detailed evaluation summaries including scores and token usage. Inspect full conversation histories for individual samples. Search and filter logs by task, model, date, or status. Perform in-memory log analysis without extracting files to disk.

What can I use Inspect Logs for?

Debugging model performance on specific evaluation samples. Analyzing token usage and cost efficiency across multiple evaluation runs. Comparing model performance improvements between different evaluation iterations. Quickly auditing evaluation results directly within the development environment.

How do I install Inspect Logs?

Install Inspect Logs by running: git clone https://github.com/PranshuSrivastava/inspect-logs-mcp.git && cd inspect-logs-mcp && pip install -e .

What MCP clients work with Inspect Logs?

Inspect Logs works with any MCP-compatible client including Claude Desktop, Claude Code, Cursor, and other editors with MCP support.

Turn this server into reusable context

Keep Inspect Logs docs, env vars, and workflow notes in Conare so your agent carries them across sessions.

Need the old visual installer? Open Conare IDE.
Open Conare