LangSmith MCP

Pulls LangSmith traces and runs: inputs, outputs, latency, and errors for a project. It turns 'the agent is flaky' into a specific failing step, which is the only way an evaluation loop improves. Read-only…

Community stdio Verified 2026-11-12 observabilityagentsevaluation

Use it for

Reading traces and evaluations to find where an agent fails

Skip it if

Running experiments — that is the platform's job

What it is

Pulls LangSmith traces and runs: inputs, outputs, latency, and errors for a project. It turns ‘the agent is flaky’ into a specific failing step, which is the only way an evaluation loop improves. Read-only access is enough for that.

Install

Terminal
uvx langsmith-mcp

Client configuration

Paste this into your MCP client config, then restart the client.

MCP client config (JSON)
{
  "mcpServers": {
    "avbbc": {
      "command": "npx",
      "args": ["-y", "uvx langsmith-mcp"]
    }
  }
}

Overlapping servers

All servers
  • 01
    Grafana MCPOfficial

    Connects an agent to a Grafana instance so it can list dashboards, run datasource queries, and inspect alert rules. The value is in incident work: an agent that can …

    #grafana#observability#metrics
    Gostdio
  • 02
    SentryOfficial

    Pulls issues, stack traces, and event context into the agent so it can triage production errors with the actual payload in front of it. Remote-hosted, which means no…

    #monitoring#errors#observability
    TypeScripthttp
  • 03
    Datadog MCPCommunity

    Queries the Datadog API for metrics, monitors, dashboards, and incident data. On an incident this turns 'something is slow' into an actual series with a timestamp. C…

    #monitoring#observability#incidents
    TypeScriptstdio

Tools that use this server

All tools

Skills built around it

All skills