Skip to content

Vitest

4.77 / 5 composite score · 98.0% API recall · 50 questions evaluated

Vue Docs MCP provides deep access to the official Vitest documentation, covering the test framework's API reference (test, describe, expect, vi), configuration options, mocking guides, browser testing, coverage, and migration guides.

Activation

Vitest is not enabled by default. Call set_framework_preferences to activate it:

set_framework_preferences(vitest=true)

Tools

Semantic search over Vitest documentation. Uses a 6-step pipeline: embed query, hybrid search (dense + BM25), resolve HyPE hits, expand cross-references, rerank, and reconstruct into readable markdown.

ParameterTypeDefaultDescription
querystringDeveloper question or topic (max 2000 chars)
scopestring"all"Documentation section to search within
max_resultsinteger3Number of sections to return (1-20)

Scope values: all, guide, api, config

vitest_api_lookup

Fast exact-match API reference lookup with fuzzy fallback. Returns type signatures, descriptions, and usage examples directly from the documentation.

ParameterTypeDefaultDescription
namestringAPI name to look up (e.g. vi.mock, test.each, expect, coverage)

Find related APIs, concepts, and documentation pages for a given API or topic.

ParameterTypeDefaultDescription
namestringAPI name or concept to explore

Resources

URIDescription
vitest://topicsFull table of contents
vitest://topics/{section}TOC for a specific section (e.g. vitest://topics/guide)
vitest://pages/{path}Raw markdown of any doc page (e.g. vitest://pages/api/vi)
vitest://api/indexComplete API entity index grouped by type
vitest://api/entities/{name}Details for a specific API (e.g. vitest://api/entities/vi.mock)
vitest://scopesAll valid search scope values

Prompts

PromptParametersDescription
debug_vitest_issuesymptom, code_snippet (optional)Systematic debugging workflow: identifies the concept, searches docs, looks up APIs, and provides a fix
compare_vitest_apisitems (comma-separated)Side-by-side comparison of APIs or patterns (e.g. vi.mock, vi.doMock or test.each, test.for)
migrate_vitest_patternfrom_pattern, to_patternMigration guide between patterns (e.g. Jest to Vitest)

Benchmarks vs Context7

Evaluated on 50 Vitest questions scored by an LLM judge (Gemini, temperature 0) across 5 dimensions on a 1-5 scale.

Methodology

Each question has a ground-truth answer with expected API names and documentation paths. Both providers receive the same question and return documentation context. The judge scores the retrieved context on relevance, completeness, correctness, API coverage, and conciseness. See the eval/ directory in the repository for the full evaluation framework.

Overall Scores

MetricVue Docs MCPContext7
Relevance4.824.92
Completeness4.664.80
Correctness4.724.86
API Coverage4.704.56
Conciseness4.964.86
Composite4.774.80

Retrieval and Cost

MetricVue Docs MCPContext7
API Recall98.0%89.0%
Avg Response Tokens3,361797
Avg Latency1.44s1.57s
Cost per Query (user-facing)Free$0.002

Notes on Fairness

  • Context7 is a general-purpose service covering 9000+ libraries. Vue Docs MCP is purpose-built for the Vue ecosystem.
  • Context7 scores slightly higher on composite for Vitest (4.80 vs 4.77), while Vue Docs MCP leads on API recall (98% vs 89%) and is free to use.
  • The evaluation framework is open source in the eval/ directory. Run make eval-compare to reproduce.