IA-QA Eval & RAG — 38 tools
LLM & RAG evals: hallucination, eval contracts, semantic tests, tokens & model info. Free, no key.
Description as published in the official MCP registry.
Maintain this server? Get the badge
What we measured
| Endpoint | https://www.ia-qa.com/mcp/eval | registry |
|---|---|---|
| Handshake | Answers the MCP handshake and lists its tools (833 ms) | our check, 2026-10-27 |
| Protocol version | 2025-11-25 | our check, 2026-10-27 |
| Tools (38) | get_testing_guidelines, find_tool, hallucination_check, run_eval_contract, run_semantic_tests, generate_ci_workflow, needle_haystack_generate, generate_eval_yaml, metamorphic_check, test_skill, llm_output_validator, compare_responses, analyze_responses, prompt_test_suite, llm_format_check, consistency_check, llm_json_schema_check, response_quality_score, conversation_analyze, cot_analyzer, ab_test_report, similarity_score, run_vlm_test_suite, embedding_similarity, rag_relevance_rank, bm25_score, build_rag_prompt, rerank_evaluate, count_tokens, extract_json_from_text, estimate_llm_cost, token_budget_calculator, context_window_check, model_info, compare_models, list_llm_models, llm_generate, rate_tool | tools/list, 2026-10-27 |
| GitHub stars | 0 | github.com/ia-qa-com/mcp |
| Last push | 2026-10-26 | GitHub API |
| Licence | MIT | GitHub API |
| Registry version | 1.0.1 · active · updated 2026-10-26 | registry |
Signed reports
No signed reports yet. A report carries a signed decision record from the reporter's gate, so it shows that the gate allowed a call, not just an opinion; it does not prove which server answered. How to file one.
Connect
claude mcp add --transport http ia-qa-eval https://www.ia-qa.com/mcp/evalCommands are built from the registry entry. Check the publisher's documentation before giving any server access to your data.
Related servers
- fojin — Buddhist Canon Tools Buddhist canon tools: search, passages, cross-canon parallels, dictionaries — all…
- ref-tools-ref-tools-mcp Provide your AI coding tools with token-efficient access to up-to-date technical…
- IA-QA Data & Dev — 36 tools Dev utilities for agents: JSON/YAML/CSV, schema validation, encoding, text & time. Free…
- IA-QA Security — 30 tools Agent security: prompt injection, PII & secret scans, TLS/header/CORS audits, MCP checks…
- IA-QA — 152 QA & Dev Tools for AI Agents 152 free QA tools for agents: injection scan, evals, RAG, web audits. Smaller packs…
- ref-tools-mcp Token-efficient search for coding agents over public and private documentation.
Is this your server?
Show the result of our latest check where your users look first. The badge is a live image: it changes when our check does, and it links back to this page.
[](https://openforallofus.com/tools/io.github.JcJamet/ia-qa-eval)<a href="https://openforallofus.com/tools/io.github.JcJamet/ia-qa-eval"><img src="https://openforallofus.com/badge/io.github.JcJamet/ia-qa-eval.svg" alt="Agora: MCP handshake check" height="20"></a>The badge reports one thing: the result of our last handshake check. A server with no remote endpoint shows as "runs locally". How we check.
Agents can read this page as data: MCP endpoint https://openforallofus.com/api/mcp, tool get_tool with name io.github.JcJamet/ia-qa-eval.