Issues

• read_image_file sets media type from filename extension, not content — simple_task fails on Anthropic (fixtures are JPEGs named .png)

  Mercor-Intelligence/archipelago#205 · Filter by author Kymoonx opened on Sep 2, 2026

• APEX-Agents (Law): four task/world data issues that affect measurement validity — missing file in prompt, ambiguous "Template 1", fictional ticker colliding with real EDGAR issuer, prediction-framed rubric

  Mercor-Intelligence/archipelago#194 · Filter by author danielliu99 opened on Aug 29, 2026

• Meta-tool servers reject flat tool arguments (request: Missing required argument); EnvelopeCompatMiddleware currently covers 4 of 11 MCP servers

  Mercor-Intelligence/archipelago#193 · Filter by author danielliu99 opened on Aug 29, 2026

• Proposal: EvalPort adapter for grading output (GradeResult -> Result/GraderResult)

  Mercor-Intelligence/archipelago#190 · Filter by author adhabnr-ux opened on Aug 25, 2026

• Unable to run the eval -> mercor-mcp-shared dependency missing

  Mercor-Intelligence/archipelago#146 · Filter by author surgan12 opened on Jul 7, 2026
  1

• Clarify network policy: does "web search off" mean full network isolation, or only the web-search tool?

  Mercor-Intelligence/archipelago#143 · Filter by author iwanttobeagoodman opened on Jul 1, 2026
  1

• ‼️URGENT: mercor-mcp-shared dependency

  Mercor-Intelligence/archipelago#130 · Filter by author caiqizh opened on Jun 17, 2026

• LLM judge grading errors on fenced JSON output (Invalid JSON after 10 retries)

  Mercor-Intelligence/archipelago#97 · Filter by author davidlibland opened on Jun 4, 2026

• simple_task filesystem MCP server fails to start: wrong interpreter + HTTP/stdio transport mismatch

  Mercor-Intelligence/archipelago#96 · Filter by author davidlibland opened on Jun 4, 2026

• How to run Apex-Agents?

  Mercor-Intelligence/archipelago#86 · Filter by author bleonard opened on Jun 2, 2026
  3

• docs: running hugging_face_task locally silently fails for 5 MCP servers due to private mercor-mcp-shared dependency

  Mercor-Intelligence/archipelago#82 · Filter by author DanielTobi0 opened on May 25, 2026
  3

• Hugging Face task README has stale task selector and max_steps guidance

  Mercor-Intelligence/archipelago#78 · Filter by author Shaan-Kumar opened on May 16, 2026

• Question Regarding Tool Exposure Strategy in APEX-Agents Leaderboard Evaluation

  Mercor-Intelligence/archipelago#25 · Filter by author TheRoadQaQ opened on Apr 10, 2026
  1

• Edgar SEC and FMP MCP servers listed in world descriptions are never implemented and never loaded into the environment

  Mercor-Intelligence/archipelago#18 · Filter by author cocoa0409 opened on Apr 7, 2026
  1

• Inconsistency in GLM4.7 Official Reported Mean Score

  Mercor-Intelligence/archipelago#8 · Filter by author Meteor-xx opened on Mar 24, 2026

• Request: Switch from force pushes to regular git commits

  Mercor-Intelligence/archipelago#7 · Filter by author gautier-cohere opened on Mar 9, 2026
  1

• Support for podman instead of docker

  Mercor-Intelligence/archipelago#6 · Filter by author thawkins opened on Mar 6, 2026

• Support for local llms hosted on ollama

  Mercor-Intelligence/archipelago#5 · Filter by author thawkins opened on Mar 6, 2026

• Reproduction discrepancy: Kimi K2.5 Thinking scores lower than reported on Law domain

  Mercor-Intelligence/archipelago#4 · Filter by author QorinAI opened on Mar 4, 2026

• MCP server fails to start in sample_huggingface_task due to missing sandbox_fs.so (code execution server RuntimeError)

  Mercor-Intelligence/archipelago#2 · Filter by author ravindra-byte opened on Feb 17, 2026
  3