skill-eval

Workflow runs for skill-eval

• docs(cosmos3): add edge fp8 to cookbooks

  skipped:
  skill-eval#22:Issue comment#345 (comment)createdbylfengad
  Oct 31, 20261s
  More actions for workflow run 22

• fix(inference): warn when a transfer setting cannot take effect

  skipped:
  skill-eval#21:Issue comment#338 (comment)createdbylfengad
  Oct 31, 20262s
  More actions for workflow run 21

• add fp8 instruction for sglang

  skipped:
  skill-eval#20:Issue comment#330 (comment)createdbylfengad
  Oct 31, 20261s
  More actions for workflow run 20

• cookbook(diffusers): add FP8 quantized checkpoint support

  skipped:
  skill-eval#19:Issue comment#298 (comment)createdbylfengad
  Oct 31, 20262s
  More actions for workflow run 19

• fix(eval): count a single-row PAI-Bench-C shard as pending

  requires action with the application:
  skill-eval#18:Pull request#317labeledbyyaoxu-crypto
  tarang-tj:fix/paibench-c-single-row-shard

  Oct 30, 2026Action required
  More actions for workflow run 18

• fix(eval): reuse the Framework checkout in the PAI-Bench-C launcher

  requires action with the application:
  skill-eval#17:Pull request#315labeledbyyaoxu-crypto
  salignatmoandal:fix/paibench-c-framework-paths

  Oct 30, 2026Action required
  More actions for workflow run 17

• Reuse per-image IoU matrix across thresholds in Metropolis2D detectio…

  requires action with the application:
  skill-eval#16:Pull request#325labeledbyyaoxu-crypto
  raus7n:optimize-metropolis2d-iou

  Oct 30, 2026Action required
  More actions for workflow run 16

• Add Nano Brev launchable for native MVBench evaluation

  completed successfully:
  skill-eval#15:Pull request#321labeledbyyaoxu-crypto
  freshyjmp:feat/brev-vantage-launchable

  Oct 30, 20268s
  More actions for workflow run 15

• fix(inference): warn about Sim-Transfer history windows that degrade the video

  completed successfully:
  skill-eval#14:Pull request#344labeledbyyaoxu-crypto
  rwagwani:fix/kv-cache-window-warning

  Oct 30, 20268s
  More actions for workflow run 14

• fix(inference): warn when a transfer setting cannot take effect

  completed successfully:
  skill-eval#13:Pull request#338labeledbyyaoxu-crypto
  rwagwani:fix/transfer-ignored-setting-warnings

  Oct 30, 20269s
  More actions for workflow run 13

• fix(inference): name the cause in Transfer rejection messages

  completed successfully:
  skill-eval#12:Pull request#335labeledbyyaoxu-crypto
  rwagwani:fix/transfer-error-messages

  Oct 30, 202643s
  More actions for workflow run 12

• skills: add cosmos3-qwen3-vl-robovqa-sft (Qwen3-VL-8B SFT on RoboVQA, one GPU, scored before and after)

  skipped:
  skill-eval#11:Issue comment#343 (comment)createdbychristinayyw
  Oct 30, 20261s
  More actions for workflow run 11

• docs(cosmos3): fix Super-FP8 reasoner video requests, pin modelopt 0.44.0

  completed successfully:
  skill-eval#10:Pull request#341labeledbyyaoxu-crypto
  wkutak:wkutak/fp8-reasoner-video-flag-modelopt-pin-upstream

  Oct 30, 20269s
  More actions for workflow run 10

• docs(cosmos3): add edge fp8 to cookbooks

  completed successfully:
  skill-eval#9:Pull request#345labeledbyyaoxu-crypto
  mutichung:docs/edge-fp8-cookbook

  Oct 30, 20268s
  More actions for workflow run 9

• Add Cosmos3-Edge to the TensorRT-LLM Reasoner cookbook

  completed successfully:
  skill-eval#8:Pull request#347labeledbyyaoxu-crypto
  ConstBob:docs/cosmos3-edge-reasoner-trtllm-main

  Oct 30, 20269s
  More actions for workflow run 8

• Add Cosmos3-Edge to the TensorRT-LLM Reasoner cookbook

  skipped:
  skill-eval#7:Issue comment#299 (comment)createdbyConstBob
  Oct 30, 20262s
  More actions for workflow run 7

• Add Cosmos3-Edge variant of the LIBERO-10 action-policy SFT recipe

  requires action with the application:
  skill-eval#6:Pull request#278labeledbyyaoxu-crypto
  ubrobotics-ai:libero-edge-recipe

  Oct 30, 2026Action required
  More actions for workflow run 6

• skills: add cosmos3-qwen3-vl-robovqa-sft (Qwen3-VL-8B SFT on RoboVQA, one GPU, scored before and after)

  completed successfully:
  skill-eval#5:Pull request#343labeledbyyaoxu-crypto
  sbabamohamad:sft-qwen3-vl-robovqa

  Oct 30, 202610s
  More actions for workflow run 5

• cosmos3-qwen3-vl-robovqa-sft: eval-derived fixes (stacked on #343)

  skipped:
  skill-eval#4:Issue comment#346 (comment)createdbychristinayyw
  Oct 30, 20261s
  More actions for workflow run 4

• Single-GPU CPU offloading via reasoner/generator split

  skipped:
  skill-eval#3:Issue comment#11 (comment)createdbyrahul-steiger-nv
  Oct 30, 20262s
  More actions for workflow run 3

• cosmos3-generate-media: eval-derived fixes (stacked on #324)

  completed successfully:
  skill-eval#2:Pull request#327labeledbychristinayyw
  skills/generate-media-fixes-public

  Oct 28, 20261h 54m 59s
  More actions for workflow run 2

• cosmos3-generate-media skill (cookbook → skill migration) with eval-derived fixes, cosmos3-skill-authoring guide, opt-in skill-eval CI

  completed successfully:
  skill-eval#1:Pull request#324labeledbychristinayyw
  skills/generate-media-migration-and-eval-public

  Oct 28, 20263h 14m 40s
  More actions for workflow run 1