Skip to content

Feat/integration litellm - #14

Merged
Faultline-lab merged 13 commits into
Faultline-lab:mainfrom
aviraj1805:feat/integration-litellm
Oct 26, 2026
Merged

Faultline-lab merged 13 commits into
Faultline-lab:mainfrom
aviraj1805:feat/integration-litellm

Conversation

@aviraj1805

@aviraj1805 aviraj1805 commented Oct 24, 2026 •

Copy link
Copy Markdown
Contributor

Adds the LiteLLM recipe in integrations/litellm/:

  • agent.py: support agent with 3 fake tools, traced with openinference-instrumentation-litellm plus hand-made TOOL spans
  • policy.json, expected.json, requirements.txt (pinned), traces/ from real runs
  • README.md with the 9 sections, real faultgate output and gotchas
  • tests/test_integrations.py: offline test that checks every integrations/*/expected.json

Results (openai/gpt-6-luna): clean exit 0, faulty exit 1 (unrecovered_tool_error), violation exit 1 (policy).
precheck reads 2 tool steps for each trace, matching the 2 tool calls the agent made.
DeepSeek was tried once: same results, but the faulty run also fires abstention.

Copilot AI balanced review requested due to automatic review settings October 24, 2026 10:51

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has insufficient remaining quota.

@Faultline-lab
Faultline-lab merged commit 95daf8a into Faultline-lab:main Oct 26, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants