Not everyone running PostTrainBench has a ChatGPT subscription with the required judge models available. Many users already have access to OpenAI-compatible endpoints (OpenRouter, self-hosted gateways, other vendors) and would like to use those for the judge phase.
Can you offer a way to use a third part model as the judge models? Thanks
Not everyone running PostTrainBench has a ChatGPT subscription with the required judge models available. Many users already have access to OpenAI-compatible endpoints (OpenRouter, self-hosted gateways, other vendors) and would like to use those for the judge phase.
Can you offer a way to use a third part model as the judge models? Thanks