Skip to content

Add MiniMax provider routing to the PRICE API judge #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
octo-patch wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Add MiniMax provider routing to the PRICE API judge #1

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions evaluation/image_gen/PRICE/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -118,6 +118,9 @@ api_key = "YOUR_GEMINI_API_KEY"

[doubao]
api_key = "YOUR_DOUBAO_API_KEY"

[minimax]
api_key = "YOUR_MINIMAX_API_KEY"
```

The supported API judge aliases are:
Expand All @@ -127,6 +130,10 @@ The supported API judge aliases are:
| `gemini3.1` | Gemini official API or AiHubMix fallback |
| `gpt5.4` | OpenAI official API or AiHubMix fallback |
| `doubao2.0` | Doubao official API or AiHubMix fallback |
| `minimax-m3` | MiniMax official API or AiHubMix fallback |
| `minimax-m2.7` | MiniMax official API or AiHubMix fallback |

The MiniMax provider defaults to the global endpoint (`https://api.minimax.io/v1`). To use the mainland China site instead, set `base_url = "https://api.minimaxi.com/v1"` under `[minimax]` in `env.toml`.

If an official provider key is unavailable, configure the optional fallback:

Expand Down
9 changes: 7 additions & 2 deletions evaluation/image_gen/PRICE/env.example.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Recommended: official provider APIs. Fill in whichever providers you plan
# to use — gemini3.1 -> [gemini], gpt5.4 -> [openai], doubao2.0 -> [doubao].
# You don't need all three.
# to use — gemini3.1 -> [gemini], gpt5.4 -> [openai], doubao2.0 -> [doubao],
# minimax-m3 / minimax-m2.7 -> [minimax]. You don't need all of them.

[openai]
api_key = "YOUR_OPENAI_API_KEY"
Expand All @@ -15,6 +15,11 @@ api_key = "YOUR_DOUBAO_API_KEY"
# base_url = "https://ark.cn-beijing.volces.com/api/v3" # optional override
# endpoint_id = "ep-xxxxxxxxxxxx" # optional: use an Ark inference endpoint id instead of a model name

[minimax]
api_key = "YOUR_MINIMAX_API_KEY"
# base_url = "https://api.minimax.io/v1" # optional override (global/international default)
# base_url = "https://api.minimaxi.com/v1" # use this for the mainland China site instead

# Fallback: any judge whose provider table above isn't filled in (or whose
# api_key is left as the placeholder) uses this aggregator instead. A single
# key here is the simplest way to get started without official provider keys.
Expand Down
9 changes: 9 additions & 0 deletions evaluation/image_gen/PRICE/scripts/eval_imgs.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,8 @@
"gemini3.1": "gemini-3.1-pro-preview",
"gpt5.4": "gpt-5.4-high",
"doubao2.0": "doubao-seed-2-0-pro",
"minimax-m3": "MiniMax-M3",
"minimax-m2.7": "MiniMax-M2.7",
}

# Optional direct-to-provider routing (see docs/PUBLIC_OFFICIAL_API_JUDGES_PLAN_zh.md).
Expand All @@ -42,6 +44,8 @@
"gemini3.1": "gemini",
"gpt5.4": "openai",
"doubao2.0": "doubao",
"minimax-m3": "minimax",
"minimax-m2.7": "minimax",
}

# NOTE: these base URLs are the providers' publicly documented endpoints, but the
Expand All @@ -51,6 +55,9 @@
"openai": "https://api.openai.com/v1",
"gemini": "https://generativelanguage.googleapis.com/v1beta/openai/",
"doubao": "https://ark.cn-beijing.volces.com/api/v3",
# Global (international) OpenAI-compatible endpoint. For the mainland China
# site set base_url = "https://api.minimaxi.com/v1" under [minimax] in env.toml.
"minimax": "https://api.minimax.io/v1",
}

# NOTE: unverified best-effort defaults, reusing the aggregator's alias strings (a
Expand All @@ -60,6 +67,8 @@
"gemini3.1": "gemini-3.1-pro-preview",
"gpt5.4": "gpt-5.4-high",
"doubao2.0": "doubao-seed-2-0-pro",
"minimax-m3": "MiniMax-M3",
"minimax-m2.7": "MiniMax-M2.7",
}

PROVIDER_MODE_CHOICES = ("auto", "official", "aihubmix")
Expand Down