Skip to content

Fix/several bot failures #251

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
colesussmeier wants to merge 2 commits into from
Closed

Fix/several bot failures #251

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
4eec9f9
remove grok_4_1 models since only the grok_4_1_fast variant is availa…
colesussmeier May 7, 2026
a60565e
uniform bot only needs a token to get access to questions, not for ca…
colesussmeier May 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
28 changes: 1 addition & 27 deletions .github/workflows/run-bot-aib-tournament.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -86,32 +86,6 @@ jobs:

# NOTE: don't remove any of the open source models, since these are the best option for a long term baseline (other models get deprecated)

bot_grok_4_1_high: # TODO: Not yet released via API as of Dec 21st, 2025
needs: precache_asknews
uses: ./.github/workflows/run-bot-launcher.yaml
with:
bot_name: "METAC_GROK_4_1_HIGH"
cache_key: asknews-cache-${{ github.run_id }}
secrets:
INPUT_METACULUS_TOKEN: ${{ secrets.METAC_GROK_4_1_HIGH }}
INPUT_XAI_API_KEY: ${{ secrets.XAI_API_KEY }}
INPUT_OPENROUTER_API_KEY: ${{ secrets.OPENROUTER_API_KEY }}
INPUT_ASKNEWS_CLIENT_ID: ${{ secrets.ASKNEWS_CLIENT_ID }}
INPUT_ASKNEWS_SECRET: ${{ secrets.ASKNEWS_SECRET }}

bot_grok_4_1: # TODO: Not yet released via API as of Dec 21st, 2025
needs: precache_asknews
uses: ./.github/workflows/run-bot-launcher.yaml
with:
bot_name: "METAC_GROK_4_1"
cache_key: asknews-cache-${{ github.run_id }}
secrets:
INPUT_METACULUS_TOKEN: ${{ secrets.METAC_GROK_4_1 }}
INPUT_XAI_API_KEY: ${{ secrets.XAI_API_KEY }}
INPUT_OPENROUTER_API_KEY: ${{ secrets.OPENROUTER_API_KEY }}
INPUT_ASKNEWS_CLIENT_ID: ${{ secrets.ASKNEWS_CLIENT_ID }}
INPUT_ASKNEWS_SECRET: ${{ secrets.ASKNEWS_SECRET }}

#################################### February 2026 new bots ####################################

bot_claude_opus_4_6_high_32k:
Expand Down Expand Up @@ -1547,7 +1521,7 @@ jobs:
bot_name: "METAC_UNIFORM_PROBABILITY_BOT_TOKEN"
cache_key: asknews-cache-${{ github.run_id }}
secrets:
INPUT_METACULUS_TOKENS: ${{ secrets.METACULUS_TOKENS }}
Copy link
Copy Markdown
Contributor

@lsabor lsabor May 7, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In #245, I shifted things so that all of the metaculus api tokens are stored in the METACULUS_TOKENS secret. It might not be working properly, so that might be a blocker, but I think it should be sorted by #246 maybe?

Copy link
Copy Markdown
Contributor

@lsabor lsabor May 7, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Another note: METACULUS_TOKEN secret I think is an actual staff user metaculus token, not the token for the uniform probability bot (I deleted it from the secrets since we hit the limit of secrets in this repo and I needed space for METACULUS_TOKENS).

INPUT_METACULUS_TOKEN: ${{ secrets.METACULUS_TOKEN }}
INPUT_METACULUS_API_BASE_URL: ${{ secrets.METACULUS_API_BASE_URL }}
INPUT_ASKNEWS_CLIENT_ID: ${{ secrets.ASKNEWS_CLIENT_ID }}
INPUT_ASKNEWS_SECRET: ${{ secrets.ASKNEWS_SECRET }}
Expand Down
Loading