Is Kaggle Overnight an AI agent for Kaggle?+
Yes — an open-source one that works on live competitions with your own Kaggle account. Your coding agent (Claude Code or Cursor) or your own model proposes each round; Kaggle Overnight runs it on the compute you pick, measures it, keeps or rejects it with a reason, and offers you the better submissions. Unlike agents scored offline on MLE-bench, it never submits without your Approve & submit.
Does it keep my leaderboard score up to date with new public notebooks?+
Yes. Public notebooks are checked every hour, re-runs included, and ranked by the score their authors claim. Those claiming more than your best score are run first as rounds on your compute, and a better result is offered to you as a submission — one click on Approve & submit updates your leaderboard entry. Auto-run then keeps improving on top of them. It never submits on its own.
What is Kaggle Overnight?+
An open-source loop that keeps your Kaggle score current and then pushes it further while you sleep. It checks the competition’s public notebooks every hour and runs the best as rounds, then Claude Code, Cursor, an API model or a local Ollama model proposes improvements on top; ResearchForge routes it to the right compute, measures it against a frozen baseline, keeps or rejects it with a reason, and sends you a morning report.
Does it download competition data to my laptop?+
Only when the chosen compute is this machine and the data is allowed to be local. With Kaggle GPU, Colab, SSH or cloud compute the data stays on that machine, and the compute policy raises an error if anything tries to download it locally.
Do I need an API key?+
No. From Claude Code or Cursor, your editor’s AI proposes each experiment while the session is open. Turn on auto-run and headless Claude Code or the Cursor agent starts new rounds with no chat open, on the same plan. With an Anthropic, Gemini or OpenAI key, or a free local model through Ollama, it runs headless with no editor. In every mode the machine running the loop stays on — use an always-on server over SSH to free your laptop.
Will it submit to Kaggle without asking?+
Never. Submission candidates are offered according to your submission policy, and only you decide. ResearchForge records your decision; it does not press submit.
Can it keep experimenting with no chat open?+
Yes, with auto-run, which is off until you turn it on: researchforge kaggle auto-run <slug> --on. Each monitor cycle it starts rounds on untested ideas with headless Claude Code, the Cursor agent or your API key, within a daily limit and the Kaggle GPU cap. It waits while the loop is paused or a question is holding it, and it never submits.
Can I steer it while it runs?+
Yes: status, pause, resume, change compute, add your own idea, or answer a question the loop asked — from Claude Code (/overnight status, /overnight pause, …) or the CLI. A running round finishes; the change applies from the next one.
How do I install it?+
pip install researchforge. Then researchforge claude install --user and /overnight <url> in Claude Code, or researchforge cursor install --user and @overnight <url> in Cursor. Claude Code users can install the skills as a plugin instead: /plugin marketplace add forger-labs-hq/researchforge.
Can it run on a local model?+
Yes. Pull a model with Ollama, set RESEARCHFORGE_LLM=ollama/<model> (for example ollama/qwen3:14b), and run researchforge kaggle run <slug>. There is no API key, no token cost, and the prompts stay on your machine or your network.
How is it different from Karpathy’s autoresearch?+
autoresearch is a small loop in which an agent edits one training script and keeps the changes that improve validation loss on a single GPU. Kaggle Overnight applies the same keep-or-revert idea to a live Kaggle competition: it reads the competition and its public notebooks, runs each experiment on the compute you pick (this machine, Kaggle GPU, Colab, SSH or cloud), and records every rejected idea with its reason.
Is it like AIDE or the agents on MLE-bench?+
Those are research agents scored on offline copies of past Kaggle competitions. Kaggle Overnight works on live competitions, with your Kaggle account and your editor’s AI or your own model. It never submits without your approval, and it keeps a record you can check rather than a single final score.