A proposed ICLR 2027 workshop

AI4Research

Autonomous research and recursive self-improvement across AI4AI and AI4Science — grounded in verification, evaluation integrity, and safety.

ICLR 2027 Workshop April 2027 Location TBA One day · in person ● proposal under preparation
$ ./ai4research --venue iclr-2027
methods: autonomous research × recursive self-improvement
domains: AI4AI × AI4Science  [verified ✓ safe ✓]
$

00 · News

News

01 · About

From autonomous research to systems that improve the next research cycle.

Research agents are beginning to carry out increasingly complete loops: reading the literature, forming hypotheses, designing and running experiments, interpreting results, and communicating findings. Those loops now appear both in AI4AI — improving models, data, algorithms, and computing systems — and in AI4Science, from mathematics and materials to biology, chemistry, and physics.

Autonomy alone is not recursive self-improvement. The stronger claim begins when a system's discoveries improve the models, tools, evaluators, or research strategies used in its own future cycles, and when those gains persist rather than disappear under new tasks or stronger controls. AI4Research puts both questions in one program: how much of research can be made autonomous, and when does that autonomy produce cumulative improvement?

Our intellectual spine is verification. AI4AI often offers executable feedback such as unit tests, benchmark scores, and wall-clock measurements; AI4Science adds simulators, theorem checkers, instruments, and experimental evidence. Across both domains, evaluation integrity must remain a first-class research topic: results need provenance, contamination controls, human-effort accounting, reproducibility, and defenses against reward hacking.

AI4Research connects communities that are often discussed separately. Autonomous-research work asks how agents conduct discovery; recursive-self-improvement work asks whether improvements compound. AI4AI and AI4Science provide complementary proving grounds for both. The workshop focuses on the shared methods, evidence standards, infrastructure, and safety boundaries that let progress transfer across all four.

Methods axis

Autonomous Research ↔ RSI

From agents that execute a research loop to systems whose results measurably improve later loops.

Domains axis

AI4AI ↔ AI4Science

From models and ML infrastructure to scientific reasoning, simulation, and experiment-grounded discovery.

02 · Topics

Topics of Interest

We invite submissions including, but not limited to, the following areas.

topic/01Autonomous research agents

Systems that read literature, form hypotheses, design and run experiments, interpret evidence, and communicate findings; architectures, workflows, and failure analyses.

topic/02AI4AI & automated ML engineering

Agents for data, model design, training and post-training, debugging, AutoML, GPU kernels, compilers, serving systems, and the broader ML stack.

topic/03AI4Science & scientific discovery

Research agents for mathematics, physics, chemistry, biology, medicine, materials, and climate; simulation, theorem proving, lab workflows, and experiment-grounded discovery.

topic/04Recursive self-improvement

Self-referential agents, automated system design, open-ended evolution, and empirical tests of whether improvements persist, transfer, compound, or plateau.

topic/05Benchmarks & environments

Tasks, environments, and metrics for ideation, experimentation, replication, engineering, and scientific discovery; contamination-resistant and long-horizon design.

topic/06Evaluation integrity & reward hacking

Specification gaming, benchmark exploits, evaluator attacks, and hardened harnesses, co-evolving evaluators, execution-based verification, and evidence provenance.

topic/07Harness & scaffold engineering

Prompt and program optimization, workflow and topology search, tool use, memory, test-time-compute scaffolds, and self-modifying research harnesses.

topic/08Automated evaluation & peer review

Evaluation of research artifacts, LLM-as-judge, automated reviewing and meta-reviewing, replication agents, and evaluating the evaluators.

topic/09Measurement & forecasting

Autonomy levels, time-horizon and uplift studies, human-comparison methodology, compute and human-effort accounting, and economics of AI-assisted research.

topic/10Safety, security & governance

Risk thresholds, oversight of self-improving systems, dual-use scientific capabilities, secure experiment execution, and policy for AI-authored research.

topic/11Human–AI collaborative research

Division of labor, trust calibration, research taste, attribution and authorship, accessibility, and keeping humans meaningfully in the loop.

topic/12Open research infrastructure

Open-source agent frameworks, compute and laboratory environments, shared run archives, interoperable tools, and reproducibility standards for agent-conducted research.

03 · Call for Papers

Call for Papers

The CFP below is tentative and becomes official upon workshop acceptance by ICLR 2027.

Full Papers

  • Up to 8 pages, excluding references and appendices
  • ICLR 2027 style files, double-blind
  • Novel research, benchmarks, systems, and analyses
  • Agent-conducted empirical results must ship verifiable artifacts (code, logs, or execution transcripts)

Tiny Papers

  • Up to 4 pages, including references
  • Early results, position statements, negative results, reproductions
  • Designed as an on-ramp for first-time and student authors — with its own on-stage lightning session (6 × 5 min)
  • Primarily human-authored, per ICLR policy — no AI-generated papers in this track

Review & Policies

  • Double-blind review on OpenReview; at least three reviews per submission
  • Non-archival: submission elsewhere afterwards is welcome; dual submission policy stated at CFP release
  • AI-involvement disclosure is mandatory for every submission (systems used, and for what)
  • No fully AI-generated submissions in either track; undisclosed AI generation, fabricated results, or reviewer-targeted prompt injection means desk rejection
  • Best Paper and Best Tiny Paper awards
status: Submissions open upon workshop acceptance (expected December 2026). The OpenReview link will be posted here — no submission system is live yet.

04 · Important Dates

Important Dates

All deadlines are 11:59 pm Anywhere on Earth (AOE) and tentative until the ICLR 2027 workshop decisions are announced.

05 · Schedule

Tentative Schedule

Tentative schedule — times in local venue time; final program posted after author notifications. Highlighted rows: keynotes, the dedicated safety session, and the panel. Contributed slots: six full-paper orals, six tiny-paper lightning talks, and two poster sessions covering all accepted papers.
TimeSessionDurationDetails
9:00 – 9:10Opening remarks10 minOrganizers
9:10 – 9:50Keynote 1 — End-to-end research agents40 minInvited talk + Q&A
9:50 – 10:35Contributed talks I45 min3 × 15 min oral presentations
10:35 – 11:05Coffee break & posters30 minPoster session I
11:05 – 11:45Keynote 2 — AI4AI: models, systems & infrastructure40 minInvited talk + Q&A
11:45 – 12:15Tiny-paper lightning talks30 min6 × 5 min — the on-ramp track, on stage
12:15 – 13:30Lunch break75 min—
13:30 – 14:10Keynote 3 — AI4Science: verified scientific discovery40 minInvited talk + Q&A
14:10 – 15:00Safety session — risks of recursive self-improvement50 minInvited talk + moderated discussion: RSI risk thresholds, evaluation integrity under self-modification, dual-use discovery, and oversight
15:00 – 15:45Poster session II & coffee45 minAll accepted papers
15:45 – 16:30Contributed talks II45 min3 × 15 min oral presentations
16:30 – 17:20Panel — “Who is doing the research?”50 minPanelists + moderator, audience Q&A
17:20 – 17:30Closing remarks & awards10 minBest Paper and Best Tiny Paper announcements

06 · Speakers

Invited Speakers

Yilun Du and Zifan Wang are confirmed. The remaining names are prospective invitees, clearly labeled below. The final program features three keynotes, one safety-session speaker, and four to five panelists drawn from the confirmed roster. No organizer will speak at the workshop.

YD
Harvard University · Kempner Institute
Assistant Professor of Computer Science; generative modeling, robotics, and multi-agent systems.
confirmed
ZW
Meta Superintelligence Labs · London
Research Scientist working on safety, robustness, and alignment.
confirmed
JC
Jeff Clune
University of British Columbia · Vector · Recursive
Senior author of The AI Scientist and ADAS; pioneer of AI-generating algorithms.
to be invited
DH
David Ha
Sakana AI
Co-founder & CEO of the lab behind The AI Scientist v1/v2 — the first AI-generated paper to pass peer review.
to be invited
AM
Azalia Mirhoseini
Stanford University
KernelBench senior author; AlphaChip; self-improving AI systems.
to be invited
BB
Beth Barnes
METR
Founder & CEO; built the field of frontier AI-R&D evaluation — RE-Bench and the time-horizon line.
to be invited
MB
Matej Balog
Google DeepMind
Co-lead of AlphaEvolve and FunSearch — the flagship AI-improving-AI-infrastructure results.
to be invited
TP
Tejal Patwardhan
OpenAI
Leads frontier evaluations; co-author of MLE-bench and PaperBench.
to be invited
RL
Robert Tjarko Lange
Sakana AI
Corresponding author of The AI Scientist-v2; evolutionary meta-learning for automated discovery.
to be invited
CL
Cong Lu
Recursive
Co-first author of The AI Scientist; self-improving AI for open-ended discovery.
to be invited
CL
Chris Lu
OpenAI
Co-first author of The AI Scientist; automating discovery via meta-learning.
to be invited
SH
Shengran Hu
University of British Columbia
First author of Automated Design of Agentic Systems (ADAS, ICLR 2025).
to be invited
AO
Anne Ouyang
Stanford University / Standard Kernel
KernelBench co-lead (Best Paper, DL4C @ ICLR 2025); automated GPU-kernel generation.
to be invited
OP
Ofir Press
Meta
Co-creator of SWE-bench and SWE-agent — the evaluation backbone of agentic coding.
to be invited
JY
John Yang
Stanford University
Lead author of SWE-bench, SWE-agent, and SWE-smith.
to be invited
NP
Neev Parikh
METR
RE-Bench (ICML spotlight) — the canonical human-calibrated AI-R&D-automation evaluation.
to be invited

07 · Panel

Panel — “Who Is Doing the Research?”

A 50-minute moderated discussion with four to five panelists drawn from the confirmed speaker roster, balancing capabilities, systems, evaluation, and safety perspectives. Moderated by an organizer. Candidate questions:

  1. Across AI4AI and AI4Science, where is the current frontier between “AI as research tool” and “AI as researcher” — and what is the real bottleneck: ideas, engineering, experiments, compute, or taste?
  2. Research agents have exploited benchmark harnesses and reward signals. Can evaluation stay trustworthy as agents get better at gaming it — or must evaluators, instruments, and verification protocols co-evolve with the agents?
  3. How should we compare autonomy in executable ML engineering with autonomy in science, where simulation, theorem proving, and physical experiments offer very different kinds of evidence?
  4. Is scaffold/prompt-space optimization (ADAS, GEPA, Darwin Gödel Machine) a fundamentally different — perhaps safer, more auditable — substrate for self-improvement than weight-space RL? Will the two converge?
  5. AI-authored papers have passed review at a main conference and appeared in Nature. Should venues admit AI-authored submissions — and under what disclosure, verification, and volume-control rules?
  6. If automated AI and scientific R&D create faster feedback loops, which measurements — horizon curves, uplift studies, replication rates, or RSI signals — should trigger which responses, and who is responsible for running them?

08 · Organizers

Organizers

YZ
Yuxuan Zhang
PhD student, University of British Columbia
Agentic AI, reinforcement learning, and benchmarks for research agents — creator of ClawBench and RewardHarness. Lead organizer.

Co-organizers to be announced

The organizing team is being assembled ahead of the ICLR 2027 proposal deadline, targeting diversity of affiliation, seniority, geography, and viewpoint. Profiles being recruited:

  • Senior researcher in autonomous research or automated ML engineering
  • Faculty in AI4Science or experiment-grounded scientific agents
  • Researcher at an independent evaluation organization
  • Faculty or senior researcher in agent scaffolding and automated agent design
  • Senior AI-safety researcher focused on self-improving systems

Interested in co-organizing or reviewing? Get in touch via the contact address below.

09 · FAQ

Frequently Asked Questions

Is the workshop confirmed to take place at ICLR 2027?
Not yet. AI4Research is a workshop proposal under preparation. The ICLR 2027 Call for Workshops is expected in fall 2026 (proposal deadline around October 2026), with decisions expected in December 2026. This site is published early for transparency toward invited speakers, prospective co-organizers, and authors; everything labeled “tentative” becomes official only upon acceptance.
Can I use AI assistance in my submission — and can an AI system be an author?
AI assistance is welcome, and disclosure is mandatory: every submission must include an AI-involvement statement (which systems, used for what). Tiny papers must be primarily human-authored, per ICLR policy. Full papers may report agent-conducted research, but a human author must vouch for correctness, and agent-produced empirical results must include verifiable artifacts (code, logs, or execution transcripts). Fully AI-generated submissions are not accepted in either track for 2027. Undisclosed AI generation, fabricated results, or prompt-injection content aimed at reviewers is grounds for desk rejection.
Are workshop papers archival? Can I later submit my work to a conference?
The workshop is non-archival. Accepted papers will be posted on this website (with author consent) but do not count as prior publication, and you are free — encouraged, even — to extend and submit your work to ICLR, NeurIPS, ICML, or elsewhere. Work already published at an ML conference should not be the primary content of a submission.
Can I attend virtually?
ICLR 2027 workshops are in-person events. For virtual access we will maintain this website with all accepted papers and posters, post speaker-consented talk recordings after the workshop, and publish a post-workshop summary including panel and safety-session notes. Authors facing exceptional circumstances (e.g., visa denials) may present via proxy or pre-recorded video.
How does AI4Research connect AutoResearch, RSI, AI4AI, and AI4Science?
They form two complementary axes. Autonomous Research ↔ Recursive Self-Improvement describes what the system does: from executing a research loop to using its results to improve later loops. AI4AI ↔ AI4Science describes where that loop operates: on AI models and infrastructure, or on scientific questions and experiments. AI4Research focuses on the shared problems at their intersections — verification, evaluation integrity, reproducibility, cumulative improvement, human oversight, and safety — while retaining dedicated space for each community.
How can I get involved before the workshop is accepted?
Two ways: (1) join the program committee — reviewers across research agents, benchmarks, ML systems, and safety will be recruited via an open call once the workshop is accepted; (2) co-organize — see the profiles above. In both cases, email the contact address below with a short note and a link to your work.