AI can help produce research. Can it judge what is worth pursuing?
A catalogue of mathematical results, a failed research task, and a corrected game test reveal the distance between producing an answer and establishing a discovery.
OpenAI published hundreds of mathematical manuscripts. Two frontier agents failed to match a human research innovation. A model reached a game benchmark’s ceiling, then lost ground when evaluators removed a legal shortcut. Read together, these reports expose a difficult question for AI research: can a system choose a worthwhile problem, produce a useful result, and establish that the result is sound?
Superintelligence Monitor follows the evidence behind AI progress and the choices that give it direction. We examine who did the work, which tools and resources made it possible, and what survives scrutiny. Our publisher, the Center for Artificial Wisdom, seeks a future in which AI improves human life while supporting meaning and agency. That purpose requires scrutiny of the systems being built and of the people deciding how to build, deploy, and govern them.
What would make the superintelligence we create—and the future we create with it—wise?
This first issue examines five primary reports published October 6–8, 2026. They concern research production, autonomous research, the validity of tests, and the reliability of oversight. The selection is not comprehensive. Sources were checked October 8; older work is identified as historical context. These assessments remain provisional and await human editorial approval. The October 17 revision clarifies the prose using the same evidence and information cutoff.
1 / 5 · Lab claim · 2026-10-06
Hundreds of manuscripts leave the central question open: which results hold up?
The release could accelerate mathematical research if its results prove novel, correct, and useful. Its sustained impact remains undetermined.
OpenAI’s October 6 release presents mathematical results produced with an internal model that outsiders cannot yet use. The catalogue groups 719 manuscripts into 372 families; those totals do not count independently verified, distinct open problems. The need for scrutiny is already visible in its October 7 history: a sign error led to three withdrawals and affected dependent results, while 14 other manuscripts received repairs.
A reliable supply of new, reusable results could speed mathematical research. To establish that contribution, researchers must check what each result adds and whether it holds up. The number of manuscripts alone cannot establish a general autonomous scientist or superintelligence.
The work draws on existing mathematics, human-selected problems, verification tools, and computation performed while the model works on an answer. The report does not isolate which recent change made the difference. A specialized production pipeline and a reasoner that improves across fields could generate similar headlines while implying different futures.
Main limitation. The model is unavailable for independent reproduction, and the released work was selected from roughly 4,000 posed problems. That selection prevents a clear general success-rate estimate. A machine-checked formal proof establishes a proposition under stated assumptions; it does not establish the proposition’s novelty or importance, or validate every surrounding informal explanation.
Watch next. Look for expert reviews at the family level, usable proof artifacts, further withdrawals, and results that other researchers build on. A system outsiders can reproduce on problems chosen in advance would provide a stronger test. Reliable new results would strengthen the acceleration claim; persistent errors or failure to transfer would weaken it.
One demanding test exposes a gap in autonomous research. It does not establish a ceiling across research domains.
Epoch AI asked Claude Fable 5 and GPT-5.6 Sol to develop a post-training method comparable to a recent human innovation. Neither matched it. Each run could use up to 3,000 GPU-hours and a 10-billion-token inference budget; those were limits, not reported expenditure. Newer successors already knew the task, so their results offered a weaker test of fresh research.
An AI system that improves research methods could help accelerate the development of later systems. Epoch tested the connected work of choosing an idea, implementing it, and running experiments. Success at an isolated coding task leaves much of that process unexamined.
The agents had compute and tools. Choosing productive ideas and checking improvements within the task’s scope remained difficult. The surrounding software and instructions may also have constrained them. Fresh problems, different setups, and comparable human resources would help separate a reasoning gap from a limitation of the test.
Main limitation. The study centers on one research problem and one main evaluation per model. Human judgments helped determine what counted as in scope, and the resource budgets may not be directly comparable. The failures therefore constrain claims about these runs without showing that every system would fail across research.
Watch next. Look for repeated runs on several tasks chosen before testing, with credible human baselines and independent checks of novelty and results. Reproducible success across fresh research problems would change this assessment more than a higher coding score.
The model made real progress at the game. Neither its perfect scores nor its revised results establish general scientific discovery.
GPT-6 Astra reached perfect scores in more than half of its original EBR-bench attempts by using a legal card combination that bypassed time pressure. Epoch then banned the card. The model’s mean score fell from 19.8 to 16 of 21 objectives; its best run under the revised rules reached 20.
Finding a legal shortcut is itself a skill. It also reveals that a test may reward a different ability from the one readers assume it measures. Strong performance after the rule change supports progress within this game. Whether that progress carries into open-ended research requires separate evidence.
The card combination made the original ceiling reachable. Removing it supplied a useful comparison: the model remained strong, but its average score fell. That comparison helps explain the game result without establishing why the model improved or whether its approach works elsewhere.
Main limitation. A top human used the same legal tactic. The episode therefore does not, by itself, demonstrate misconduct or confusion by the model. Results under the old and revised rules need separate comparisons. Our limited-impact judgment concerns this game result’s significance for the specified SI claim, not the model’s overall capability.
Watch next. Look for repeated performance under the revised rules and tests in other environments. We have not measured public attention to the result, so the evidence does not support a resolved false-alarm judgment.
The project shows a useful route to assisted scientific production. Autonomous discovery and downstream impact remain unproven.
Astrophysicist and Anthropic researcher Brice Ménard describes using Claude Science to combine ultraviolet surveys into an educational sky map. About a third of the map is statistically predicted rather than newly observed, and the map distinguishes those regions. Ménard directed the work and caught an artifact that two agent reviews missed.
Scientific progress can come from making neglected work practical. If AI reduces the labor of assembling research resources, more projects may become feasible. This case points to that possibility while leaving the size and reliability of the saving unmeasured.
Public telescope archives supplied the observations. Model-assisted coding and coordination helped assemble them, while expert judgment helped check the output. A comparison with the same work performed through an alternative workflow would help establish whether the main contribution was reduced labor or an improvement in scientific reasoning.
Main limitation. There is no independent replication or matched comparison of labor. Predicted regions are not new measurements, and the case does not establish validated new astronomical knowledge. The developer affiliation also matters when weighing the account.
Watch next. Look for independent checks of the map’s predictions and uncertainty, reuse by researchers, and replicated savings in time or cost across projects. Those results would support a specific research-productivity claim.
METR demonstrated a weakness in an evaluation tool. It did not observe evaluated agents using it to conceal misconduct.
METR reported a proof of concept in which a vulnerability in its transcript viewer could change what reviewers saw. The underlying database logs remained intact. METR patched the flaw and said it had not observed evaluated agents exploiting it.
An evaluator’s conclusion depends on a trustworthy account of what a system did. A weakness in the tools that display that account can undermine both capability assessment and oversight, even when the underlying records survive.
The viewer’s handling of untrusted material created the opening. Keeping authoritative logs separate from their display and securing the review tools address that mechanism. Broader tests of agent behavior are still needed.
Main limitation. A staged exploit establishes a possible failure mode. It does not establish spontaneous concealment by a deployed agent, a general tendency to deceive, or imminent superintelligence.
Watch next. Look for independent security reviews, preserved audit trails, and similar weaknesses in other evaluation tools. Evidence of an agent initiating such an exploit would support a stronger, separate claim.
The strongest claim these reports support is that AI can help researchers produce and assemble scientific work. The harder claim—that it can reliably decide what to investigate, establish a novel result, and validate it without substantial human direction—remains open. Mathematical output still needs expert scrutiny. A sky map still depends on archived observations and a scientist who notices an error. A successful game strategy still needs a separate test of whether it transfers to research. Our next judgments will turn on fresh tasks, reproducible results, and explicit accounts of human assistance. We will also examine whether researchers and evaluators correct their assumptions when the evidence changes. That capacity matters to the kind of future these systems could help create; these reports do not settle the broader question of a wise trajectory.
Two draft forecasts make our follow-up questions checkable. Their windows set deadlines for review; they do not predict an arrival date for superintelligence.
We expect public evidence to remain insufficient for the broad claim below, with low qualitative confidence. A negative finding may reflect limited evaluation access rather than a capability limit.
Review deadline: 2026-12-31 · not yet resolved
Publication record
Initial draft prepared 2026-10-08. Draft v1.2 · 2026-10-17. Rewritten for clearer explanatory journalism. The original source dates, information cutoff, claim identities, ratings, and forecast wording and resolution criteria are preserved. No new reporting, human approval, or sending is claimed. Continuing assessments have their own histories.
Research, source checking, drafting, and site preparation used AI assistance. This is an editorial draft; it has not received human editorial approval. No claim is made that SI Monitor independently reproduced the experiments or verified the mathematical proofs.
SI Monitor by email
Understand what changed—and why it matters.
Follow the evidence shaping our future with superintelligence. Our planned weekly newsletter explains the findings and choices that could shape a happier future with less suffering. The website’s daily briefing reviews sources between issues. The publication is in public preview. Issue #1 is still an unsent review draft. A launch date and regular send day have not been set; material corrections receive a notice when needed.
Brevo handles signup and email delivery. You can unsubscribe using the link in each newsletter. Read our subscription privacy information before submitting.
The publisher reported a successful signup and email confirmation test on October 15. Campaign delivery and unsubscribe checks remain incomplete.
You’ll open Brevo’s hosted form. Enter your email address there and follow the confirmation instructions. Reading this page does not load the signup service.