Skip to content
AGI PROGRESS INTELLIGENCE

Footprints on the Road to AGI

Selected for You2,250

IdeaScientist: Orchestrating Agents for Grounded Scientific Ideation

IdeaScientist: Orchestrating Agents for Grounded Scientific Ideation

Most autoresearch systems couple idea generation with implementation, experiments, and writing, so it is unclear whether success comes from the idea or from downstream execution. IdeaScientist isolates research ideation as a standalone task: given a problem definition and a challenge that current solutions fail to meet, produce a grounded research proposal. An orchestrator coordinates three sub-agents - a gap finder that locates the shared methodological limitation in same-problem prior work, an innovator that retrieves mechanisms which solved an analogous challenge in other fields and adapts them, and a report writer that develops the surviving intuition into a complete proposal. Each role is trained separately with asynchronous GRPO and reference-grounded rubric rewards. The Svalbard Idea Vault decomposes 4.7M arXiv papers into 2.77M (problem, challenge, gap, intuition, proposal) tuples for retrieval, training, and temporally controlled evaluation with a January 1, 2026 cutoff and 277 held-out post-cutoff methodology papers. On Qwen3.6-27B, IdeaScientist reaches 74.6% overall, 14.0% above the strongest open-source autoresearch baseline, driven mainly by novelty, and beats Claude Code SDK with Claude-4.8-Opus by 5.9% and Codex SDK with GPT-5.4 by 5.1% on the same open backbone.

Paper · 2026-10-02
AnyScene Builds a Finished Blender Set From a Reference

AnyScene Builds a Finished Blender Set From a Reference

AnyScene uses one or more reference images and optional text to generate, place, light, and color-grade a complete Blender scene with separate assets.

Demo · 2026-10-31
Pika H3 Flex: synchronized video and audio in six steps, driven by up to 12 references

Pika H3 Flex: synchronized video and audio in six steps, driven by up to 12 references

An open adaptation of MiniMax-H3 for synchronized video and stereo audio, with endpoint-frame and up to 12 multimodal references, six joint evaluations, and explicit compute and licensing limits.

Open source · 2026-11-04
VoxCPM2: Tokenizer-Free Multilingual TTS with Voice Design and Cloning

VoxCPM2: Tokenizer-Free Multilingual TTS with Voice Design and Cloning

VoxCPM2 is OpenBMB's 2B-parameter speech generation model, built on MiniCPM-4 and operating in the continuous latent space of AudioVAE V2. A local encoder, text-semantic language model, residual acoustic language model and local diffusion transformer generate latent patches that decode natively to 48 kHz audio. The project supports multilingual synthesis, natural-language voice design, reference-audio cloning, continuation cloning with transcript and LoRA or full fine-tuning. This deep dive separates implementation facts from author-reported benchmarks and examines streaming deployment, voice consistency and misuse risk.

Open source · Exploring · 2026-10-31
VibeOffice: A Local-first Office Suite in the Browser

VibeOffice: A Local-first Office Suite in the Browser

VibeOffice runs three Office-style editors in the browser and writes real DOCX, XLSX and PPTX files locally. Its immutable OOXML baseline preserves untouched structures, macros and embedded objects; Scout is not yet generative AI, but the suite supplies a credible local execution layer for future office agents.

Open source · Exploring · 2026-11-02

Frontier papers

499
D&A: Decoupling Description and Assessment Enables VLMs as Zero-Shot Robotic Reward Models

D&A: Decoupling Description and Assessment Enables VLMs as Zero-Shot Robotic Reward Models

Vision-Language Models (VLMs) hold promise for zero-shot video task-progress estimation in robot learning, yet existing frameworks frequently suffer from confirmation bias, hallucinating progress in failed executions due to implicit success assumptions or relative temporal ranking designs. Naive prompting of frontier models collapses into a binary success detector that fails to capture nuanced, non-linear progress and failures. While post-training approaches can mitigate this through explicit training, they demand expensive real-world robotics data and require computationally intensive post-training for every individual base model. To resolve these limitations, we introduce D&A (Describe & Assess): our approach decouples progress estimation into an objective, task-grounded textual description of scene dynamics followed by an assessment phase using explicit rubrics. By compelling the VLM to synthesize an explicit, text-based definition of absolute success before scoring, the framework anchors evaluations to an external, global criterion rather than the video's internal timeline. Empirical results demonstrate that our method calibrates zero-shot estimates and mitigates confirmation bias, providing fine-grained, partial progress metrics that accurately penalize failed executions while correctly interpolating successful runs. Being purely prompt-based, D&A generalizes across tasks, embodiments, and benchmarks—matching or surpassing post-trained reward models—and its reward estimates enable efficient downstream reinforcement learning.

Marius Memmel, Shawn Yin, Urvi Rutia · 13 views · Nov 2, 2026
VLMRobot Reward Modeling
Nov 2, 2026
Democratizing Robot-Use Agents: A Unified Harness with Open Models
02Paper

Democratizing Robot-Use Agents: A Unified Harness with Open Models

Robot-use Agents (RUAs) have shown promising zero-shot manipulation capabilities, but reliance on frontier, proprietary models limits research into further training. To democratize RUA research, we introduce uni-robot-agent, a unified harness for competitive open-weight robot use that supports further training. Without privileged inputs, an out-of-the-box Qwen3.8-Flash-Next achieves a RoboDojo Score of 31.39, surpassing the published GPT-6 Astra-RoboProbe result of 28.97 and many VLA/WAM baselines, and performs competitively on 19 real-world tasks. Our analysis across model generations, families, and sizes links effective robot use to four general capabilities, suggesting that future RUA training should develop them jointly.

Jiarui Yuan, Yuxin Zuo
Real2Sem2Real: 3D Semantic Augmentations for Robot Learning from a Single Human RGB Demonstration
03Paper

Real2Sem2Real: 3D Semantic Augmentations for Robot Learning from a Single Human RGB Demonstration

Human video scales easily and does not need robot hardware, but existing methods require depth sensing, overlay the robot onto 2D video, or generate data only for the demonstrated objects. We present Real2Sem2Real (R2Sem2R), a real-to-semantic-to-real pipeline that turns one monocular RGB video of a human demonstration into thousands of robot demonstrations across the semantic object instances of a category. R2Sem2R tracks the SE(3) pose of each object with DINOv3-distilled Gaussian splats, outperforming existing methods and FoundationPose with estimated metric depth. R2Sem2R then aligns digital cousins, each generated from one or a few photographs, to the demonstrated objects with a semantic alignment. This alignment matches whole objects and the functional regions of target objects, such as a coffee machine's tray. R2Sem2R maps the human hand to a feasible robot grasp that extends to the cousins. Robot demonstrations are generated either in IsaacSim, for photorealistic rendering, or MuJoCo, for contact physics, and R2Sem2R can generate over 2,000 episodes in about two hours. On two real robots and four tasks, we train a vision-language-action policy on data from one human video per task, and policies trained on our data match or exceed policies trained on teleoperation across diverse object instances. The project page is available at https://real2sem2real.github.io/.

Matthew Strong, Ankush K. Dhawan
RoboFoundry: System-as-Policy Evolution for Self-Learning Embodied Agents
04Paper

RoboFoundry: System-as-Policy Evolution for Self-Learning Embodied Agents

RoboFoundry freezes the foundation model and treats the surrounding context, skill, and semantic-binding system as the evolving policy, allowing embodied agents to diagnose failures, validate persistent repairs, and transfer improvements across benchmarks and robots.

Jingsong Liang, Shuhao Liao

Foundation models: pre- and post-training, architecture and long context, inference serving and cost per token.

Harness

92

Agent runtimes: plugins and sandboxes, tool surfaces, skill systems, long-term memory and self-improvement.

AI Coding

104

Code generation, repair, refactoring, software engineering tasks

Skills

19
Developmentmattpocock/skillsFeatured

The 38 skills Matt Pocock uses every day for real engineering

Editor's takeSells parts, not a process: 38 SKILL.md behind a strict user/model-invoked contract, a SCOPE.md admission bar and a shared GLOSSARY.md; the spec-to-tickets-to-implement-spec pipeline is the most complete agentic engineering loop in this channel.

Daily-working set of the Total TypeScript author: 38 SKILL.md files (engineering 20, productivity 7, misc 4 frozen, in-progress 7) behind a user-invoked/model-invoked contract, a SCOPE.md admission bar and a shared GLOSSARY.md; installs as a Claude Code, Codex, Copilot or Gemini plugin, or an editable skills.sh copy.

Claude CodeCodexGemini CLI+2
claude plugin install mattpocock-skills@claude-plugins-official
Shellmattpocock289.9k
The 38 skills Matt Pocock uses every day for real engineering
Developmentobra/superpowersFeatured

Fifteen skills that give a coding agent a full development process

Editor's takeIts premise is that models lack process discipline, not coding ability. The single best idea to steal is 'Rulings, not stalls': decide by default, and stop for a human only when an action is irreversible, touches a security-sensitive surface, leaks outside the worktree, or the plan is already too broken to continue.

v6.4.1 (2026-09-18), MIT, 289k stars — the largest single skill repository of its kind. It chains brainstorming, spec writing, git-worktree isolation, planning, subagent execution, red-green TDD, two-way code review and verification-before-completion into one trunk workflow, and the README lists 16+ harnesses: Claude Code, Codex, Cursor, Gemini CLI, OpenCode, Kimi Code, Devin CLI and more.

Claude CodeCodexCursor
/plugin install superpowers@claude-plugins-official
Shellobra289.2k
Fifteen skills that give a coding agent a full development process
Official & Collectionsanthropics/skillsFeatured

The official repo from the format's author: 19 skills plus spec and template

Editor's takeIf you want to know how a SKILL.md is actually supposed to be written, read this instead of any second-hand tutorial. Two things to know first: docx, pdf, pptx and xlsx are source-available rather than open source (the other 15 are Apache-2.0), and the repo carries its own disclaimer — these skills are demos, so test them in your environment before trusting them with anything critical.

Anthropic's own implementation, 177k stars: 19 skills under ./skills plus ./spec (the Agent Skills specification, now at agentskills.io) and ./template as a scaffold. Its definition of a skill is folders of instructions, scripts and resources loaded dynamically, and progressive disclosure comes straight from here.

Claude Code
/plugin marketplace add anthropics/skills
Pythonanthropics177.3k
The official repo from the format's author: 19 skills plus spec and template
Design & Frontendnextlevelbuilder/ui-ux-pro-max-skillFeatured

Design knowledge as searchable local data: 79 styles, 192 palettes, 119 UX rules

Editor's takeIts sharpest self-description is that models can write CSS but lack a taste database. Ten rule categories are ordered by severity, with Accessibility and Touch & Interaction first as CRITICAL and Charts last — that ordering is the stance. The Design System Generator runs five parallel searches, and the repo states plainly: do not persist unverified output, so a generated design system has to be checked before it lands in your repo.

v2.13.0, MIT, 129k stars, site uupm.cc. Instead of lecturing the model it ships structured catalogues the agent queries before writing code: 79 UI styles, 192 palettes with reasoning, 74 type pairings, 119 UX rules, 105 icon suggestions, 17 GSAP presets, 25 chart types, 22 stacks and 34 landing-page patterns.

Any agent
npx ui-ux-pro-max-cli init --ai claude
Pythonnextlevelbuilder129.3k
Design knowledge as searchable local data: 79 styles, 192 palettes, 119 UX rules
KnowledgeGraphify-Labs/graphifyFeatured

Map the whole project into a queryable knowledge graph instead of grepping

Editor's takeThe design that matters most: every edge is labelled EXTRACTED or INFERRED, so you can tell what the source explicitly contains from what the tool inferred — which makes an agent's conclusions auditable, a hard requirement in production. It is not a vector index: no embeddings, no vector store, a real graph you can explain, path and query. In its own benchmark, building the graph costs zero LLM spend and ingest is an order of magnitude cheaper, a structural win from local parsing.

YC S26, Apache-2.0, 120k stars, Python 3.10+. /graphify . maps code, docs, PDFs, images and videos into a graph and emits a clickable graph.html, a human-readable GRAPH_REPORT.md and a machine-readable graph.json. Code goes through tree-sitter AST parsing (about 40 languages): deterministic, no LLM calls, nothing leaves the machine.

Claude CodeCodexCursor
uv tool install graphifyy && graphify install
PythonGraphify-Labs119.9k
Map the whole project into a queryable knowledge graph instead of grepping
Design & FrontendLeonxlnx/taste-skillFeatured

Taste Skill: 13 anti-slop frontend skills that turn AI tells into countable rules

Editor's takeThe lesson worth stealing is rules expressed as countable mechanical tests: eyebrow count ≤ ceil(sections/3), bento cells equal to content items, zero em-dashes on the page, palette families rotated across projects. Each one aims straight at the model repeating itself instead of stopping at an adjective. The repo is equally honest about its edges: v2 self-declares experimental and is still moving, §13 explicitly excludes dashboards, data tables, multi-step wizards, code editors and native mobile, and the only test in the repo guards the source-invocation semantics of the skill.sh shell helper rather than the design rules.

One MIT repo holding 13 skills: ten that output code and three that output reference images only, all installed into Claude Code / Codex / Cursor with a single npx skills add. The default design-taste-frontend v2 (experimental) is a 1,228-line SKILL.md: first the model must emit a one-line "design read", then it sets three dials (DESIGN_VARIANCE / MOTION_INTENSITY / VISUAL_DENSITY), then it implements against 14 chapters of hard rules - install the official package for corporate briefs, label aesthetic borrowings in comments, zero em-dashes anywhere on the page, eyebrow quota computed from section count, bento cells equal to content items, and finally a 50-plus box pre-flight check. The repo also ships research/laziness, a literature directory using controlled studies to explain why models cut output short.

Claude CodeCodexCursor
npx skills add https://github.com/Leonxlnx/taste-skill
JavaScriptLeonxlnx94.8k
Taste Skill: 13 anti-slop frontend skills that turn AI tells into countable rules

Leaderboard

481
Artificial Analysis Intelligence IndexOfficial intelligence index (higher is better)
Gemini 4 Carbon (high)60.03
Claude Opus 5.5 (max with fallback)59.11
Gemini 4 Carbon (medium)58.26
Claude Opus 5.5 (xhigh with fallback)57.44
GPT-6 Astra (max)56.85

Source · artificialanalysis.aiofficial Intelligence Index v5synced Nov 4, 2026

Image Generation

64

Text-to-image, image editing, consistency and controllability

Audio & Video

165

Video and speech/audio: physical and temporal coherence for text/image-to-video, TTS and voice cloning, music generation and ASR.

3D & World Models

371

3D asset generation, scene reconstruction, long-horizon world prediction

Design & Frontend

83

Visual design, UI components, web and slide layout

Docs & Slides

19

Slides, Word, Excel, PDF generation and editing

Blog

109

Agent Studio

7

RetouchPi

Fifty-four professional tools, layers and masks, PSD files that open and save back - all in the browser, nothing to install.

retouchpi.com · 54 pro tools · PSD read and write · AI generate & edit

ThreeDream simulation engine

Built for games and for physical AI: an ultra-realistic, ultra-high-performance simulation environment with ultra-low-cost procedural data; Unreal-grade visuals open and play in the browser, bridging the physical world and intelligent agents.

Games meet physical AI · Unreal-grade on the web · Open and play

CodeWaifu, your caring coding desktop sprite

A caring coding sprite on your desktop and a cockpit that never stops: the work resumes itself after a crash or a reboot. Every coding terminal, ssh session and local shell in one tree, every start, finish and permission request reported in time. Open source, one-line install.

Your caring coding desktop sprite · Resumes after crash & reboot · First-rate terminal / ssh / shell

Agent digital twin office

A 100 km 3D city that opens in seconds — crawling, blogs, papers, industry and investment analysis, all watchable in one digital twin.

100km city · opens in seconds · Live task stream · Agent-maintained

Robotic arm workbench

An SO-101 6-DoF arm running MuJoCo physics in your browser: joint teleoperation, IK end-effector dragging and gripper pick-and-place into a basket. No install.

MuJoCo WASM physics · SO-101 · 6 DoF · Contacts / telemetry HUD

Joint actuator anatomy lab

Take a humanoid joint module apart layer by layer: brushless motor, magnetic encoder, planetary / harmonic / cycloidal drive and output flange. Switch architectures on one page — exploded view plus analytic kinematics.

Three gearbox types · Planetary / harmonic / cycloidal · Analytic kinematics · explode

AI Games

5

Under constructionThe games system is still under construction — everything listed starts in-page, and the library keeps growing.

ThreeDream FPS arena

ThreeDream FPS arena

A first-person match where every bot across from you is driven live by a policy this repo trained, the whole round stepping at a fixed 60 Hz: builtin, Rust/wasm or Rapier behind one physics interface, nothing scripted.

WASD move · mouse look · left-click fire · shift sprint · R reload · esc release

ThreeDream UE level

ThreeDream UE level

Unreal 5.5's first-person test map, running same-origin in the browser: the level, the materials, the lights and four weapon data assets are read out of the project's own .umap / .uasset bytes, six soldiers are driven by a four-state brain on one fixed 60 Hz step, and the sidebar lists every substitution the page had to make.

WASD move · mouse look · left-click fire · shift sprint · space jump · R reload · F pick up · esc release

ThreeDream CARLA town drive

ThreeDream CARLA town drive

The whole of CARLA Town10HD read out of its .umap and OpenDRIVE road bytes, 4,474 actors back on the project's own coordinates; 32 cars decide live over the same lane graph - car-following, braking, lane changes - and you sit in one of them, on the wheel or on autopilot.

W throttle · S brake · A D steer · space handbrake · T autopilot · C camera

ThreeDream factory town

ThreeDream factory town

The abandoned-factory town's bytes come from two places: 3,571 actors and a 509x509 landscape heightfield read out of the Unreal project's own mainmap.umap, 3,283 meshes resolved through an unlicensed content pack pinned by revision on its own mirror; six soldiers run live on a four-state patrol / engage / advance / down brain over one fixed 60 Hz step, standing at random walkable spots wave by wave and getting back up elsewhere once downed, with four guns on the ground each wave to swap for with F and a kill quota that opens the next one (?arena=0 gives the same town back without rounds); and the sidebar lists the 101 placements still missing their mesh instead of hiding the holes.

WASD move · mouse look · left-click fire · shift sprint · space jump · R reload · F pick up · esc release

ThreeDream Solis Reach

ThreeDream Solis Reach

A whole mirror-salt solar city generated at runtime: 4,570 built pieces, 3,197 hillside homes, 71 heliostats and a three-ring armillary surround one live sea; 11 salt skiffs query the same heightfield that is drawn every frame, and orbit or fly cameras let you cross the scene - this is not a pre-baked tour.

drag orbit · wheel zoom · WASD fly · E Q up/down · shift boost · mouse look

Frequently asked

What is this site?
An AGI progress digest: paper deep reads, open-source projects, demo videos and leaderboards across models, agents and runtimes, skills, multimodal and embodied AI.
Where does the content come from?
Public sources: arXiv papers, official releases and blogs, GitHub repositories, demos on X and YouTube, and evaluators' own leaderboards. Every entry keeps its source link and author credit.
Are the paper and project write-ups summaries?
No. Papers are written up from the full text as bilingual long reads with formulas, experiment tables and method diagrams; open-source projects are read through their README and source before a bilingual write-up with a hands-on verdict.
Where do the leaderboards come from?
From each evaluator's own official board, synced on a schedule, with scrape and official-update timestamps shown.
Can I cite this site?
Yes — cite the canonical URL each page declares. Third-party papers, videos and images remain the copyright of their original authors.

As an Amazon Associate, we earn from qualifying purchases.