Skip to content
AGI PROGRESS INTELLIGENCE

Footprints on the Road to AGI

Selected for You2,013

VideoJev: A System One Model for Video Understanding and Interaction

VideoJev: A System One Model for Video Understanding and Interaction

VideoJev casts video understanding and interaction as structured decision tasks: a shared head scores temporal intervals and textual options against video evidence, unifying temporal grounding and multiple-choice video QA so agents can act on timely decisions.

Demo · 2026-10-14
Into the LidarVerse: A Real-Time Unified LiDAR World Model Across Tasks and Sensors

Into the LidarVerse: A Real-Time Unified LiDAR World Model Across Tasks and Sensors

We present LidarVerse, a real-time unified LiDAR world model for sensor simulation across tasks and sensors. Existing LiDAR simulators largely follow one of two complementary paradigms: reconstruction-based methods preserve the geometry of a captured scene but require lengthy per-scene optimization, whereas generative methods amortize learning across data but lack the consistency needed for long-horizon rollouts. LidarVerse brings both paradigms into a single, unified conditional generative framework. A universal tokenizer maps LiDAR range sequences into a shared latent space, where a bidirectional teacher learns a common interface for conditioning on a LiDAR prefix, an HD-Map, a persistent spatial cache, and optionally, text. Varying the available scene evidence turns the same model into a generator of new worlds, a point-cloud forecaster, or a generalizable resimulator of observed scenes without per-scene optimization. We distill the teacher into a four-step autoregressive causal student and maintain both a rolling temporal K/V cache and a world-aligned spatial cache, enabling persistent long-horizon rollouts with real-time inference at 11 FPS on a single H100 GPU. LidarVerse achieves state-of-the-art performance on most reported metrics across all three evaluation protocols, while its tokenizer supports 32-, 64-, and 128-beam LiDAR and generalizes to an unseen scanning pattern. These results demonstrate that generative and reconstruction-grounded LiDAR simulation can be realized within one model, providing the core capabilities for future closed-loop sensor simulation.

Paper · 2026-10-13
Hallmark: Design Guardrails for Coding Agents

Hallmark: Design Guardrails for Coding Agents

Hallmark gives coding agents a design workflow with real material, browser checks, and wiring-preserving redesigns.

Open source · 2026-10-26
Twenty: The Open-Source Salesforce Alternative, Designed for AI

Twenty: The Open-Source Salesforce Alternative, Designed for AI

The 59k-star open-source CRM where objects, views, workflows and agents are TypeScript packages you build, ship and version; an in-CRM chatbot reads your records, autonomous agents run inside workflows, and official agent skills let coding agents build CRM apps.

Open source · Exploring · 2026-10-22
dsh-context: turning DeepSeek Harness context into an auditable ledger

dsh-context: turning DeepSeek Harness context into an auditable ledger

A DeepSeek Harness plugin for context insight and management: five surfaces cover the cross-session overview, per-session composition/trend/events/file activity and the subagent fleet; the host folds the V4 durable event log into a per-request composition timeline, meters parity-verified against the runtime own projections, and probes a per-tag compatibility matrix against real harness sources.

Open source · Exploring · 2026-10-21

Frontier papers

453
FAR: Failure-Aware Retry for Test-Time Recovery and Continual Policy Improvement

FAR: Failure-Aware Retry for Test-Time Recovery and Continual Policy Improvement

Robot policies trained on offline demonstrations fail inevitably at deployment, and naive retries repeat the same mistake because failure states are out of distribution for the pretrained policy. FAR (Failure-Aware Retry) keeps the scene after a failure, returns the arm to its start pose, and retries: an IQL-style conservative critic attributes the failure to the action chunks whose value drop falls in the lowest percentile, candidate chunks sampled from the current policy are distance-filtered and critic-ranked into top-K positives, and a diffusion preference-optimization loss updates the policy for only 10 gradient steps (1.5-3 s on a single A5000) while temporally smoothed Gaussian perturbations add local exploration during retries. Successful recovery trajectories then feed an advantage-weighted denoising objective for continual policy improvement. Across nine ManiSkill, RoboSuite and RoboMimic tasks FAR beats standard diffusion policy by 17.6 points on average, and on three xArm real-world tasks by 11.7 points (80.0% vs 68.3%), while cutting the environment resets that online learning needs.

Haoran Hao, Shahram Najam Syed, Jeffrey Ichnowski · 9 views · Jul 1, 2026
Failure RecoveryTest-Time Adaptation
Jul 1, 2026
UniAction: Unified Action Conditioning for World Models
02Paper

UniAction: Unified Action Conditioning for World Models

Actions that condition world models are highly heterogeneous, and thus existing action-conditioned world models are typically built for individual action types, fragmenting already limited action-annotated data across separate models. We introduce UniAction, a unified action-conditioning framework that represents any action as a sparse set of action elements, each with a discrete semantic identity and a continuous spatiotemporal grounding coordinate. By mapping these coordinates directly into the pretrained video model's native positional space, UniAction allows heterogeneous actions to condition a shared world model within the same spatiotemporal structure. We further introduce cardinality-calibrated attention to address the bias from differing action representation granularities. We evaluate UniAction on four representative action forms: force, camera control, hand pose, and robot pose. UniAction outperforms conditioning alternatives in action following, and a single jointly trained model surpasses the action-specific experts, showing that heterogeneous action data benefit from unified model and joint training.

Bowen Xue, Zizhang Li
Depth Anything V4: Dynamic 4D Scene Reconstruction via Riemannian Flow Matching on 4D Gaussian Splatting
03Paper

Depth Anything V4: Dynamic 4D Scene Reconstruction via Riemannian Flow Matching on 4D Gaussian Splatting

WITHDRAWN / archival entry: arXiv marks this paper as withdrawn by its authors (v2, 20 Aug 2026, 1 KB record, comment: “Major errors in research”); it is kept here for critical reading only. The paper itself proposes Depth Anything V4 (DAV4), dynamic 4D scene reconstruction from monocular video by defining Riemannian Flow Matching (RFM) directly on the non-Euclidean manifolds of 4D Gaussian Splatting parameters (scale, rotation, opacity), so every intermediate state on the probability path remains valid without post-hoc projection. A deterministic MLP baseline sharing the same data, architecture and test-time optimization (TTO) protocol isolates the contribution: MLP+TTO scores 0.762 F-score versus 0.806 for RFM+TTO, a +0.044 isolated gain, while Euclidean flow matching with projection reaches only 0.684 with 12.3% invalid Gaussians. Pre-training costs 360 GPU-hours and amortizes only beyond roughly 10,000 scenes; uncertainty is quantified via negative Gaussian log-likelihood and expected calibration error; no human-annotated depth labels are used as training losses.

Jiaming Fan, Jian Lu
RynnUnify: Towards Unified Embodied Brain
04Paper

RynnUnify: Towards Unified Embodied Brain

We introduce RynnUnify, a 16B unified embodied model that combines strong embodied understanding with long-horizon visual planning through interleaved video–language reasoning. With capabilities spanning spatial reasoning, physical prediction, and grounding, RynnUnify connects an understanding of the physical world with visual anticipation of how it evolves across successive subtasks. Building on these capabilities, we further develop an agentic extension through reinforcement learning to selectively use video predictions for reasoning about unobserved states and interaction outcomes. We also develop a world-action extension of the full RynnUnify model, translating its understanding and prediction capabilities into robot control. To evaluate these capabilities, we introduce Rynn-VP and Rynn-GEU for long-horizon visual planning and anticipatory reasoning. Experiments show that RynnUnify achieves the highest average embodied understanding score among the evaluated unified multimodal models and improves the Rynn-VP overall score by 9.75 points over Cosmos 3 Nano. Its agentic extension improves the Rynn-GEU average by 6.0 points over direct reasoning, while the world-action extension achieves 51.5% success on 20 selected composite RoboCasa365 tasks and 46.7% average success across three real-robot tasks. Together, these results establish RynnUnify as a shared foundation for embodied understanding, visual planning, and robot control, taking a step toward a unified embodied brain.

Minghao Zhu, Bohan Hou

Foundation models: pre- and post-training, architecture and long context, inference serving and cost per token.

Harness

74

Agent runtimes: plugins and sandboxes, tool surfaces, skill systems, long-term memory and self-improvement.

AI Coding

96

Code generation, repair, refactoring, software engineering tasks

Skills

18
Developmentmattpocock/skillsFeatured

The 38 skills Matt Pocock uses every day for real engineering

Editor's takeSells parts, not a process: 38 SKILL.md behind a strict user/model-invoked contract, a SCOPE.md admission bar and a shared GLOSSARY.md; the spec-to-tickets-to-implement-spec pipeline is the most complete agentic engineering loop in this channel.

Daily-working set of the Total TypeScript author: 38 SKILL.md files (engineering 20, productivity 7, misc 4 frozen, in-progress 7) behind a user-invoked/model-invoked contract, a SCOPE.md admission bar and a shared GLOSSARY.md; installs as a Claude Code, Codex, Copilot or Gemini plugin, or an editable skills.sh copy.

Claude CodeCodexGemini CLI+2
claude plugin install mattpocock-skills@claude-plugins-official
Shellmattpocock289.9k
The 38 skills Matt Pocock uses every day for real engineering
Developmentobra/superpowersFeatured

Fifteen skills that give a coding agent a full development process

Editor's takeIts premise is that models lack process discipline, not coding ability. The single best idea to steal is 'Rulings, not stalls': decide by default, and stop for a human only when an action is irreversible, touches a security-sensitive surface, leaks outside the worktree, or the plan is already too broken to continue.

v6.4.1 (2026-09-18), MIT, 289k stars — the largest single skill repository of its kind. It chains brainstorming, spec writing, git-worktree isolation, planning, subagent execution, red-green TDD, two-way code review and verification-before-completion into one trunk workflow, and the README lists 16+ harnesses: Claude Code, Codex, Cursor, Gemini CLI, OpenCode, Kimi Code, Devin CLI and more.

Claude CodeCodexCursor
/plugin install superpowers@claude-plugins-official
Shellobra289.2k
Fifteen skills that give a coding agent a full development process
Official & Collectionsanthropics/skillsFeatured

The official repo from the format's author: 19 skills plus spec and template

Editor's takeIf you want to know how a SKILL.md is actually supposed to be written, read this instead of any second-hand tutorial. Two things to know first: docx, pdf, pptx and xlsx are source-available rather than open source (the other 15 are Apache-2.0), and the repo carries its own disclaimer — these skills are demos, so test them in your environment before trusting them with anything critical.

Anthropic's own implementation, 177k stars: 19 skills under ./skills plus ./spec (the Agent Skills specification, now at agentskills.io) and ./template as a scaffold. Its definition of a skill is folders of instructions, scripts and resources loaded dynamically, and progressive disclosure comes straight from here.

Claude Code
/plugin marketplace add anthropics/skills
Pythonanthropics177.3k
The official repo from the format's author: 19 skills plus spec and template
Design & Frontendnextlevelbuilder/ui-ux-pro-max-skillFeatured

Design knowledge as searchable local data: 79 styles, 192 palettes, 119 UX rules

Editor's takeIts sharpest self-description is that models can write CSS but lack a taste database. Ten rule categories are ordered by severity, with Accessibility and Touch & Interaction first as CRITICAL and Charts last — that ordering is the stance. The Design System Generator runs five parallel searches, and the repo states plainly: do not persist unverified output, so a generated design system has to be checked before it lands in your repo.

v2.13.0, MIT, 129k stars, site uupm.cc. Instead of lecturing the model it ships structured catalogues the agent queries before writing code: 79 UI styles, 192 palettes with reasoning, 74 type pairings, 119 UX rules, 105 icon suggestions, 17 GSAP presets, 25 chart types, 22 stacks and 34 landing-page patterns.

Any agent
npx ui-ux-pro-max-cli init --ai claude
Pythonnextlevelbuilder129.3k
Design knowledge as searchable local data: 79 styles, 192 palettes, 119 UX rules
KnowledgeGraphify-Labs/graphifyFeatured

Map the whole project into a queryable knowledge graph instead of grepping

Editor's takeThe design that matters most: every edge is labelled EXTRACTED or INFERRED, so you can tell what the source explicitly contains from what the tool inferred — which makes an agent's conclusions auditable, a hard requirement in production. It is not a vector index: no embeddings, no vector store, a real graph you can explain, path and query. In its own benchmark, building the graph costs zero LLM spend and ingest is an order of magnitude cheaper, a structural win from local parsing.

YC S26, Apache-2.0, 120k stars, Python 3.10+. /graphify . maps code, docs, PDFs, images and videos into a graph and emits a clickable graph.html, a human-readable GRAPH_REPORT.md and a machine-readable graph.json. Code goes through tree-sitter AST parsing (about 40 languages): deterministic, no LLM calls, nothing leaves the machine.

Claude CodeCodexCursor
uv tool install graphifyy && graphify install
PythonGraphify-Labs119.9k
Map the whole project into a queryable knowledge graph instead of grepping
Design & FrontendLeonxlnx/taste-skillFeatured

Taste Skill: 13 anti-slop frontend skills that turn AI tells into countable rules

Editor's takeThe lesson worth stealing is rules expressed as countable mechanical tests: eyebrow count ≤ ceil(sections/3), bento cells equal to content items, zero em-dashes on the page, palette families rotated across projects. Each one aims straight at the model repeating itself instead of stopping at an adjective. The repo is equally honest about its edges: v2 self-declares experimental and is still moving, §13 explicitly excludes dashboards, data tables, multi-step wizards, code editors and native mobile, and the only test in the repo guards the source-invocation semantics of the skill.sh shell helper rather than the design rules.

One MIT repo holding 13 skills: ten that output code and three that output reference images only, all installed into Claude Code / Codex / Cursor with a single npx skills add. The default design-taste-frontend v2 (experimental) is a 1,228-line SKILL.md: first the model must emit a one-line "design read", then it sets three dials (DESIGN_VARIANCE / MOTION_INTENSITY / VISUAL_DENSITY), then it implements against 14 chapters of hard rules - install the official package for corporate briefs, label aesthetic borrowings in comments, zero em-dashes anywhere on the page, eyebrow quota computed from section count, bento cells equal to content items, and finally a 50-plus box pre-flight check. The repo also ships research/laziness, a literature directory using controlled studies to explain why models cut output short.

Claude CodeCodexCursor
npx skills add https://github.com/Leonxlnx/taste-skill
JavaScriptLeonxlnx94.8k
Taste Skill: 13 anti-slop frontend skills that turn AI tells into countable rules

Leaderboard

481
Artificial Analysis Intelligence IndexOfficial intelligence index (higher is better)
Claude Opus 5.5 (max with fallback)57.62
Claude Sonnet 5.5 (max with fallback)56
Claude Opus 5.5 (xhigh with fallback)55.99
Muse Wonder Full (max)55.8
Kimi K3.1 Pro55.09

Source · artificialanalysis.aiofficial Intelligence Index v4.3.2synced Oct 27, 2026

Image Generation

59

Text-to-image, image editing, consistency and controllability

Audio & Video

152

Video and speech/audio: physical and temporal coherence for text/image-to-video, TTS and voice cloning, music generation and ASR.

3D & World Models

314

3D asset generation, scene reconstruction, long-horizon world prediction

Design & Frontend

75

Visual design, UI components, web and slide layout

Docs & Slides

16

Slides, Word, Excel, PDF generation and editing

Blog

96

Agent Studio

7

RetouchPi

Fifty-four professional tools, layers and masks, PSD files that open and save back - all in the browser, nothing to install.

retouchpi.com · 54 pro tools · PSD read and write · AI generate & edit

Agent digital twin office

A 100 km 3D city that opens in seconds — crawling, blogs, papers, industry and investment analysis, all watchable in one digital twin.

100km city · opens in seconds · Live task stream · Agent-maintained

Robotic arm workbench

An SO-101 6-DoF arm running MuJoCo physics in your browser: joint teleoperation, IK end-effector dragging and gripper pick-and-place into a basket. No install.

MuJoCo WASM physics · SO-101 · 6 DoF · Contacts / telemetry HUD

Joint actuator anatomy lab

Take a humanoid joint module apart layer by layer: brushless motor, magnetic encoder, planetary / harmonic / cycloidal drive and output flange. Switch architectures on one page — exploded view plus analytic kinematics.

Three gearbox types · Planetary / harmonic / cycloidal · Analytic kinematics · explode

Speech synthesis lab

Matcha-TTS mixed zh/en speech synthesis: server-side synthesis with sentence-streamed playback and full-article read-aloud for papers and blogs. Sign-in required.

Matcha-TTS · server-side · Mixed zh / en · Full-article read-aloud

CodeWaifu, your caring coding desktop sprite

A caring coding sprite on your desktop and a cockpit that never stops: the work resumes itself after a crash or a reboot. Every coding terminal, ssh session and local shell in one tree, every start, finish and permission request reported in time. Open source, one-line install.

Your caring coding desktop sprite · Resumes after crash & reboot · First-rate terminal / ssh / shell

AI Games

4

Under constructionThe games system is still under construction — everything listed starts in-page, and the library keeps growing.

ThreeDream FPS arena

ThreeDream FPS arena

A first-person match where every bot across from you is driven live by a policy this repo trained, the whole round stepping at a fixed 60 Hz: builtin, Rust/wasm or Rapier behind one physics interface, nothing scripted.

WASD move · mouse look · left-click fire · shift sprint · R reload · esc release

ThreeDream UE level

ThreeDream UE level

Unreal 5.5's first-person test map, running same-origin in the browser: the level, the materials, the lights and four weapon data assets are read out of the project's own .umap / .uasset bytes, six soldiers are driven by a four-state brain on one fixed 60 Hz step, and the sidebar lists every substitution the page had to make.

WASD move · mouse look · left-click fire · shift sprint · space jump · R reload · F pick up · esc release

ThreeDream CARLA town drive

ThreeDream CARLA town drive

The whole of CARLA Town10HD read out of its .umap and OpenDRIVE road bytes, 4,474 actors back on the project's own coordinates; 32 cars decide live over the same lane graph - car-following, braking, lane changes - and you sit in one of them, on the wheel or on autopilot.

W throttle · S brake · A D steer · space handbrake · T autopilot · C camera

ThreeDream factory town

ThreeDream factory town

The abandoned-factory town's bytes come from two places: 3,571 actors and a 509x509 landscape heightfield read out of the Unreal project's own mainmap.umap, 3,283 meshes resolved through an unlicensed content pack pinned by revision on its own mirror; six soldiers run live on a four-state patrol / engage / advance / down brain over one fixed 60 Hz step, standing at random walkable spots wave by wave and getting back up elsewhere once downed, with four guns on the ground each wave to swap for with F and a kill quota that opens the next one (?arena=0 gives the same town back without rounds); and the sidebar lists the 101 placements still missing their mesh instead of hiding the holes.

WASD move · mouse look · left-click fire · shift sprint · space jump · R reload · F pick up · esc release

Frequently asked

What is this site?
An AGI progress digest: paper deep reads, open-source projects, demo videos and leaderboards across models, agents and runtimes, skills, multimodal and embodied AI.
Where does the content come from?
Public sources: arXiv papers, official releases and blogs, GitHub repositories, demos on X and YouTube, and evaluators' own leaderboards. Every entry keeps its source link and author credit.
Are the paper and project write-ups summaries?
No. Papers are written up from the full text as bilingual long reads with formulas, experiment tables and method diagrams; open-source projects are read through their README and source before a bilingual write-up with a hands-on verdict.
Where do the leaderboards come from?
From each evaluator's own official board, synced on a schedule, with scrape and official-update timestamps shown.
Can I cite this site?
Yes — cite the canonical URL each page declares. Third-party papers, videos and images remain the copyright of their original authors.

As an Amazon Associate, we earn from qualifying purchases.