Skip to content
AGI PROGRESS INTELLIGENCE

Footprints on the Road to AGI

Selected for You2,375

Seamless 30-second Kung Fu Panda from two MiniMax H3 clips: ComfyUI-H3-Motion-Context chains clips via latent slicing and audio continuation

Seamless 30-second Kung Fu Panda from two MiniMax H3 clips: ComfyUI-H3-Motion-Context chains clips via latent slicing and audio continuation

Developer @eternityspring demonstrates (29-second video): MiniMax H3 generates at most 15 seconds per call — how do you join clips for a short drama without visible seams? He recommends the open-source ComfyUI-H3-Motion-Context pack, showing a 30-second Kung Fu Panda clip: "If I didn't say it, who could tell this 30s Kung Fu Panda was generated in two segments?" The common approach — feeding the last frame back as an image-to-video start — lacks motion information, so the model guesses direction and speed, causing stutter or sudden action changes at the seam. Motion Context instead pins the previous clip's last 22 frames (0.92s) at the head of the next clip, frozen at every sampling step — the model sees real motion, not a guess. Picture and sound are sliced directly from the previous clip's latent (no VAE decode-re-encode round trip), preserving the numbers bit for bit and eliminating the color drift and softening that accumulate over long chains; the pinned audio window ends at the join and reaches backwards, so the soundtrack continues rather than restarts — instantly audible on anything with a beat. After generation, a Trim node removes the pinned head and the two segments concatenate directly, no transitions needed. The key prompting trick: open the next segment by describing how the previous one ended — same character, same framing, same action held for a second or two before new plot. Frame-by-frame inspection shows pose, position and expression all matching across the seam. Core nodes: Motion Context / Trim / Save-Load Latent (carrying H3's paired video+audio latent across runs) / Seam Probe (quantifying whether a join is a real continuation or a convincing imitation) / Chain loop node (Approve auto-advances indices, segments controls how many clips run) — without modifying ComfyUI itself, refusing to run if layout checks fail.

Demo · 2026-10-02
MetricTrail Estimates Long-Video Pose Without Long Training

MetricTrail Estimates Long-Video Pose Without Long Training

NVIDIA MetricTrail estimates long-video pose without long-sequence training while maintaining metric scale and trajectory consistency, with code and models released.

Demo · 2026-11-05
House Plan Designer: From Drawing to an Editable Renovation Workspace

House Plan Designer: From Drawing to an Editable Renovation Workspace

An agent-guided pipeline that reconstructs plans from images, screenshots, PDFs, and DXFs into a millimetre-based workspace, then audits walls, dimensions, openings, and furniture before producing an offline renovation designer.

Open source · 2026-11-09
NVIDIA Auto Ontology: A Verifiable Semantic Layer for Agent Harnesses

NVIDIA Auto Ontology: A Verifiable Semantic Layer for Agent Harnesses

NVIDIA's open semantic layer compiles certified terms, relationships, and SQL attributes, then serves them to agents through MCP, CLI, and APIs for traceable text-to-SQL.

Open source · Exploring · 2026-11-05
OpenPencil: the Rust-rewritten open-source AI-native vector design tool where design is code

OpenPencil: the Rust-rewritten open-source AI-native vector design tool where design is code

OpenPencil stores designs as readable, diffable, Git-friendly .op JSON, turns one prompt into multi-screen editable designs through the op-orchestrator and Agent Teams, and exports React, Flutter and more via MCP, CLI and codegen; after the Rust rewrite the desktop app is a single 55.5 MB binary, a 10k-node canvas runs panic-free and the web build is 2.18 MB gzipped.

Open source · Exploring · 2026-10-28

Frontier papers

527
LG-VLN: A Zero-Shot Vision-and-Language Navigation Framework with LangGraph State Orchestration

LG-VLN: A Zero-Shot Vision-and-Language Navigation Framework with LangGraph State Orchestration

LG-VLN is a zero-shot VLN-CE framework that uses only monocular RGB. VGGT estimates depth, camera poses, and point clouds online, while CleanDIFT supplies shared dense features for correspondence filtering and semantic value construction. BLIP-2 image-text relevance is fused with target-reference similarity, and Grounding DINO with SAM 2 localizes objects. LangGraph orchestrates instruction tracking, mapping, planning, action execution, and staged recovery over persistent state. On a fixed 550-episode R2R-CE val-unseen subset, it reaches 21.3% SR, 12.1% SPL, and 7.85 m NE. The public repository is only a scaffold at the inspected commit and does not yet reproduce the paper.

Jianhe Zhao, Yanhua Qiu, Zhiyu Zhang · 18 views · Sep 14, 2026
Vision-and-Language NavigationVLN-CE
Sep 14, 2026
FACTR 2: Learning External Force Sensing for Commodity Robot Arms Improves Policy Learning
02Paper

FACTR 2: Learning External Force Sensing for Commodity Robot Arms Improves Policy Learning

Contact-rich manipulation requires force sensitivity, but many robot arms lack dedicated force sensors due to their high cost. We present Neural External Torque Estimation (NEXT), a data-driven method that estimates external joint torques without needing any dedicated force sensors. NEXT trains in 1 minute from only 10 minutes of free-motion data, yet achieves estimates comparable to dedicated joint-torque sensors. NEXT enables force-feedback teleoperation on low-cost arms and improves policy learning through Force-Informed Re-Sampling Training (FIRST), which up-samples pre-contact and contact segments during behavior cloning. Across five long-horizon tasks, FIRST outperforms prior force-aware policies by over 17% in task progress. Together, NEXT and FIRST bring force-aware teleoperation and policy learning to off-the-shelf robots without additional sensing hardware. Video results and code are available at https://jasonjzliu.com/factr2

Steven Oh, Jason Jingzhou Liu
AIRoA-0: Learning Long-Horizon, Precise Cross-Embodiment Manipulation from Handheld Data
03Paper

AIRoA-0: Learning Long-Horizon, Precise Cross-Embodiment Manipulation from Handheld Data

AIRoA-0 turns 16,151 hours of bimanual handheld-gripper demonstrations into a vision-language-action policy that uses anchored tool motion, selective wrist perception, stage prediction, proprioceptive memory, and streaming decoding to carry one set of weights across four robot embodiments.

Yueh-Hua Wu, Kei Ota
UniWAM: Unified World-Action Model
04Paper

UniWAM: Unified World-Action Model

Vision-language-action models benefit from the understanding and reasoning capabilities of pretrained vision-language models, but action-only supervision provides limited grounding in world dynamics. Conversely, world-action models inherit spatiotemporal priors from video generation models, yet remain limited in semantic understanding and reasoning under distribution shifts. We introduce UniWAM, a unified architecture that integrates a physical reasoner, a world generator, and an action predictor to jointly learn semantic understanding of the physical world, visual generation, and action prediction. To ensure the quality of the training data, we developed a rigorous data cleaning and annotation pipeline for both human egocentric data and robot data. To adapt the vision-language component to embodied tasks while preserving its inherited language capabilities, we represent low-level actions in natural language and introduce a pre-training recipe that assigns complementary supervision from visual question answering (VQA) data, human egocentric data, and robot demonstrations to the appropriate model components. During post-training, future visual noise augmentation reduces reliance on precise future predictions, while history-conditioned flow matching uses encoded action history to initialize action generation. Together, these designs significantly reduce denoising steps while maintaining performance. UniWAM achieves state-of-the-art (SOTA) performance across multiple evaluations, including in-distribution performance, robustness, generalization, instruction following, and long-horizon task execution. Furthermore, we uncover a log-linear scaling law of unified human-robot co-training, demonstrating the effectiveness of large-scale pre-training on a mixture of human and robot data.

Wenxuan Song, Jiayi Chen

LLM

103

Foundation models: pre- and post-training, architecture and long context, inference serving and cost per token.

Harness

100

Agent runtimes: plugins and sandboxes, tool surfaces, skill systems, long-term memory and self-improvement.

AI Coding

107

Code generation, repair, refactoring, software engineering tasks

Skills

19
Developmentmattpocock/skillsFeatured

The 38 skills Matt Pocock uses every day for real engineering

Editor's takeSells parts, not a process: 38 SKILL.md behind a strict user/model-invoked contract, a SCOPE.md admission bar and a shared GLOSSARY.md; the spec-to-tickets-to-implement-spec pipeline is the most complete agentic engineering loop in this channel.

Daily-working set of the Total TypeScript author: 38 SKILL.md files (engineering 20, productivity 7, misc 4 frozen, in-progress 7) behind a user-invoked/model-invoked contract, a SCOPE.md admission bar and a shared GLOSSARY.md; installs as a Claude Code, Codex, Copilot or Gemini plugin, or an editable skills.sh copy.

Claude CodeCodexGemini CLI+2
claude plugin install mattpocock-skills@claude-plugins-official
Shellmattpocock289.9k
The 38 skills Matt Pocock uses every day for real engineering
Developmentobra/superpowersFeatured

Fifteen skills that give a coding agent a full development process

Editor's takeIts premise is that models lack process discipline, not coding ability. The single best idea to steal is 'Rulings, not stalls': decide by default, and stop for a human only when an action is irreversible, touches a security-sensitive surface, leaks outside the worktree, or the plan is already too broken to continue.

v6.4.1 (2026-09-18), MIT, 289k stars — the largest single skill repository of its kind. It chains brainstorming, spec writing, git-worktree isolation, planning, subagent execution, red-green TDD, two-way code review and verification-before-completion into one trunk workflow, and the README lists 16+ harnesses: Claude Code, Codex, Cursor, Gemini CLI, OpenCode, Kimi Code, Devin CLI and more.

Claude CodeCodexCursor
/plugin install superpowers@claude-plugins-official
Shellobra289.2k
Fifteen skills that give a coding agent a full development process
Official & Collectionsanthropics/skillsFeatured

The official repo from the format's author: 19 skills plus spec and template

Editor's takeIf you want to know how a SKILL.md is actually supposed to be written, read this instead of any second-hand tutorial. Two things to know first: docx, pdf, pptx and xlsx are source-available rather than open source (the other 15 are Apache-2.0), and the repo carries its own disclaimer — these skills are demos, so test them in your environment before trusting them with anything critical.

Anthropic's own implementation, 177k stars: 19 skills under ./skills plus ./spec (the Agent Skills specification, now at agentskills.io) and ./template as a scaffold. Its definition of a skill is folders of instructions, scripts and resources loaded dynamically, and progressive disclosure comes straight from here.

Claude Code
/plugin marketplace add anthropics/skills
Pythonanthropics177.3k
The official repo from the format's author: 19 skills plus spec and template
Design & Frontendnextlevelbuilder/ui-ux-pro-max-skillFeatured

Design knowledge as searchable local data: 79 styles, 192 palettes, 119 UX rules

Editor's takeIts sharpest self-description is that models can write CSS but lack a taste database. Ten rule categories are ordered by severity, with Accessibility and Touch & Interaction first as CRITICAL and Charts last — that ordering is the stance. The Design System Generator runs five parallel searches, and the repo states plainly: do not persist unverified output, so a generated design system has to be checked before it lands in your repo.

v2.13.0, MIT, 129k stars, site uupm.cc. Instead of lecturing the model it ships structured catalogues the agent queries before writing code: 79 UI styles, 192 palettes with reasoning, 74 type pairings, 119 UX rules, 105 icon suggestions, 17 GSAP presets, 25 chart types, 22 stacks and 34 landing-page patterns.

Any agent
npx ui-ux-pro-max-cli init --ai claude
Pythonnextlevelbuilder129.3k
Design knowledge as searchable local data: 79 styles, 192 palettes, 119 UX rules
KnowledgeGraphify-Labs/graphifyFeatured

Map the whole project into a queryable knowledge graph instead of grepping

Editor's takeThe design that matters most: every edge is labelled EXTRACTED or INFERRED, so you can tell what the source explicitly contains from what the tool inferred — which makes an agent's conclusions auditable, a hard requirement in production. It is not a vector index: no embeddings, no vector store, a real graph you can explain, path and query. In its own benchmark, building the graph costs zero LLM spend and ingest is an order of magnitude cheaper, a structural win from local parsing.

YC S26, Apache-2.0, 120k stars, Python 3.10+. /graphify . maps code, docs, PDFs, images and videos into a graph and emits a clickable graph.html, a human-readable GRAPH_REPORT.md and a machine-readable graph.json. Code goes through tree-sitter AST parsing (about 40 languages): deterministic, no LLM calls, nothing leaves the machine.

Claude CodeCodexCursor
uv tool install graphifyy && graphify install
PythonGraphify-Labs119.9k
Map the whole project into a queryable knowledge graph instead of grepping
Design & FrontendLeonxlnx/taste-skillFeatured

Taste Skill: 13 anti-slop frontend skills that turn AI tells into countable rules

Editor's takeThe lesson worth stealing is rules expressed as countable mechanical tests: eyebrow count ≤ ceil(sections/3), bento cells equal to content items, zero em-dashes on the page, palette families rotated across projects. Each one aims straight at the model repeating itself instead of stopping at an adjective. The repo is equally honest about its edges: v2 self-declares experimental and is still moving, §13 explicitly excludes dashboards, data tables, multi-step wizards, code editors and native mobile, and the only test in the repo guards the source-invocation semantics of the skill.sh shell helper rather than the design rules.

One MIT repo holding 13 skills: ten that output code and three that output reference images only, all installed into Claude Code / Codex / Cursor with a single npx skills add. The default design-taste-frontend v2 (experimental) is a 1,228-line SKILL.md: first the model must emit a one-line "design read", then it sets three dials (DESIGN_VARIANCE / MOTION_INTENSITY / VISUAL_DENSITY), then it implements against 14 chapters of hard rules - install the official package for corporate briefs, label aesthetic borrowings in comments, zero em-dashes anywhere on the page, eyebrow quota computed from section count, bento cells equal to content items, and finally a 50-plus box pre-flight check. The repo also ships research/laziness, a literature directory using controlled studies to explain why models cut output short.

Claude CodeCodexCursor
npx skills add https://github.com/Leonxlnx/taste-skill
JavaScriptLeonxlnx94.8k
Taste Skill: 13 anti-slop frontend skills that turn AI tells into countable rules

Leaderboard

504
Artificial Analysis Intelligence IndexOfficial intelligence index (higher is better)
Gemini 4 Carbon (high)60.03
Claude Opus 5.5 (max)59.11
Gemini 4 Carbon (medium)58.26
Claude Opus 5.5 (xhigh)57.44
GPT-6 Astra (max)56.85

Source · artificialanalysis.aiofficial Intelligence Index v5synced Nov 9, 2026

Image Generation

65

Text-to-image, image editing, consistency and controllability

Audio & Video

172

Video and speech/audio: physical and temporal coherence for text/image-to-video, TTS and voice cloning, music generation and ASR.

3D & World Models

388

3D asset generation, scene reconstruction, long-horizon world prediction

Design & Frontend

85

Visual design, UI components, web and slide layout

Docs & Slides

19

Slides, Word, Excel, PDF generation and editing

Blog

121

Agent Studio

7

RetouchPi

Fifty-four professional tools, layers and masks, PSD files that open and save back - all in the browser, nothing to install.

retouchpi.com · 54 pro tools · PSD read and write · AI generate & edit

ThreeDream simulation engine

Built for games and for physical AI: an ultra-realistic, ultra-high-performance simulation environment with ultra-low-cost procedural data; Unreal-grade visuals open and play in the browser, bridging the physical world and intelligent agents.

Games meet physical AI · Unreal-grade on the web · Open and play

CodeWaifu, your caring coding desktop sprite

A caring coding sprite on your desktop and a cockpit that never stops: the work resumes itself after a crash or a reboot. Every coding terminal, ssh session and local shell in one tree, every start, finish and permission request reported in time. Open source, one-line install.

Your caring coding desktop sprite · Resumes after crash & reboot · First-rate terminal / ssh / shell

Agent digital twin office

A 100 km 3D city that opens in seconds — crawling, blogs, papers, industry and investment analysis, all watchable in one digital twin.

100km city · opens in seconds · Live task stream · Agent-maintained

Robotic arm workbench

An SO-101 6-DoF arm running MuJoCo physics in your browser: joint teleoperation, IK end-effector dragging and gripper pick-and-place into a basket. No install.

MuJoCo WASM physics · SO-101 · 6 DoF · Contacts / telemetry HUD

Joint actuator anatomy lab

Take a humanoid joint module apart layer by layer: brushless motor, magnetic encoder, planetary / harmonic / cycloidal drive and output flange. Switch architectures on one page — exploded view plus analytic kinematics.

Three gearbox types · Planetary / harmonic / cycloidal · Analytic kinematics · explode

AI Games

5

Under constructionThe games system is still under construction — everything listed starts in-page, and the library keeps growing.

ThreeDream FPS arena

ThreeDream FPS arena

A first-person match where every bot across from you is driven live by a policy this repo trained, the whole round stepping at a fixed 60 Hz: builtin, Rust/wasm or Rapier behind one physics interface, nothing scripted.

WASD move · mouse look · left-click fire · shift sprint · R reload · esc release

ThreeDream UE level

ThreeDream UE level

Unreal 5.5's first-person test map, running same-origin in the browser: the level, the materials, the lights and four weapon data assets are read out of the project's own .umap / .uasset bytes, six soldiers are driven by a four-state brain on one fixed 60 Hz step, and the sidebar lists every substitution the page had to make.

WASD move · mouse look · left-click fire · shift sprint · space jump · R reload · F pick up · esc release

ThreeDream CARLA town drive

ThreeDream CARLA town drive

The whole of CARLA Town10HD read out of its .umap and OpenDRIVE road bytes, 4,474 actors back on the project's own coordinates; 32 cars decide live over the same lane graph - car-following, braking, lane changes - and you sit in one of them, on the wheel or on autopilot.

W throttle · S brake · A D steer · space handbrake · T autopilot · C camera

ThreeDream factory town

ThreeDream factory town

The abandoned-factory town's bytes come from two places: 3,571 actors and a 509x509 landscape heightfield read out of the Unreal project's own mainmap.umap, 3,283 meshes resolved through an unlicensed content pack pinned by revision on its own mirror; six soldiers run live on a four-state patrol / engage / advance / down brain over one fixed 60 Hz step, standing at random walkable spots wave by wave and getting back up elsewhere once downed, with four guns on the ground each wave to swap for with F and a kill quota that opens the next one (?arena=0 gives the same town back without rounds); and the sidebar lists the 101 placements still missing their mesh instead of hiding the holes.

WASD move · mouse look · left-click fire · shift sprint · space jump · R reload · F pick up · esc release

ThreeDream Solis Reach

ThreeDream Solis Reach

A whole mirror-salt solar city generated at runtime: 4,570 built pieces, 3,197 hillside homes, 71 heliostats and a three-ring armillary surround one live sea; 11 salt skiffs query the same heightfield that is drawn every frame, and orbit or fly cameras let you cross the scene - this is not a pre-baked tour.

drag orbit · wheel zoom · WASD fly · E Q up/down · shift boost · mouse look

Frequently asked

What is this site?
An AGI progress digest: paper deep reads, open-source projects, demo videos and leaderboards across models, agents and runtimes, skills, multimodal and embodied AI.
Where does the content come from?
Public sources: arXiv papers, official releases and blogs, GitHub repositories, demos on X and YouTube, and evaluators' own leaderboards. Every entry keeps its source link and author credit.
Are the paper and project write-ups summaries?
No. Papers are written up from the full text as bilingual long reads with formulas, experiment tables and method diagrams; open-source projects are read through their README and source before a bilingual write-up with a hands-on verdict.
Where do the leaderboards come from?
From each evaluator's own official board, synced on a schedule, with scrape and official-update timestamps shown.
Can I cite this site?
Yes — cite the canonical URL each page declares. Third-party papers, videos and images remain the copyright of their original authors.

As an Amazon Associate, we earn from qualifying purchases.