Skip to content
←Back to Applications

APPLICATION

AI CodingDevelopmentTop

Codex: an Apache-2.0 core, one agent in four form factors, and the reference harness for OpenAI models

openai-codex

Codex is the coding agent from OpenAI, and in 2026 it is not one product but four entry points onto one core: the CLI in your terminal, an IDE extension (officially for VS Code, Cursor and Windsurf), a desktop app launched with a single codex app command, and Codex Web running tasks remotely at chatgpt.com/codex. The openai/codex repository is Apache-2.0 and stood at 126,918 stars / 19,819 forks when fetched on 2026-09-28 - one of the few frontier-vendor coding harnesses whose harness is itself open source, so context assembly, tool ordering and approval gating can all be read. Safety is a first-class citizen: docs/ carries sandbox.md, execpolicy.md, exec.md, agents_md.md, skills.md and slash_commands.md, where execpolicy turns which commands may run unattended into an auditable, versionable, org-distributable policy instead of model goodwill, exec lets Codex run in CI, scripts and batch jobs rather than only waiting in a terminal, and AGENTS.md has become a de facto cross-tool standard. Four install channels (install.sh, install.ps1, npm, brew) and two billing models: usage included in ChatGPT plans versus per-token API keys, a cost question to settle before choosing. Codex is also the reference harness for OpenAI models - the Cursor Terminal-Bench 2.0 footnote states that OpenAI model scores use the Simple Codex harness, and the vendor-published Terminal-Bench 4.0 reading of 58.18% is already carried on the GPT-6 Astra card because it measures the model rather than the shell, so this entry does not claim it. Boundaries: models are closed and data egress cannot be avoided; developers.openai.com returns 403 to automated fetching, so the fact layer rests on the repository README/docs and the GitHub API. The card metric keeps only the verifiable fact layer (license plus stars). Confidence C (vendor-claim).

C
CONFIDENCE
Vendor Claim
Official model card or keynote only, no independent re-test
Apache-2.0 · 126,918★
KEY METRIC
Harness core licence + GitHub stars
Vendor Claim · 2026-09
MATURITY
Product
research → demo → product → production
Editor's take

Graded C (vendor-claim). Terminal-Bench 4.0 is hosted by Stanford, Harbor and the Laude Institute and is a credible third-party benchmark, but the 58.18% reading was published vendor-side and it has not been recomputed; developers.openai.com also returns 403 to automated fetching, so the detailed capability surface can only be inferred from the open repository. What is confirmable is hard: Apache-2.0 licensing, 126,918 stars, four install channels, the sandbox / execpolicy / exec / skills / AGENTS.md concepts in the docs tree, and Cursor's footnote naming it the comparator harness for OpenAI models.

Water level: Codex's strategic position is not "another CLI". Two things matter. It open-sourced the harness, which makes its sandbox and execution policy a readable reference implementation for the industry. And competitors use it as their baseline comparator, which is the field's way of saying it represents the real ceiling of OpenAI's models. For teams, four surfaces on one core means local, IDE, desktop and cloud-hosted work can share one AGENTS.md and one policy set - a far cheaper migration than switching vendors.

Costs stated plainly: closed models, data leaves the perimeter, and the two billing models are easy to conflate.

AI CodingCode HarnessCLI AgentSandbox
OpenAIOfficial sitegithub.com/openai/codex4 min read909

What it is: one Apache-2.0 coding agent shipped as four surfaces

Codex is OpenAI's coding agent, and in 2026 it is not one product but four entry points onto the same agent: the Codex CLI (runs locally; the repo describes it as "a lightweight coding agent that runs in your terminal"), an IDE extension (officially for VS Code, Cursor and Windsurf), a desktop app (launched with a single codex app), and Codex Web (the cloud agent at chatgpt.com/codex, where tasks run remotely). All four share one core, which is the real difference from products that ship a plugin and stop there.

openai/codex is Apache-2.0 licensed and stood at 126,918 stars / 19,819 forks when fetched on 2026-09-28. That matters: this is one of the few frontier-vendor coding harnesses whose harness is itself open source, so anyone can read how it assembles context, orders tools, and gates approvals.

Install and auth: four install channels, two billing models

Install coverage is unusually complete: one line on macOS/Linux (curl -fsSL https://chatgpt.com/codex/install.sh | sh), one line on Windows (irm https://chatgpt.com/codex/install.ps1 | iex), plus npm install -g @openai/codex and brew install --cask codex. Standalone installers download from releases.openai.com/codex by default and fall back to GitHub Releases when metadata or assets are unavailable, with CODEX_INSTALLER_USE_RELEASES_OPENAI_COM=false to force the GitHub path. Treating distribution-source failure as an explicitly configurable engineering problem is the kind of detail that only appears after being hit at real scale.

Authentication has two shapes. The recommended path is Sign in with ChatGPT, using Codex as part of a Plus, Pro, Business, Edu or Enterprise plan; an API key also works but needs additional setup. The first is subscription-inclusive usage, the second is per-token billing - the same agent under two entirely different cost models, and that is the first calculation a team should do.

The security model is a first-class citizen: sandbox, approvals, execpolicy

The fastest way to judge an agent harness is to read the nouns in its docs directory. openai/codex's docs/ contains sandbox.md (sandboxing and approvals), execpolicy.md (execution policy), exec.md (non-interactive execution), config.md and example-config.md, agents_md.md (AGENTS.md), skills.md, slash_commands.md, authentication.md, install.md and open-source-fund.md. The directory is itself a capability map:

  • sandbox + approvals: the filesystem and network isolation boundary, plus human approval before crossing it. This is the precondition for letting an agent run on a machine that holds real credentials.
  • execpolicy: which commands may run unattended and which must be asked about, expressed as policy rather than left to model discretion. Policy is auditable, versionable, and distributable across an organisation.
  • exec: a non-interactive execution entry point, meaning Codex can live in CI, in scripts and in batch jobs rather than only in a terminal waiting for a human.
  • AGENTS.md: the repository-level brief for agents. It has become a de facto cross-tool standard - Codex is not the only harness that reads it.
  • skills / slash commands: reusable capability packaging and shortcuts; the layer that turns personal prompts into team assets.

Why it functions as a reference harness in evaluations

Terminal-Bench 4.0 is hosted by Stanford, Harbor and the Laude Institute and is one of the main 2026 benchmarks for long-horizon agent work in a terminal. Any credible cross-vendor comparison has to pin the harness, and Cursor's official Composer 2 evaluation footnote says so explicitly: Anthropic model scores use the Claude Code harness and OpenAI model scores use the Simple Codex harness, while Cursor's own score came from Harbor, the designated framework for Terminal-Bench 2.0, averaged over 5 iterations per model-agent pair.

The signal is that Codex is now treated by peers as the standard shell for OpenAI-family models. In coding agents, harness and model multiply rather than add: the same model can move a dozen points on long-task completion between shells. A harness that competitors use as their baseline comparator is, by implication, the industry's estimate of that model's real ceiling.

Paired with GPT-6 Astra (already catalogued on this site), the vendor-published Terminal-Bench 4.0 reading is 58.18%, ranked first. That number was published vendor-side, we have not recomputed it, and it already sits on the GPT-6 Astra card (it measures the model, not the shell), so this entry does not claim it as its own metric and is graded C (vendor-claim); the card metric is limited to the verifiable fact layer - core license and repository stars.

Boundaries

The core is Apache-2.0, but the models are closed and reachable only through OpenAI's services, so data leaving the perimeter is unavoidable. Usage included in a ChatGPT plan and usage billed against an API key follow very different accounting, and mixing them distorts cost analysis. developers.openai.com returns 403 to automated fetching; the factual layer of this entry therefore rests on the GitHub repository README and docs directory, GitHub API metadata, and third-party evaluation footnotes.

More in AI Coding

4
AI CodingDevelopmentTopC

ZCode: the official GLM-5.3 harness, defined as an ADE rather than an editor

ZCode is the official harness Z.ai built for GLM-5.3, and it defines itself as neither an AI editor nor a CLI but an ADE (Agentic Development Environment): it turns the 1M context window and long-horizon capability of GLM-5.3 into a stable desktop experience covering planning, coding, review and iteration, keeping goal, files, terminal output, browser context, execution mode and Git state inside one task so continuity survives from plan through implementation to verification, with model capability, tool calling and the execution chain tuned over multiple rounds against GLM-5.3. The most distinctive design is /goal mode: after a goal is set, every round ends with an automatic check of whether the goal is met, and the agent continues into the next round on its own until completion is confirmed (the documented example is a research task running twenty-plus rounds, with a right-hand panel showing what each round did). One session holds one goal at a time; /goal shows it, /goal sets it (replacing any existing goal), /goal replace swaps it explicitly, /goal pause suspends it, and the docs are honest about the fit - work that is easy to state in one sentence but takes many rounds to finish. The card metric keeps the verifiable price fact layer: GLM-5.3 API at $1.4 input / $4.4 output per million tokens. Boundaries: the client is not open source and the deep tuning only covers the GLM-5.3 family; a stable 1M context is a vendor claim and mid-context recall is an industry-wide weakness, so stuffing a whole repo is no substitute for retrieval; idle-time tasks are being rolled out to subscribers rather than always available; the free quota is a 5-day window, not a lasting benefit. Confidence C (vendor-claim).

$1.4 / $4.4GLM-5.3 API price (input / output, per million tokens)Vendor Claim · 2026-09
ProductZ.aiSite
ZCode: the official GLM-5.3 harness, defined as an ADE rather than an editor
LLMDevelopmentTopC

GLM-5.3: the open-weights coding flagship bought with post-training alone

Z.ai post-trained the very same base as GLM-5.2 and nothing else, producing the 744B-A40B GLM-5.3: 50 percent over 5.2 on the in-house Z.ai Code Bench, open-weights first on Terminal Bench 3.0 at 28.3 and Agents' Last Exam at 28.5, while AutomationBench 48.2 and GDPVal-AA v2 1769 beat every closed-source comparison on the official chart; CyberGym vulnerability discovery is SOTA and the exploitation-chain gains emerged without dedicated training. The companion 320B-A18B Flash starts from a new base and is the first GLM to mix sparse with linear attention, attacking long-context serving cost. Weights ship in FP8 and BF16, deployable on SGLang, vLLM, KTransformers and the Ascend stack.

28.3Terminal Bench 3.0 (top open-weight, vendor chart)Vendor Claim · 2026-08
ProductZ.ai (Zhipu AI)SiteRepo
GLM-5.3: the open-weights coding flagship bought with post-training alone
ReasoningDevelopmentTopA

GPT-6 Astra: first on terminal engineering tasks, third tier on composite intelligence

The OpenAI flagship tier, officially positioned for hardest end-to-end work (gpt-6-astra): 1.05M-token context, 128K-token single output, knowledge cutoff 2026-04-30, with Functions, Web search, File search and Computer use built in, so search, retrieval and interface control ship with the model instead of an outer agent framework. Reasoning effort runs low to max in five steps while price stays fixed at $10/$50, so the cost lever is token consumption; siblings Sol ($2/$10) and Luna ($0.1/$0.5) make a 100x spread, so load splitting can stay inside one vendor. Readings (2026-09-22): #1 on Terminal-Bench 4.0 at 58.18% (n_trials=330, pass@5 0.7121), the protocol closest to a coding agent's daily life; #2 on Arena Agent with net_improvement 11.54 and confirmed_success 17.70, both below leader Fable 5.1, but the field's highest praise at 32.79; #6 and #7 on the intelligence index (max 52.67). The cutoff is nearly five months older than this page, so version numbers and API changes must go through Web search; computer-use reliability appears on no board; closed, API only. Graded A (confirmed); not independently benchmarked.

58.18%Terminal-Bench accuracyConfirmed · 2026-09
ProductOpenAISite
GPT-6 Astra: first on terminal engineering tasks, third tier on composite intelligence
LLMDevelopmentTopA

MiMo-V2.6: Live RL as an auditable ledger of 30 steps, 750k trajectories, and dollars

Xiaomi's open-source MiMo-V2.6 Pro/Flash: 30 steps of Live RL, roughly 750k trajectories, public cost of $850k/$2.62M, and 7k+ RL environments released in the same batch; tops the open-weights camp on the Artificial Analysis intelligence index at 46 with +17/+14 points out-of-sample on DeepSWE v1.1; four demo lines (Vibe World, CUA, research, content creation) all open. Self-improvement becomes an auditable ledger - steps, trajectories, and dollars on the table for third-party recomputation.

46Artificial Analysis Intelligence Index (top open-weight)Confirmed · 2026-09
ProductXiaomiSiteRepo
MiMo-V2.6: Live RL as an auditable ledger of 30 steps, 750k trajectories, and dollars

As an Amazon Associate, we earn from qualifying purchases.