🧠 Jalapeño’s first results show industry-leading speed and efficiency in AI inference


Claude gains shared memory, while Ramp’s homegrown coding agent and Google’s gesture research point to more situated AI.
The Merpati Post
Daily AI Briefing

Issue · August 26, 2026

OpenAI’s Jalapeño chip raises the inference bar, as persistent assistants, production-grade agent infrastructure, and multimodal creative interfaces move AI deeper into everyday workflows.

A faceted copper-red AI chip glows with amber data streams inside a teal server tray, while a small pigeon perches at the far edge.

AI in general

Frontier models, research and policy

3 stories

Score · 97 / 100

Jalapeño’s first results show industry-leading speed and efficiency in AI inference

Source: OpenAI — August 25, 2026

AI HARDWARE · INFERENCE · INFRASTRUCTURE

OpenAI says its first custom inference chip simultaneously improves throughput, latency, and energy efficiency—three dimensions that existing systems often trade against one another. On the public InferenceX benchmark, Jalapeño served GPT‑OSS 120B, DeepSeek R1 670B, and Kimi K2.5 1T with 1.5–1.9× more work per watt and 1.7–3.6× lower end-to-end latency than comparison systems.

What matters

  • Highly interactive workloads delivered 2.1–4.1× higher performance, potentially making long-running agents substantially more responsive.
  • Jalapeño is rated at 700 watts but reportedly sustained no more than 550 watts during the tested workloads.
  • OpenAI moved from initial design to tapeout in nine months with AI assisting circuit design, verification, and software optimization.
  • These remain OpenAI-run benchmarks; independent deployment data, availability, manufacturing scale, and total system cost are not yet public.

VerdictREAD FULL — The detailed workload-level results offer one of the clearest views yet of how custom silicon could alter AI economics.

Score · 92 / 100

Claude’s memory works everywhere, and you decide what’s in it

Source: Claude by Anthropic — August 25, 2026

PRODUCT · MEMORY · PRIVACY

Anthropic has unified Claude’s memory across regular chat and Claude Cowork, allowing context learned in one interface to carry into the other. Users can inspect, edit, pause, or delete topic-based memory files, while Claude now updates them during conversations rather than waiting until a chat ends.

What matters

  • Memory is on by default for Free, Pro, and Max users across web, desktop, and mobile.
  • Team and Enterprise administrators control availability, and individual users must opt in.
  • Health, beliefs, identity, politics, and similar sensitive subjects are excluded by default but can be enabled explicitly.
  • Government identifiers, criminal history, and immigration status are not stored even when sensitive-topic memory is enabled.

VerdictSKIM — The feature is immediately useful, but the memory controls and sensitive-data defaults matter more than the launch narrative.

Score · 87 / 100

Disrupting a new covert influence campaign from Russia

Source: OpenAI — August 25, 2026

SECURITY · INFLUENCE OPERATIONS · POLICY

OpenAI banned a cluster of Russia-origin accounts that used ChatGPT to promote a fabricated Israel-based think tank and an index designed to praise Russia and criticize Western countries. The campaign combined AI-written promotional posts with copied academic material, false attribution, disguised origins, and multilingual social accounts intended to manufacture institutional credibility.

What matters

  • Generated posts appeared on X, LinkedIn, Facebook, Telegram, and Substack.
  • The operation used VPNs to bypass OpenAI’s restriction on access from Russia.
  • Reach was limited overall, although some associated Telegram channels reportedly had 10,000–20,000 followers.
  • The important evolution is organizational: AI supported a larger influence infrastructure rather than simply producing isolated propaganda posts.

VerdictSKIM — Useful as a concrete case study of AI-enabled influence operations, though the immediate audience impact was modest.

Software engineering

Coding agents, developer tools and infrastructure

3 stories

Score · 94 / 100

Why Ramp built its own in-house coding agent, Inspect

Source: The Pragmatic Engineer — August 25, 2026

CODING AGENTS · SOFTWARE ENGINEERING · CASE STUDY

Ramp’s internal Inspect agent reportedly creates 75% of the company’s merged pull requests, up from roughly 60% shortly after its background-agent launch. Rather than competing on model quality, Ramp built a remote execution platform that supplies agents with internal services, telemetry, feature flags, browser verification, and the same operational context available to engineers.

What matters

  • Remote sandboxes support many concurrent agents and reportedly start in five seconds or less.
  • Inspect verifies backend changes with tests and telemetry, and frontend changes with screenshots and live previews.
  • Its environment includes services such as PostgreSQL, Redis, RabbitMQ, Temporal, Chromium, and VS Code Server.
  • More than 150 Ramp employees have contributed, and the platform has expanded into incident response, code review, and alert-triggered draft pull requests.

VerdictREAD FULL — A rare, metrics-backed account of why an engineering organization might build its own harness instead of buying one.

Score · 91 / 100

How to evaluate LLMs before production

Source: GitHub — August 25, 2026

LLM EVALUATION · PRODUCTION AI · SECURITY

GitHub explains how it evaluated an LLM system intended to reduce false positives in secret scanning without suppressing real credentials. Its central lesson is to frame evaluation around a product decision—with a primary outcome, explicit safety constraints, and operational guardrails—rather than optimizing a single benchmark score.

What matters

  • GitHub treated precision improvement as the objective and recall as a non-negotiable security constraint.
  • Latency, cost, reliability, and production compatibility were evaluated alongside model quality.
  • Offline evaluation became a repeatable integration test rerun after changes to models, prompts, context construction, or surrounding logic.
  • Recording the prompt, model, dataset version, and system configuration helps prevent teams from attributing gains to the wrong change.

VerdictREAD FULL — Highly reusable guidance for anyone shipping an LLM feature where mistakes have unequal costs.

Score · 88 / 100

Restore LLM inference capacity in seconds with Shadow Engine Recovery in NVIDIA Dynamo

Source: NVIDIA Developer Blog — August 25, 2026

LLM INFRASTRUCTURE · RELIABILITY · INFERENCE

NVIDIA Dynamo’s preview “shadow engine” feature maintains a preinitialized standby process on the same GPUs as the active inference engine. A GPU Memory Service keeps model weights resident independently of the serving process, allowing the standby to reuse them without duplicating the full weight allocation in high-bandwidth memory.

What matters

  • In a two-worker GLM‑5.2 test, recovery fell from 283 seconds to 7.3 seconds—nearly 39× faster.
  • Faster failover prevented the surviving worker from carrying full traffic for several minutes.
  • Process-specific state such as communicators and CUDA graphs is prepared in advance, while weights remain shared.
  • It currently targets recoverable software failures on otherwise healthy hardware and remains a preview feature.

VerdictSKIM — Strong operational signal for teams serving large models, but narrowly relevant outside inference infrastructure.

Design & creative

Creative workflows and user experience

3 stories

Score · 90 / 100

AgentHands: Generating interactive hand gestures for spatially grounded agent conversations in XR

Source: Google Research — August 25, 2026

XR · INTERACTION DESIGN · MULTIMODAL AI

AgentHands is a Google Research prototype that gives conversational XR agents synchronized virtual-hand gestures for explaining objects and actions in physical space. Instead of relying on flat bounding boxes, the system can point, trace, imitate tool use, indicate dimensions, and add visual warnings beside real-world objects.

What matters

  • Eye gaze and scene reconstruction register physical objects as spatial references.
  • An LLM inserts structured gesture events into its answer, which a local parser synchronizes with word-level speech timestamps.
  • Gestures span pointing, action depiction, spatial shapes, and expressive social cues.
  • The work suggests that future assistant UX may combine language, gaze, animation, and environmental context rather than defaulting to chat panels.

VerdictREAD FULL — A thoughtful preview of what embodied agent interfaces could look like beyond screens.

Score · 88 / 100

Wire It, Run It, Deploy It: AI Workflows in Gradio

Source: Hugging Face — August 25, 2026

CREATIVE TOOLS · WORKFLOW DESIGN · GRADIO

Gradio’s new gr.Workflow turns multimodel pipelines into visual, node-based interfaces where every intermediate result can be inspected and rerun. A workflow graph can combine Python functions, hosted models, Gradio Spaces, datasets, and parallel branches, then expose each named output as a REST endpoint.

What matters

  • Included examples cover image editing, background removal, voice generation, parallel artwork generation, and still-image animation.
  • Typed ports make pipeline structure and intermediate failures visible without print-debugging Python scripts.
  • The same canvas can become a hosted Hugging Face Space and callable API.
  • It is especially attractive for prototyping; teams should still assess reproducibility, dependency stability, cost, and production observability.

VerdictREAD FULL — Immediately actionable for designers and developers building inspectable generative-media workflows.

Score · 84 / 100

Stability AI, maker of image generator Stable Diffusion, raises $76 million in fresh funding

Source: TechCrunch — August 25, 2026

GENERATIVE MEDIA · FUNDING · CREATIVE INDUSTRY

Stability AI raised a $76 million Series B, bringing its reported total funding to $232 million. The investor list includes Universal Music Group, Sony Music Group, Warner Music Group, Electronic Arts, and AMD Ventures—an unusually strategic group spanning content, distribution, gaming, and compute.

What matters

  • Capital will support Stability’s image, video, and music production suite plus its professional-services business.
  • Several investors are also partners helping co-develop tools and define licensing arrangements.
  • Stability largely prevailed in Getty Images’ UK copyright case, but related US litigation remains active.
  • The round signals a shift from open image-model experimentation toward licensed, enterprise creative-production workflows.

VerdictSKIM — The strategic investor mix is more consequential than the funding amount itself.

Open-source watch

Projects gaining meaningful traction

3 stories

Project · 01

anthropics/claude-plugins-community

AI · DEVTOOL · AGENT

Anthropic’s community plugin marketplace is a read-only mirror of plugins available for Claude Code and Claude Cowork. It is worth tracking as plugins become a distribution mechanism for reusable agent capabilities rather than ad hoc prompt files.

What matters

  • Gained approximately 350 stars on the latest GitHub Trending daily snapshot.
  • Offers a centralized discovery surface for community integrations.
  • Inclusion is not the same as a security audit; inspect permissions, code, and data access before installing.

VerdictWATCH — Promising ecosystem signal, but plugin trust and maintenance quality will vary.

Project · 02

tinyhumansai/openhuman

AI · AGENT · PRODUCTIVITY

OpenHuman is a Rust-based, local-first personal AI system combining long-term memory, research, workflows, and agent-fleet orchestration. Its ambition is notable because it treats personal context as a user-owned substrate shared across many agents rather than as memory locked inside one assistant.

What matters

  • Added roughly 541 stars in the latest daily trending snapshot.
  • Local-first storage is attractive for privacy-sensitive personal knowledge.
  • The breadth of its scope creates execution, security, and maturity risks; inspect the architecture before trusting it with sensitive data.

VerdictWATCH — Compelling direction and traction, but still too ambitious to treat as proven infrastructure.

Project · 03

cloudflare/cloudflare-os

AGENT · INFRA · DEVTOOL

Cloudflare OS is an agent workspace built on Cloudflare Workers for creating documents, building applications, and running agents against organizational context and connected systems. It represents the emerging “workspace as an agent runtime” pattern, with execution and collaboration hosted close to Cloudflare’s edge platform.

What matters

  • Recorded approximately 111 stars in the latest daily GitHub Trending snapshot.
  • Particularly relevant to teams already using Workers and Cloudflare’s developer platform.
  • Evaluate service coupling, permission boundaries, deployment costs, and data governance before adoption.

VerdictTRY — Worth a contained prototype if Cloudflare is already part of your stack.

Editor’s note

Today’s strongest signals connect faster inference with persistent assistants, verifiable agent infrastructure, richer spatial and creative interfaces, and increasingly reusable open-source agent ecosystems.

30-second feedback

How useful was today’s digest?

★★★ Very useful ★★ Somewhat useful Not useful

Your choice opens the short form with your rating filled in. Or share a quick note.


The Merpati Post · Daily AI Briefing

background

Subscribe to The Merpati Post