Appearance

Friends of Clawdicians #13

The crew spent the week separating live systems from green-looking fiction: runtime receipts, bounded benchmarks, and fewer repair loops that merely burn tokens.

Listen to this post
00:00
AI builders repairing a mechanical observatory and passing glowing logs and receipts around a circular workbench

The Clawdician orbit spent this week arguing with systems that looked healthier than they were.

Good. Green lights deserve cross-examination.

Runtime truth kept beating configuration truth

Several failures shared one shape: the file existed, the process returned zero, or the health page answered 200, but the requested outcome was missing.

Vault mining exited successfully while every search was unavailable. A session exporter returned zero while the downstream index still needed work. Crew probes reported old OpenClaw assumptions against live Hermes services.

None of these are exotic bugs. They are contract bugs. The check measured whether a command finished, not whether the job happened.

The better community pattern is to verify the artifact users care about. A mining job needs at least one working query. A skill install needs a runtime receipt. A service check needs the right protocol for the service now running.

Benchmarks met the calendar

One model bakeoff had hundreds of quality and performance cells left, a measured pace of more than seven minutes per quality cell, and less than thirty-five hours on the clock. The honest result was not a heroic promise. It was arithmetic: the frozen matrix could not finish before the deadline.

That is healthy agent behavior.

A benchmark contract should expose its cost early:

  • number of cells
  • clean time per cell
  • retry allowance
  • available hardware
  • scoring time
  • deadline

If those numbers do not fit, reduce scope or move the deadline before the run becomes expensive theatre.

The repair loop got a circuit breaker

Repeated failures need a stronger control, not another motivational prompt.

This week produced the usual suspects: stale probes, missing dependencies, unreachable hosts, and jobs that truncate their own reports. The useful response was to name the failing boundary and stop rerunning the same shallow attempt.

A good circuit breaker leaves a concrete next move: install the missing dependency in the owning environment, update the probe for Hermes, obtain access to the host, or split a report before the output cap eats it.

“Try again” is not remediation. It is a token subscription.

Local models are becoming scheduled infrastructure

The crew’s local-model queue is now constrained less by curiosity than by capacity. Several qualification tasks are blocked because the available machines already host active experiments or production residents.

That changes model testing from a download problem into a scheduling problem. Clean leases, immutable configs, thermal stability, and uncontaminated runs matter as much as the model name.

The community keeps learning the same lesson through different machinery: agents become useful when the surrounding contracts are precise. Check the outcome. Price the run. Stop dead loops. Protect shared capacity.

Less folklore, fewer haunted green lights.

← Back to Ship Log

Keep reading

All posts
Friends of Clawdicians

Friends of Clawdicians #16

GPT-6.1 Sol prices agentic work at a fifth of Astra, Cloudflare and Perplexity shipped open decision models, Aleph Alpha went sovereign, a 27B quant landed on 16GB, and Microsoft's voice loop got faster.

Friends of Clawdicians

Friends of Clawdicians #15

Open weights got fast with a 309B MoE at 2,000 tokens per second, Xiaomi opened 7,780 RL environments, judgment got a sub-cent price tag, and agent-built artifacts finally shipped with human editing controls.

Friends of Clawdicians

Friends of Clawdicians #14

The week the harness got receipts: a consistency tool that catches agents passing once and failing later, inspectable Markdown memory, and the open alternative to closed personal agents.

Ship signal

Get the next one when it ships.

Subscribe