01 / Conversation-to-Idea Pipeline

Recorded speech → attributed transcripts → cited idea map

Continuous capture and synthesis running across a home NAS and a shared GPU host over Tailscale—scheduled opportunistically without cron delays.

stage 01 · capture Pendant & Mac audio Consented BLE pendant & dual-channel macOS capture; raw audio stays on the tailnet.
stage 02 · hearsay Transcribe & attribute Parakeet ASR + pyannote diarization → versioned JSONL utterance stream.
stage 03 · ideamachine Segment & extract Content-addressed uuid5 episodes, pseudonymized Claude mining, pgvector links.
stage 04 · schema pub im web & MCP Read-only Postgres role serving themes, cards, and verbatim transcript spans.
Python 3.13 Postgres 16 + pgvector Claude SDK sentence-transformers

Most recorded speech is small talk. Idea Machine groups Hearsay’s utterance stream into content-addressed episodes, extracts ideas, tasks, and decisions with exact line citations, and relates each idea to prior ones across themes.

  • Deterministic rebuilds: Every derived row records code, model, and prompt version; human verdicts anchor to transcript segments so they survive re-segmentation.
  • Pseudonymized & budgeted egress: Speakers map locally to me, S1, S2 per request, gated by a pre-flight monthly spend cap.
  • Measured, then simplified: Cheap triage routers were benchmarked against hand labels, then retired once replay data proved routing wasn’t earning its keep.
im web · role: pub (read-only) theme / bounded-agents
idea · ep:8f3a1c (uuid5) verdict: kept
Keep diagnostic pacing at one question per turn so the operator owns hypothesis selection.
“[me · turn 142] When the tool runs for forty minutes and dumps five pages, nobody reads it on a bridge—ask one check, wait for the output.”
linked → compa: non-diagnosing posture (0.86) · hypertrace: code-owned verdicts (0.79)
decision · ep:41b90e (uuid5) ADR-0014
Retire pre-extraction triage router after replay benchmark showed net negative value vs. direct batching.
“[me · turn 038] If the classifier drops even three real ideas to save forty cents a week, the router is the bug.”
Python Swift (iOS/macOS) Parakeet pyannote

Turns consented recordings from a BLE pendant and Mac capture into speaker-attributed transcripts. Raw audio never leaves the tailnet.

Precision-first owner voice attribution, deterministic rebuilds from raw uploads, and a versioned stream contract with deletion propagation.

Python GPU & NAS Scheduling

Priority job scheduler for opportunistic local compute across gpu and nas workers—driving Hearsay transcription and Idea Machine runs.

Priority aging, burst coalescing (wait_seconds), persistent worker pause, and automatic yield when an interactive process claims the GPU.

02 / Support-Case Triage

Evidence-checked investigation over diagnostic archives

Go Sandboxed Tools Secret Redaction Vertex AI / OpenRouter

A terminal companion in Go for investigating support cases and unpacked diagnostic bundles. Out of the box it makes zero network calls; when connected to a model, every file read runs through deterministic sandboxed tools and secrets are redacted before leaving the host.

  • compa-engine: Go library owning sandboxed collection, cache-friendly conversation ordering, redaction, digest-pinned bundles, and evidence checks.
  • compa-experts: Embedded domain experts, file-inspection catalogs, and routing rules.
  • Human-owned conclusions: Compa states what the data shows, what remains open, and what artifact settles it—it never diagnoses or posts to a case.
compa · case: 03948120 (sandbox: ro, egress: off) go
$ compa case open 03948120 archive: must-gather.local.8412/ (1,418 files indexed, 0 network calls) experts: openshift-networking@sha256:9c4e..., etcd-quorum@sha256:31a0... case> check ovnkube-node restarts against apiserver TLS errors [tool: inspect_pod_logs] redacted 2 bearer tokens, 1 client key [verified] 3/3 citations matched byte spans in archive Observed: - ovnkube-node-7xk2p logged x509 expired cert at 14:02:11Z [cite: namespaces/openshift-ovn-kubernetes/.../current.log:418] Open: - Current signer rotation ConfigMap is absent from this bundle; request openshift-config-managed/kube-apiserver-aggregator-client-ca.
03 / Bounded Research & Local Speech

Smaller harnesses and zero-API audio tools

Python SQLite

Bounded web-research harness where an LLM proposes searches, but code decides what qualifies as evidence.

Verbatim byte-offset quote checks in article bodies, adversarial review, per-attempt cost accounting, and code-written "Inconclusive" verdicts.

Python Parakeet ONNX Silero VAD

Local GPU speech server for real-time voice chat over Tailscale speaking the OpenAI Realtime protocol.

Read-back-only server that refuses ungrounded replies, cancels cleanly on barge-in, shares the GPU with corral, and voices via chimera-tts.

TypeScript Vocal-Tract Synth

Text-to-speech voice and browser chat built on a physical vocal-tract synthesizer rather than neural TTS.

Pitch and rhythm learned from speech recordings over an unpatched synth, Markdown-to-speech normalizer, zero GPU or API key.