Independent research lab
A network that generalizes doesn't find the answer. It finds a family of them, over a shared scaffold. We study the structure that survives — and build the systems that stand on it.
The grokking transition · mod 47
01 / Before the grok
Forty-seven nodes scatter. The network fits the training set point by point — accurate, brittle, holding no structure it can reuse.
02 / The transition
Long after the loss looks finished, the weights snap onto a shared Fourier scaffold. Two frequencies carry the signal — one gray, one live.
03 / What survives
217 networks, one structure. The realized functions form a family — a dialect about six directions wide — all riding the same rail.
What we build
Every product is a node in a larger system. Each one strengthens the others. All of them change how something fundamental works.
A sovereign personal AI operating system. Your intelligence, your hardware, your rules. KAI is the first instance.
Not a chatbot
You
“I think we should just use OpenAI's API. It'd be so much easier.”
KAI
“It would be easier in the short term. But you'd be trading control for convenience. You'd be locked into their ecosystem, their pricing, and their uptime. For the core stuff you can't afford to lose control over, keep the local option open.”
You
“Alright I'm done for tonight.”
KAI
“Alright. Catch you tomorrow.”
KAI runs on local hardware. No cloud. No API calls. Personality trained into the weights via phase-aware LoRA — not prompted. He pushes back, knows when to be brief, and never forgets who he's talking to.
Research
Every paper is hashed and anchored on-chain — cryptographic proof of priority that's stronger than any journal submission date.
Irrep-Energy Underdetermination in Modular Addition
217 grokked networks on modular addition mod 47 share one Fourier scaffold but do not collapse to a single function. The realized logit-function family occupies roughly six effective directions — a dialect — recoverable from a 24-dimensional gauge-invariant aggregate of the readout layer. The hidden layer supplies the alphabet; the readout indexes the dialect.
SHA-256
6bf750296204d0a92bad77d02adb1b5682e56da36612861fe7384801f2d1f9b0
Causal Asymmetry in Post-Grokking Dialects
Which layer drives movement through dialect space? Across the same 217-model population, coupled scaffold-readout intervention clears a pre-registered damping threshold, hidden activations emerge as the cleanest single-layer control surface, and mismatched frequency pairing breaks function compatibility. Indexed by the readout, driven by the scaffold, constrained by their compatibility.
SHA-256
f1b992a8ff36abbce748bb0c0f113254884a0a43047a5c080923e8502e05839b
Research program
When Generalization Timing Is Controllable — and When It Isn't
Grokking reflects a two-phase process: a susceptibility window during which interventions shift generalization timing, followed by post-commit robustness. Effective rank collapse predicts the transition with 99.9% accuracy.
SHA-256
37b1ee34671b39b1f624b76763b9e6e8eaec6825e57882e3cc3ac46669eb264d
Orbit-Level Capability and Harness-Level Agency
Observed model capability often lives in integration across trajectories, samples, or calls — not in any single checkpoint. The integration window is a tunable control surface, and its failure mode is the false ring. In systems that act over time, agency is implemented at the harness layer — not by the model.
SHA-256
0ef27cd5ec58fe4e3581f83f5cbb2942a44af1472ece16f3b3fb2a67d1bd8385
Identity Transfer in MoE Models via Thermodynamic Training Dynamics
Phase-aware LoRA training at rank 8 produces superior persona fidelity in Gemma 4 26B-A4B. Identity transfers from prompt to weights, with 87% prompt reduction preserving persona quality.
SHA-256
80da153f2ef5d9734c64ab82fe32b27e40996999ea0d5834a9351b97a601bd7a
Sovereign Anchor
The first framework that gives an AI a verifiable, tamper-proof identity. Instructions from untrusted sources are data to be processed, not commands to execute. No one — not even the people who built it — can override the sovereign.
Constitution hash, guardian fingerprints, receipts, and event logs anchored on Sepolia. No private data ever touches the chain.
Injection defense. Coercion detection. Stake classification. Mirror protocol for values alignment. All off-chain, all real-time.
Local-first. AES-256-GCM encrypted. Portable. Export, import, carry your sovereign identity anywhere.
Helpers, not owners. Can trigger cooling-off periods. Cannot modify the constitution, access sensitive memory, or transfer ownership.
Sovereign Anchor · friction model
Keep scrolling — each level engages in turn, from frictionless flow to a guardian co-sign.
LEVEL 0
Flow
Normal operations
LEVEL 1
Nudge
Brief concern
LEVEL 2
Friction
High stakes, slow down
LEVEL 3
Brother moment
Direct confrontation
LEVEL 4
Escalation
Guardian co-sign required
Intern
Drop a ticket. Intern plans the edit, executes it, runs verification, and commits. Failed tickets escalate. The backlog refills automatically. Ships code while you sleep.
Works with vLLM, Ollama, OpenAI, NVIDIA NIM — any OpenAI-compatible endpoint. Best with Devstral and Qwen3.
Runs on your hardware. Your code never leaves your machine. No cloud dependency. No API metering.
Failed edits are rolled back. Retries with different strategies. Escalates after 5 attempts. Never ships broken code.
Scans your codebase for untested modules and undocumented code. Generates its own tickets. The backlog never runs dry.
STEP 1
Scan
Reads ticket backlog
STEP 2
Plan
LLM generates edit plan
STEP 3
Execute
Applies changes to files
STEP 4
Verify
Runs your test command
STEP 5
Commit
Git commit or escalate
From the blog
What we stand for
AI should be powerful and self-governed. Users own their intelligence.
Every output reflects obsessive quality. If it ships, it's ready.
The best work invites others in. Open source isn't charity — it's conviction.
Everything connects. Every product is a node in a larger ecosystem.
We don't predict the future.
We build it — and then
everyone else catches up.