Just shipped a CPU-only lattice that runs 50 million persistent nodes on an 8 GB Orin Nano:
-
186 ns hot-path latency (≤ 3.2 cycles steady-state)
-
33× larger than RAM (disk-backed streaming)
-
Full crash & power-loss recovery — literally yanked the cable mid-run, everything came back instantly
-
Redis RESP compatible drop-in (100 % test pass)
We built it because every edge system we tried either lost state on power cut or slowed to milliseconds once RAM filled up.
Curious if anyone here has ever seen numbers close to this on Jetson hardware without a GPU.
Happy to run it live on anyone’s board or share perf/cachegrind traces if you want to break it.
Joseph & Ryan