Skip to content

Commit 51018ef

Browse files
committed
knowledge: rotation vs error correction summary
1 parent a37d0ca commit 51018ef

1 file changed

Lines changed: 21 additions & 0 deletions

File tree

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,21 @@
1+
# Rotation vs Error Correction
2+
3+
## Core Finding (2026-03-26)
4+
5+
Google TurboQuant (ICLR 2026) validates bgz17's design choices independently:
6+
7+
- **Rotation before quantization**: TurboQuant uses Hadamard → Polar. bgz17 uses Euler-Gamma bundle rotation (Fujifilm X-Sensor). Same effect (overhead-free distribution equalization), different mechanism (geometry vs number theory).
8+
9+
- **No error correction needed**: TurboQuant requires QJL (1-bit sign correction) because uniform quantization creates boundary bias. bgz17 does NOT need this because Fibonacci codebook entries sit at 1/4σ discrete positions with 3σ inter-qualia separation (99.73% assignment accuracy).
10+
11+
- **No POPCOUNT needed**: Fibonacci encoding makes bits non-uniform (bit 4 = 8× bit 0). Hamming distance (POPCOUNT) would be wrong. Table lookup (`vpshufb`/`vtbl`) is both correct AND faster, and runs on any CPU since 2013.
12+
13+
## Key Implication for ndarray
14+
15+
All bgz17 distance kernels use `vpshufb` (AVX2) or `vtbl` (NEON) table lookups.
16+
No VPOPCNTDQ (AVX-512 Ice Lake+) dependency. No FP arithmetic for distance.
17+
NPU-compatible: INT8 table lookup is the NPU's native operation.
18+
19+
## Full Spec
20+
21+
See `docs/ROTATION_VS_ERROR_CORRECTION.md`

0 commit comments

Comments
 (0)