Spectra & Decisions
The question. Can the eigen-spectrum of a relation or covariance matrix be read as a decision instrument — with random matrix theory as the null model that separates signal from noise — across business data, L-functions, and statistical mechanics alike?
Eigenvalues quietly run high-dimensional data, prime numbers, and physics. Can they run a decision?
The bet
Eigendecomposition is already the engine under PCA and high-dimensional analysis, under the Montgomery–Dyson link between Riemann zeta zeros and the eigenvalue spacings of random Hermitian matrices, and under spectral methods in physics. The bet is that one lens — the spectrum, read against its random-matrix null — gives a principled, transferable way to tell structure from noise, and to act on it.
The framing is process-relational (it shares a substrate with P9): the objects are relations and actions — operators — not static things. We read the world through what transforms, and the invariants are spectral. Mental formulations and mental objects, with no birth or death; only morphisms.
The setup
Definitions first — the part that has to be precise before any computation is allowed to mean anything.
The method — what actually gets run
- Build covariance / relation matrices from a real high-dimensional dataset.
- Compare the empirical spectrum to the Marchenko–Pastur / Tracy–Widom null.
- Keep only eigen-directions past the null edge; test whether decisions built on them beat ad-hoc thresholds.
- Probe the Montgomery–Dyson bridge: do GUE spacing statistics describe a concrete empirical operator, not just zeta zeros?
Open questions (honestly open)
These aren't rhetorical. Each is a place the project could still be a metaphor instead of a result.
- S1: eigenvalues beyond the Marchenko–Pastur edge identify decision-relevant factors more robustly than scree-plot rules of thumb.
- S2: the GUE spacing statistics matching zeta zeros also describe some real empirical operator — a bridge, not an analogy.
- Q: is “reading the world through morphisms and actions” formalisable as operators whose spectra are the invariants? (shared with P9)
Key formulas
Marchenko–Pastur upper edge: eigenvalues above it are signal; below, indistinguishable from noise.
Consecutive spacing ratio (no unfolding needed). Mean ⟨r⟩: Poisson 0.386, GOE 0.536, GUE 0.600, rigid → 1.
Wigner surmise (GUE): level repulsion — P(s) vanishes as s → 0. The law the Riemann zeros follow.