Intelligence as High-Dimensional Coherence: The Observable Dimensionality Bound and Computational Tractability
Ian Todd
Sydney Medical School, University of Sydney, Australia
Abstract
This paper proposes high-dimensional coherent dynamics as an architecture for adaptive control under finite observation and action bandwidth. In its tracking model, resolving a target with effective dimensionality at a stated error and timescale requires channel capacity that scales with the information needed per tracked mode. Crossing that model-dependent capacity threshold makes full-state tracking operationally inaccessible to that observer. The result is not ontological unmeasurability, a definition of intelligence, or a proof that biological realization is universally more efficient than digital realization. Its value is a concrete hypothesis: compare implementations by the distinctions, intervention responses, energy costs, and task performance they preserve.
1. Introduction
The paper studies whether high-dimensional continuous dynamics can support adaptive control when observation and action channels are restricted. This is one proposed architecture, not a necessary definition of intelligence or a theorem of thermodynamic optimality.
What does high-dimensional continuous computation enable?
-
Concurrent candidate configurations. A high-dimensional state can carry several task-relevant variables without forcing them into one scalar decision before action.
-
Functional noise in specified regimes. Stochastic resonance and noise-assisted barrier crossing show that fluctuations can contribute to an operation rather than merely corrupt it.
-
Physical relaxation as an algorithmic resource. Some optimization problems benefit from continuous relaxation, although no generic intractable problem becomes tractable merely by using continuous dynamics.
-
Implementation-level trade-offs. Energy use depends on the physical dynamics, maintenance, noise, error tolerance, and output requirements; dimension alone does not determine it.
2. The Observable Dimensionality Bound
The paper defines a tracking-capacity relationship between dimensionality, measurement bandwidth, and temporal resolution:
where is the observation channel capacity (bits/s), is the evolution timescale, is the minimum bits per mode per to track geometry, and captures compressibility.
When under these assumptions, the chosen observer lacks the budget to track every modeled mode at the target precision. This is a protocol-relative boundary. Compressibility, prior structure, sufficient statistics, and task-specific prediction can change the requirement.
3. A Model-Conditional Tracking Criterion
Consider a target system represented by independently tracked modes. Let an external observer with channel capacity attempt full-state tracking at error tolerance over evolution time . If the model assigns a per-mode description requirement and compressibility factor , then its bookkeeping criterion is:
-
If , the stated capacity budget does not by itself rule out full-mode tracking.
-
If , that particular full-mode code exceeds the stated budget.
This is not a necessary-and-sufficient theorem for prediction or observation. A task may require only sufficient statistics; modes may be dependent or compressible; priors and active sensing may reduce the rate; and effective dimension depends on representation and scale. The criterion becomes testable only after those quantities and the tracking task are operationally fixed.
An embedded controller need not reconstruct its own full microstate through the same external channel, but it still faces sensing, communication, noise, and control limits. “Being the substrate” does not remove physical measurement or information-processing constraints.
4. Conditional code formation at structured interfaces
Dimensional mismatch alone does not force stable or discrete codes. A low-dimensional channel can remain continuous and may even preserve global identity. Code formation requires additional structure: for example, an explicitly many-to-one or finite-resolution readout, repeated coordination tasks, and a learning or stabilization process that makes some equivalence classes reusable.
If and 's behaviorally relevant dynamics repeatedly occupy structured regions , then may learn task-relative labels for those regions. When such labels are deliberately discretized, the effective description length can fall from that needed to track to roughly .
Interpretation: Limited channels can encourage useful codes, including language and gesture, because repeated task-relevant equivalence classes are cheaper to communicate than full internal states. This is a conditional mechanism, not a theorem that dimensional reduction makes symbolic discreteness inevitable.
5. Worked Example: Human Cortex
MEG source reconstruction yields hundreds of cortical parcels (–) coupling across frequency bands (–). A conservative estimate of effective dimensionality:
For mid-range parameters ( bits/s, s):
Therefore, under the stated mid-range parameters, . This illustrates the model's sensitivity to observer bandwidth; it is not a substrate-independent estimate of how much cortex is knowable.
6. Conclusion
Biological brains and present-day AI systems differ in task, training history, hardware, precision, and energy accounting, so headline power ratios do not isolate one mechanism. The paper's hypothesis is that physical organization and the placement of observation and commitment boundaries contribute to those differences.
Lossless compression of an arbitrary source is constrained by its structure and entropy, while task-specific summaries may preserve what a controller needs. “High-dimensional” does not mean incompressible without a stated source class and error criterion.
Clocked and asynchronous digital systems, analog devices, and biological oscillators all support varied internal dynamics. The empirical comparison should ask which intervention responses, noise tolerances, latencies, and energy costs each realization achieves on the same task.