The Nature of Information

Try to deny it. Say there is no information.

The saying is a record. A distinction, made, held — in air, in pixels, in a neural pattern. It has a history. Read it back and you recover the saying. The denial is the information that the denial occurred.

There is no outside to step to. You are already inside the thing the question asks about.

Two jars of water. Identical. Swap them and nothing changes.

One grain of sand falls into the left jar.

Four things happened at once. There was a symmetry to break — S. It was broken by the smallest possible element — B. The break left a trace that does not undo itself — R. The trace is in this jar, on this table, not everywhere — C.

Two jars, one grain, four conditions. This image runs through the whole book.

And the grain is the bit.

The bit — the minimum committed binary record, the unit Shannon counted with — is one grain. One asymmetry. One ε. A bit is what one minimum break amounts to, named at the information layer.

Below ε there is no record. There is the unbroken one-to-one. No half-grain. No quarter-bit. A distinction either holds or it does not.

That does not deny fractional Shannon measures. A channel can carry half a bit on average. A distribution can have fractional entropy. Those are averages over many possible records. They are not half-records. At the layer of what exists, a distinction has committed or it has not.

Aristotle split form from matter. The statue carries a shape the bronze does not. That was the first attempt to name what a record holds beyond the holding.

Boole made symbols manipulable without reference to what they meant. Logic became syntax.

Shannon, in 1948, made it precise. Information is the reduction of uncertainty. Resolve one of two equal options and you have one bit. He counted the reduction and bracketed the meaning. Engineers built telephones on it.

Landauer, in 1961, showed that erasing one bit costs a minimum amount of heat. Small. Not zero. Information is physical.

Wheeler said it from bit. Particles, fields, spacetime are derivative. The substrate is information.

Five angles on one thing. None reached it.

Count it. Shannon’s measure is not wrong. It is disciplined. It brackets meaning and history on purpose, and that discipline made communication engineering possible. But a book and a pile of random letters with the same statistics carry the same Shannon information. You know they do not. The measure counts one shadow.

Make it meaning. The book is about something. The letters are not. But meaning has to come from somewhere, and that somewhere is usually a reader. Fingerprints existed on glasses before forensic science. Photographs sit on drives nobody has opened. The world manages information without an interpreter. Meaning is real, and meaning is later.

Make it fundamental. Wheeler saw the direction — information is structural, not added. Then he stopped at making it primitive. If information is more fundamental than physics, what does information live in? A question answered by a deeper question.

Eliminate it. Information is just a word for physical state. The fingerprint is lipids on glass. Calling that information adds nothing. But then why do some configurations function as records of other configurations, and some not? They just do is a refusal.

Measured. Semanticised. Made fundamental. Eliminated. Not dissolved.

For the question to have force, information must be separate from the record — at least conceptually. Otherwise what is information is just what is a record.

That separation cannot hold.

A record is a distinction made and held. The fingerprint is the pattern that distinguishes this glass from the same glass without it, and the pattern does not undo itself.

A record is not a thing to which information has been added. A record is a thing whose existence is the having-been-distinguished. The distinction and its persistence are not something the record has. They are what the record is.

Information is what that amounts to, read as a history.

Three pieces, each doing work.

History, because R gives the record a direction. The moment the grain dropped is preserved in the structure. History is not a metaphor. It is what R does — the past kept readable from the present.

The record, because there is nothing further the record carries. The fingerprint is not the lipids plus a ghost about who left it. Strip the configuration away and there is no information left to find.

Read, because history is what becomes legible when the structure is examined. Without reading, the structure is there and the history is implicit. With reading, what was implicit becomes explicit in the reader.

Information is the record history, literally. The carrier is the carrying.

Each of the four readings imported a separation the structure does not contain. Shannon: symbol from meaning. Semantics: substrate from interpreter. Wheeler: information from structure. Elimination: closed the gap by denying one side. The dissolution closes the question by closing the separation.

The word carry can now be retired.

The same sentence can be ink, sound, pixels, magnetism, voltage, Braille, clay. Does that not show information is separate from any record?

No. Seven substrates are seven records, alike at the layer that matters for the sentence. What persists is a pattern that any of the seven preserves and reading any of them recovers. The pattern lives in each record. Strip the records away and there is no invariant left.

Substrate independence is not substrate absence. It is repeatability.

Is this only a renaming? Landauer says no.

Erasing one bit costs at least kT ln 2. At room temperature that is about 2.87 × 10⁻²¹ joules. Lifting one grain of salt one millimetre takes a thousand billion times more. Small at every scale a body knows. Never zero.

On the syntactic account, that is a coincidence. Why should an abstract quantity have a heat cost?

On the semantic account, a mystery. Why this amount, whatever the meaning?

On Wheeler’s, comfortable but retrofitted.

On elimination, unmysterious and uninformative.

On the dissolution, expected.

The bound applies to logically irreversible erasure — forcing a system that could be in either of two states into one. Reversible operations do not pay it. What is paid for is forcing two distinguishable possibilities into one.

That is exactly what trying to undo R locally requires. Not making the past unhappen — nothing does that. Destroying local access to the distinction. Pushing the grain back out of the jar. R does not allow that for free. It allows the cost to be paid elsewhere, as heat exported to the environment.

So there must be a minimum, and it must be non-zero. R produces that directly.

What R does not produce is the value. The ln 2 is the entropy of one binary distinction, and binary follows from the break being binary. That much is earned. The k and the T come from statistical mechanics — how energy spreads across many constituents at a temperature. The four conditions have not derived that here. Some of it is done in the formal papers. The rest is a named debt.

The bound exists because R. The log of two because the break is binary. The thermal factor because the world has temperature.

If information were a carried thing, throwing it away would not disturb the carrier. The cost shows the separation is not there.

You, reading, are a site where record history is being written. Eyes scan. Light enters. The configuration that was your brain a moment ago is not the one that is your brain now. A distinction was made and held.

You are also the grain.

The image of a grain of sand has always been used for smallness — one life against deep time. True, at the register of comparison.

At the register of the axiom, we are not just grains of sand in the desert. We are all the grain. Each of us is a site where the symmetry is broken, where the +ε is happening, where ε is currently located.

You are not in the desert. You are the grain making the desert distinguishable from itself.

Shannon’s measure stands at its layer. So do algorithmic information, channel capacity, error correction. The chapter has located their object, not refuted them.

The kT in Landauer’s bound is not derived from the four conditions. Open work.

The qubit is a record whose distinction has not yet committed. Information there is the structure of the superposition, read as history. The identification appears to extend. It has not been worked through at this precision. Entanglement, no-cloning, decoherence as commitment — each needs its own treatment.

Meaning is real and is not just information. It is the relation a record has to other records and to the operators that read it. Later chapters.