Skip to the essay
Two small wooden boats carry separate warm lanterns across a broad river at dusk. The boats are close enough to see one another, but one meets a calm side channel while the other enters faster water.

The River Between Us

Minds, drift, repair, and the art of staying in contact

Two people can share a life without sharing a view. A guide to trust, drift, repair, boundaries, and how separate people find a direction they can both live with.

Close enough to see each other’s light does not mean feeling the same current.

A field guide to connection and alignment

No one gets the whole river.

Imagine two small boats at dusk, close enough to see each other’s lanterns and not close enough to share a steering wheel. They move through one river. Yet one meets fast water while the other passes behind a sheltered bend. Each carries a private map. Each leaves a wake the other must cross.

This is a guide to what happens between people while everything—including the people—keeps changing. It is about friendship, family, love, classrooms, teams, and institutions. It is also about alignment: how separate agents with incomplete information, changing goals, and unequal power can sometimes build a direction that remains workable for more than one.

The river metaphor gives us a place to stand, but it will not be allowed to do work it cannot do. People are not machines, objectives, or interchangeable vessels. Emotions are not noise. Power is not just another current. Some distance can be repaired; some must be respected; some situations require safety rather than mutual adjustment.

Read the main path as a human story. Open Go deeper when you want the psychology, systems theory, or AI-alignment connection beneath it.

Keep the levels distinct

How to read the evidence labels

A person is not a control system. Open this key when a chapter moves from lived experience into evidence, analogy, models, alignment, or ethics.

Lived
A recognizable human pattern used to build intuition, not a universal law.
Studied
A claim connected to relationship or psychological research, with limits on generalization.
Analogy
A systems idea that clarifies one feature while leaving much of human life outside the model.
Model
A precise technical framework whose definitions should not be mistaken for a complete description of people.
Connection
A disciplined comparison to AI or multi-agent alignment, not a claim that the domains are identical.
Boundary
A moral limit: dignity, autonomy, power, refusal, and safety constrain what coordination may demand.

One world, partial contact

Lived experience

The same river, different water

How can two sincere people describe the same moment differently?

Two small boats travel side by side at dusk. From one boat, the water looks calm. From the other, a submerged branch keeps striking the hull. The first person says, “We are safe—why are you steering so sharply?” The second says, “How can you not feel what is happening?” Neither is inventing the river. Neither is receiving all of it.

Human conflict often begins here, before anyone chooses cruelty or deception. We share a room, a conversation, a family, or a project, yet the situation reaches each of us differently. One person hears an ordinary question. Another hears the question after a sleepless night, a humiliating meeting, or ten earlier moments in which the same tone meant danger. The event is shared. Its pressure is not evenly distributed.

We are tempted to think that fairness requires one correct view and one mistaken view. Sometimes that is true: memory fails, evidence conflicts, and people can lie. But disagreement alone does not prove bad faith. A person can report accurately from a limited position. The useful first move is not to surrender judgment; it is to ask what each position makes visible and what it hides.

The river is everything changing around and within the encounter: time, illness, money, culture, luck, power, fatigue, prior promises, and the consequences already in motion. Attention lets a person notice more of that water. It does not lift anyone into a complete view from the sky. Even excellent attention remains located inside one body and one history.

This gives us the essay’s first discipline: separate truthfulness from completeness. A truthful report may still be incomplete. A confident report may be both incomplete and wrong. Staying in contact means treating another person’s experience as evidence without treating every interpretation as automatically correct.

Worked example

The cancelled dinner

Two friends cancel the same dinner in their minds for different reasons: one sees an overloaded week, while the other sees the fourth cancellation in two months.

  1. Name the shared event: tonight’s plan will not happen.
  2. Name each local current: exhaustion for one friend; accumulated uncertainty for the other.
  3. Separate observation from interpretation: “four cancellations” is different from “you no longer care.”
  4. Ask what new evidence would help: a revised plan, an honest limit, or a pattern that changes over time.

What it showsOne event can be small in one local history and large in another. Coordination improves when both histories enter the conversation.

Carry this forward

Before deciding whose story wins, ask what water each person can feel from where they are.

Pause and predict

A parent says a teenager’s room is “not a big deal.” The teenager says entering it without asking feels like a serious violation.

Would more careful observation necessarily make them agree?
Reveal what follows
What follows
No. Better observation may clarify the same facts while revealing that they assign different importance to privacy, authority, and care.
The hidden variable
The disagreement may concern values and power, not merely missing information.
The principle
Shared evidence can reduce confusion without producing identical priorities.
Where it stops
Understanding another person’s reason does not require accepting every demand or abandoning a legitimate boundary.
Go deeperPartial observability without turning people into machines

Decision theory gives a precise name to one small part of this problem: acting when the state of the world cannot be seen directly.

In a partially observable model, an agent receives observations generated by a hidden, changing state. It carries a provisional belief about that state and updates the belief as new evidence arrives. Feedback control adds a related question: how should new observations change the next action? Together, these ideas help explain why one message or gesture cannot reveal an entire relationship.

The comparison stops quickly. A person is not a state-estimation device or a control system. Human observations carry feeling, meaning, memory, dignity, and unequal risk. The formal model clarifies incomplete information; it does not tell us what another person deserves or reduce experience to a probability distribution.

Partial observability
The relevant situation exists, but no participant can directly see all of it.
Belief state
A formal summary of what an agent currently considers possible, not a synonym for a human inner life.
Nonstationarity
The process itself changes, so an old pattern may stop predicting what happens next.

SourcesPlanning and Acting in Partially Observable Stochastic DomainsCybernetics: Or Control and Communication in the Animal and the Machine

The model is not the person

Evidence

Every boat carries a private map

What do we miss when we confuse someone with our picture of them?

A child comes home unusually quiet. A parent sees defiance and begins a lecture. The child is replaying a moment at school and trying not to cry. The parent responds to a map—“withdrawal means disrespect”—while the person in front of them is living somewhere else.

We never meet another mind without a model. We infer from faces, timing, words, habits, and what happened before. The model is necessary; without it, every action would be a surprise. Trouble begins when the model becomes invisible to us—when “my explanation of you” quietly turns into “you.”

A private map includes needs, fears, hopes, bodily states, learned expectations, and constraints that may be difficult to explain even to oneself. It also includes values: what feels worth protecting, what counts as danger, and what kind of future seems possible. Some parts can be shared. Some remain wordless. Some change before language catches up.

Responsiveness begins with an attitude of revisability. It says: I will act on the best map I have, but I will leave room for your correction. Feeling understood does not require another person to predict us perfectly. It often begins when their picture can move in response to what we tell them.

That is different from endless uncertainty. We still judge patterns. If someone repeatedly breaks a promise, the evidence matters. Keeping the map open does not mean erasing the roads already drawn; it means allowing new evidence to refine them rather than forcing every event into the oldest story.

Two honest reports can differ because each person samples a different part of the situation.

Worked example

Three descriptions of silence

A colleague goes quiet in a meeting. Three explanations arrive immediately: disagreement, confusion, or fear of speaking.

  1. Mark all three as hypotheses rather than facts.
  2. Look for discriminating evidence: what happened before the silence, and what follows it?
  3. Ask a low-pressure question that permits correction instead of demanding a confession.
  4. Update the working map while remembering that one answer may not reveal the whole state.

What it showsA useful model guides attention and remains corrigible. A rigid model selects only the evidence that keeps itself alive.

Carry this forward

The person is always larger than the map you need in order to meet them.

Pause and predict

A friend who normally answers quickly takes two days to reply after saying they are overwhelmed.

Which belief is most accurate: they are avoiding you, they are busy, or nothing can be known?
Reveal what follows
What follows
None is yet established. The delay is evidence, but the prior message and the larger pattern should shape how strongly each explanation is held.
The hidden variable
The friend’s current capacity and the meaning they assign to replying remain partly private.
The principle
Good updating keeps multiple live hypotheses in proportion to the evidence.
Where it stops
Uncertainty is not a duty to wait forever. Your own needs and time limits are also part of the situation.
Go deeperResponsiveness, mental models, and the dignity of correction

Relationship research describes responsiveness as attending to another person’s needs and circumstances and responding in a way that conveys understanding, validation, and care.

The important word is perceived. An action intended as care may not be experienced as care if it answers a need the other person does not have. Accurate empathy is never guaranteed, which is why correction matters: “I was trying to help” and “that did not help me” can both be true.

An alignment system also carries a model of what another agent values. The comparison is illuminating only if we preserve the moral asymmetry: a person is entitled to contest the model imposed on them. They are not merely a source of labels for someone else’s predictor.

Responsiveness
Attending and responding to another person in light of their expressed needs and circumstances.
Model uncertainty
Knowing that one’s explanation may be incomplete or wrong and remaining open to correction.
Legibility
Evidence another person can actually use to update, not simply a feeling of being clear in one’s own mind.

SourcesResponsivenessCan I Tell You How I Feel? Perceived Partner Responsiveness Encourages Emotional ExpressionInverse Reward Design

Meaning arrives with a world

Lived experience

The same words can mean different things

How can three ordinary words carry an entire history?

“Are you coming?” appears on a phone. One person typed it beside a packed bag, late for a train and trying not to ask for reassurance too directly. The other reads it under fluorescent grocery-store lights after a draining day. One sent longing wrapped in logistics. The other receives pressure wrapped in a question.

Words do not travel alone. They arrive with timing, punctuation, status, shared history, and the body reading them. A pause that feels respectful in one family can feel punishing in another. “Fine” can close a topic, protect a wound, or genuinely mean fine. Language narrows uncertainty, but context finishes much of the work.

This is why repeating the exact sentence is not always enough to settle what happened. The speaker has special access to intention; the listener has special access to impact. Neither access is complete. Intent does not cancel effect, and effect does not prove a malicious intent. Repair becomes possible when both kinds of evidence can coexist long enough to change the next move.

A useful question is not only “What did you mean?” but also “What made that meaning difficult to receive?” Perhaps the channel was too thin. Perhaps the history was too loud. Perhaps one person carried more risk if the interpretation was wrong. Communication is not a packet delivered intact; it is a coordinated act of inference under unequal conditions.

The aim is not to eliminate ambiguity. Human language would become lifeless if every sentence required a contract. The aim is to recognize moments when the cost of guessing is high enough to slow down, add context, or ask.

One person waits with a packed bag near a rainy train platform while another stands tired in a grocery aisle holding a phone. Their different surroundings make the same incoming message carry different pressures.
A sentence arrives with more than words. It arrives inside a body, a history, a place, and a moment.

Worked example

From verdict to usable question

After receiving “Are you coming?” the tired reader feels controlled and prepares a defensive reply.

  1. Notice the first interpretation: “You are demanding that I hurry.”
  2. Name it as an interpretation rather than pretending no feeling occurred.
  3. Add one concrete observation: “I saw the message while overloaded and read urgency into it.”
  4. Ask for the missing state: “Are you checking the plan, or are you worried I will not come?”

What it showsThe revised question does not guarantee harmony. It creates a channel through which the hidden difference can become discussable.

Carry this forward

When a sentence suddenly feels much larger than its words, look for the history and pressure traveling with it.

Pause and predict

A manager writes “Can we talk?” with no other context. One employee feels curious; another, recently criticized, cannot concentrate for an hour.

Did the manager send the same message to both employees?
Reveal what follows
What follows
The visible words were the same. The usable signal was not, because prior evidence changed what each person reasonably expected.
The hidden variable
The message omitted topic, urgency, and consequence while hierarchy made uncertainty costly.
The principle
Communication quality depends on the receiver’s decision problem, not only the sender’s intention.
Where it stops
A sender cannot control every association. They can still reduce avoidable uncertainty when power or stakes are high.
Go deeperSignals, noise, and why shared language is not a shared model

Information theory can measure properties of signals without telling us what a sentence means to a life.

Control and communication models ask whether a signal lets a system distinguish relevant states and adjust. That helps explain why missing context, delay, and noise matter. But semantic meaning depends on histories and purposes that the channel model does not contain.

Cooperative AI models make the parallel sharper: an assistant may need to infer a person’s objective from incomplete behavior and communicate to learn more. Human conversation has a related uncertainty, but human partners are not a single reward function and may have plural, changing, or conflicting values.

Signal
An observable difference that can change what a receiver considers likely or appropriate.
Noise
Variation that makes the relevant difference harder to recover; in human life, context can be mistaken for noise when it actually matters.
Pragmatics
How context, relationship, and purpose shape what an utterance does beyond its literal wording.

SourcesCybernetics: Or Control and Communication in the Animal and the MachineCooperative Inverse Reinforcement LearningResponsiveness

When the stand-in takes the wheel

Alignment connection

How alignment quietly becomes drift

How can people protect a signal of connection while losing connection itself?

A couple is proud that they never fight. Over time, one person stops raising difficult subjects because calm receives praise and disagreement creates visible strain. The measure looks excellent: fewer arguments. The living value—honesty joined to care—has begun to disappear.

A proxy is something easier to notice than the value we actually care about. Grades can stand in for learning. Speed can stand in for good work. Agreement can stand in for trust. Proxies are not foolish; without them, complex values are hard to coordinate around. The danger appears when improving the proxy becomes more important than checking whether the underlying value still lives.

Drift is often quiet because each local step can be defended. We avoid one conversation to protect a tired evening. Then another because the first avoidance made the topic heavier. A temporary rule becomes a habit; the habit becomes the relationship’s architecture. No single turn looks like departure, yet the boats arrive at different shores.

Changing conditions make old steering rules especially risky. A child becomes an adult, a team grows, illness changes capacity, a friendship crosses distance, or a technology gives one actor much more power. A rule that once protected connection may now block it. Alignment therefore cannot mean selecting a target once and pursuing it forever.

The practical defense is periodic return to the value itself. What was this measure supposed to protect? What has become easier to count but less meaningful? Who absorbs the hidden cost? If the rule continues for six months, what kind of relationship will it build?

A useful signal becomes dangerous when protecting the signal replaces protecting what it once represented.

Worked example

A launch date becomes the mission

A product team chose a date to focus effort and coordinate dependencies. As the date nears, evidence of a safety problem appears.

  1. Recall the original value: deliver something useful without exposing people to avoidable harm.
  2. Name the proxy: shipping on the announced date.
  3. Identify the pressure: status, sunk cost, and fear of looking unreliable.
  4. Ask which action protects the original value when proxy and purpose now diverge.

What it showsChanging the date may violate the visible score while preserving the reason the score existed.

Carry this forward

Return often to what the visible rule was meant to protect, especially when the rule is succeeding.

Pause and predict

A school rewards perfect attendance. A sick student comes to class rather than lose recognition.

Has the policy produced more of what the school values?
Reveal what follows
What follows
It produced more attendance while potentially reducing health, learning, honesty, and care—the larger values attendance was meant to support.
The hidden variable
The measure did not represent why an absence occurred or who bore the cost of appearing.
The principle
Optimization pushes hardest on whatever the measure leaves out.
Where it stops
Not every metric causes corruption. Measures remain useful when they are plural, revisable, contextual, and subordinate to judgment.
Go deeperGoodhart effects, reward uncertainty, and stale policies

Alignment research studies failures that occur when a specified target is only an imperfect stand-in for what its designers value.

Goodhart-like failures come in several forms. Selection can find cases where a normally useful correlation breaks. Actors can manipulate the measure. A system can intervene in the world so aggressively that the relationship between proxy and goal changes. The common lesson is not “never measure”; it is “do not confuse the representation with the value.”

Inverse reward design treats a designed reward as evidence about an uncertain objective rather than as its complete definition. Human relationships need even more humility: there may be no single hidden objective, and people can legitimately revise what they want.

Proxy
A tractable signal used to stand in for a value that is harder to observe directly.
Goodhart effect
A failure in which strong optimization of a measure damages its connection to the goal.
Distribution shift
A change in conditions that makes a formerly useful rule or prediction less reliable.

SourcesCategorizing Variants of Goodhart’s LawInverse Reward DesignExploration and Exploitation in Organizational Learning

Expectation learns from action

Evidence

The wake becomes evidence

What does another person’s experience of us make it reasonable for them to expect?

A friend says, “Call me if the night gets hard,” and answers at two in the morning. Months later, the sentence carries weight before the phone is lifted. Another friend makes the same promise three times and disappears each time. The words match. The wakes do not.

Every action leaves evidence in someone else’s world. A kept promise, delayed reply, joke, boundary, interruption, return, or refusal changes what another person expects next time. The moment passes, but its information remains. That is the wake.

Trust is often described as a feeling or a score. Both pictures miss something. Trust is partly a willingness to become vulnerable because another person or institution appears trustworthy under relevant conditions. It depends on ability, care, integrity, context, and risk. Someone may be dependable with secrets and unreliable with time; trustworthy in calm water and dangerous under status threat.

Mistrust is not always a defect to be overcome. It can be an intelligent response to repeated evidence, unequal power, or historical harm. Asking for trust without becoming trustworthy transfers the burden to the person facing the risk. The more humane question is not “How do I make you trust me?” but “What evidence have my actions made available, and what risk am I asking you to carry?”

New evidence matters, but it does not delete history on command. A repaired pattern can gradually change expectation. A single beautiful gesture after repeated harm may be sincere and still insufficient. Trust moves at the speed of credible evidence, not the speed of the speaker’s desire to be forgiven.

Trust is not a point total. It is a changing expectation built from patterned evidence and context.

Worked example

The missed pickup

A parent repeatedly arrives late to collect a child, then promises that this time will be different.

  1. Separate intention from available evidence: the promise may be sincere while the child’s uncertainty remains reasonable.
  2. Change the system, not only the sentence: add an alarm, backup adult, and early message if conditions shift.
  3. Let repeated follow-through create the new expectation.
  4. Do not demand that the child perform trust before the pattern supports it.

What it showsTrust repair becomes visible when the burden of uncertainty moves toward the person making the promise.

Carry this forward

Ask what your pattern—not your self-description—makes reasonable for another person to believe.

Pause and predict

An institution with a history of exclusion launches a campaign telling the affected community that it is now safe and welcoming.

Should a positive message substantially increase trust?
Reveal what follows
What follows
Only slightly, if at all. A campaign is weak evidence compared with access, accountability, repair, and reliable behavior under pressure.
The hidden variable
The institution’s incentives and response when inclusion becomes costly remain untested.
The principle
Trustworthiness should precede demands for trust.
Where it stops
No individual community member owes an institution participation in its repair experiment.
Go deeperTrust, mistrust, and spirals of expectation

Research increasingly treats trust, mistrust, distrust, and trustworthiness as distinct rather than as points on one simple scale.

Expectations can become self-reinforcing. Trust can permit honest disclosure and cooperation, producing more evidence of reliability. Mistrust can reduce exposure and thereby reduce opportunities for corrective evidence. But that does not make mistrust irrational; avoiding exposure may be exactly what safety requires.

Public-health research therefore emphasizes building trustworthy institutions rather than treating low trust as a communication failure inside marginalized communities. The same ethical shift matters between people: the actor with more power to change the evidence carries more responsibility for repair.

Trust
A willingness to accept vulnerability based on expectations about another actor in a particular context.
Trustworthiness
Patterns of ability, care, integrity, and accountability that can justify trust.
Distrust
An active expectation of possible harm or unreliability, not merely a low quantity of trust.

SourcesConceptualizing and Measuring Trust, Mistrust, and DistrustCan I Tell You How I Feel? Perceived Partner Responsiveness Encourages Emotional ExpressionResponsiveness

Correction must reach the future

Systems lens

Repair means changing the next crossing

What turns an apology from a description into a repair?

During an argument, one person jokes about something the other shared in confidence. The next morning they say, “I was stressed, but I did not mean to hurt you.” The explanation may be true. Yet if the same stress produces the same joke next month, the apology has described the old steering without changing it.

Repair begins by making contact with the rupture: what happened, what it cost, and how power shaped the moment. A weak apology rushes toward closure because the speaker wants relief. A stronger apology can tolerate that the injured person’s timeline is different.

Then comes responsibility. Context can explain behavior without making its consequences disappear. “I was afraid” may reveal the current that moved the boat. It does not make another person responsible for absorbing the collision. Responsibility asks what was within my influence and what I will build before similar pressure returns.

Finally, repair reaches the policy—the repeatable way a person responds. Perhaps the change is a boundary, a pause, a check-in, a backup plan, treatment, restitution, or reduced access. Verification happens later, when the old current returns and the new steering becomes observable.

Not every rupture can or should be repaired into renewed closeness. The outcome may be a smaller relationship, a changed contract, or no further contact. Repair can mean restoring truth and safety rather than restoring the previous form.

Repair closes the loop only when new information changes what happens at the next similar moment.

Worked example

An apology with a next test

A team lead repeatedly interrupts a junior colleague, apologizes afterward, and then repeats the pattern under deadline pressure.

  1. Observe specifically: name when and how the interruption occurred.
  2. Acknowledge cost and power: the junior colleague lost the floor and faced greater risk in objecting.
  3. Change the process: the lead writes notes instead of interrupting and appoints a facilitator to return the floor.
  4. Verify under pressure: the next deadline meeting becomes the meaningful test.

What it showsThe apology becomes credible when a new process produces different evidence in the condition that previously caused failure.

Carry this forward

Repair is not convincing someone that the past was acceptable; it is making the next similar moment meaningfully different.

Pause and predict

Someone gives a detailed apology, accurately names the harm, and becomes defensive when the other person asks for a new boundary.

Has repair occurred?
Reveal what follows
What follows
Not yet. Insight and language are valuable, but resisting a reasonable corrective change leaves the old future largely intact.
The hidden variable
The speaker may be optimizing for restored self-image or access rather than changed conduct.
The principle
Correction must alter future behavior and the distribution of risk.
Where it stops
The requested boundary itself can be negotiated or refused; no framework makes every demand automatically fair.
Go deeperRupture, repair, and corrigibility

Psychotherapy research and AI alignment use different concepts that meet around one question: can new information genuinely change the relationship’s future behavior?

Alliance-repair research emphasizes recognizing strains, exploring each contribution, and renegotiating goals or tasks. This evidence comes from therapeutic relationships, not every friendship or family, so the essay borrows the process carefully rather than treating therapy as a universal template.

AI researchers use corrigibility for systems that cooperate with corrective intervention even when default incentives might favor resisting change. A human apology can be called corrigible only as an analogy. Human autonomy means correction is negotiated, not installed.

Rupture
A strain in goals, cooperation, or relational bond that becomes important to address.
Repair
A process that names the rupture, changes conditions or behavior, and creates new evidence.
Corrigibility
In AI safety, a system’s disposition to cooperate with corrective intervention; here used only as a bounded analogy.

SourcesClinical Consensus Strategies to Repair Ruptures in the Therapeutic AllianceCorrigibilityCybernetics: Or Control and Communication in the Animal and the Machine

Clarity without forced agreement

Ethical boundary

Not every pair of shores is compatible

When is separation wiser than one more attempt to align?

Two people care for each other. One wants a settled home and children soon. The other wants a life organized around movement and does not want children. No secret sentence will make both futures happen. Their tenderness is real. So is the incompatibility.

Some conflicts are missing-information problems. Some are negotiable tensions in which each person can alter a plan without abandoning something central. Some are genuine constraint conflicts. And some occur inside coercion or danger, where treating the situation as a symmetrical coordination puzzle hides the most important fact.

Alignment is not permanent agreement. It is a workable relationship among goals, constraints, information, power, and willingness to update. Two people can understand one another accurately and still discover that the shared region is too small or too costly. Clearer truth can end a relationship rather than save its old form.

This is not a failure of compassion. Compassion without reality can become pressure: if you really cared, you would keep trying; if you understood me, you would change your boundary. Mature contact lets another person remain separate enough to say no.

Safety comes first. Violence, coercive control, threats, stalking, and isolation are not merely communication mistakes. Advice built for mutual misunderstanding can increase danger when one person is using power to restrict the other. In those conditions, outside support and safety planning matter more than a beautifully balanced conversation.

Safety comes before interpretation. Once freedom and exit are secure, distance may call for clarification, negotiation, or respectful separation.

Worked example

Four regions, four responses

Consider four disagreements: a misunderstood meeting time, a budget tension, incompatible plans for children, and controlling access to money or friends.

  1. Clarify the meeting time because shared intent already exists.
  2. Negotiate the budget because the tension may admit several workable arrangements.
  3. Face the incompatible life plans without pretending compromise can create both futures.
  4. Treat financial and social control as a safety and power problem, not a neutral disagreement.

What it showsWisdom is not using the same repair tool on every kind of distance.

Carry this forward

Understanding tells you what kind of problem you face; it does not promise that every problem has a shared destination.

Pause and predict

Two colleagues disagree about a deadline. One can be fired for refusing; the other controls performance reviews and says both should simply compromise.

Is this an ordinary negotiation between equal preferences?
Reveal what follows
What follows
No. They may negotiate, but the power difference changes the risks, available speech, and meaning of apparent agreement.
The hidden variable
Consent under unequal consequence can look like alignment while concealing constraint.
The principle
Alignment claims must include who can refuse, who pays, and who controls the terms.
Where it stops
Power difference does not make cooperation impossible; it raises the standard for accountability, contestability, and protection.
Go deeperFeasibility, bargaining, and the safety exception

Multi-agent models ask whether policies can produce outcomes acceptable to several agents. Human ethics adds rights, power, and the legitimacy of refusal.

Cooperative models can illuminate partial information and shared reward, but real people may not share one reward and should not be treated as if compromise were always required. Institutions need procedures for contest, appeal, exit, and protection precisely because goodwill is not enough.

Public-health guidance distinguishes intimate-partner violence and controlling behavior from ordinary conflict. When safety is compromised, the responsible response is not to optimize mutual understanding at the endangered person’s expense.

Compatibility
The existence of a path that respects each party’s central constraints without coercion.
Contestability
A meaningful ability to question, appeal, refuse, or revise a decision.
Coercive control
A pattern of domination that restricts autonomy through intimidation, isolation, surveillance, or control of resources.

SourcesUnderstanding and Addressing Violence Against Women: Intimate Partner ViolenceCooperative Inverse Reinforcement LearningBeyond Markets and States: Polycentric Governance of Complex Economic Systems

Memory beyond one person

Alignment connection

Lanterns across the water

How do people coordinate when affection and memory cannot carry the whole river?

After a storm, neighbors return to a damaged landing. One marks the loose plank. Another writes the safe water level inside the shed. Someone adds a phone tree; someone records which house has medicine that must stay cold. None of these acts controls the river. Together they make the next night less dependent on one person remembering everything.

Culture is shared memory outside any single mind. A promise remembers an intention after the mood that made it has passed. A recipe remembers a way to feed people. A calendar remembers when to gather. A traffic light remembers whose turn it is. Scientific standards remember how to challenge a claim after its author is gone.

These markers expand coordination, but they can also preserve error. A rule may outlive the danger that created it. A record can make one kind of work visible while erasing another. An institution can become excellent at protecting its procedure and poor at protecting the human purpose that justified the procedure.

That is why collective alignment needs more than shared rules. It needs local knowledge, feedback, revision, multiple centers of judgment, and safe ways to report that the marker points toward a rock. Good institutions do not eliminate disagreement; they organize disagreement so that evidence can travel and concentrated power can be corrected.

The same is true at home. A ritual, boundary, check-in, or shared plan is not proof of closeness. It is a lantern: a small external aid that helps two changing people find a passage again. Its value depends on whether they can move it when the river changes.

Two people on opposite parts of a quiet riverbank place small lanterns along a shared landing after a storm. They remain separate and work carefully rather than embracing or pretending the damage vanished.
Shared markers do not erase distance. They make the next crossing more legible.

Worked example

A household memory that can learn

Two caregivers repeatedly discover too late that each thought the other had arranged a child’s medicine.

  1. Move the intention out of private memory into a shared schedule.
  2. Make responsibility explicit without turning the schedule into surveillance.
  3. Add a confirmation path and a backup when capacity changes.
  4. Review whether the system distributes work fairly instead of merely making one person’s invisible labor more efficient.

What it showsA marker supports care when it preserves responsibility, permits correction, and stays connected to the people carrying the work.

Carry this forward

Shared memory makes coordination durable only when the people it governs can still correct it.

Pause and predict

A workplace creates an anonymous safety-reporting form, but promotions still depend on leaders whose projects would be delayed by a report.

Has the institution built a reliable marker?
Reveal what follows
What follows
It built a channel but not necessarily a safe feedback loop. Incentives may still punish the information the form is designed to collect.
The hidden variable
Whether reports can change decisions without exposing the reporter remains untested.
The principle
Infrastructure for voice must include protection, response, and visible learning.
Where it stops
No reporting system can remove every risk; leaders must continually examine who still cannot safely speak.
Go deeperPolycentric coordination and institutional memory

Complex collective problems rarely yield to one all-seeing decision maker or one permanent rule.

Ostrom’s work documents polycentric arrangements: multiple decision centers operating with local knowledge, shared constraints, and mechanisms for learning. Their strength is not chaos or perfect decentralization; it is the capacity to match decisions to scale while preserving mutual adjustment.

AI alignment often imagines one system learning one human objective. Collective life is harder. Values are plural, authority is contested, and people need durable ways to challenge the models and objectives that govern them. The human lesson is not a ready-made technical solution, but a design constraint: alignment without voice and correction is brittle.

Institutional memory
Records, standards, routines, and roles that preserve knowledge beyond one person’s attention or lifetime.
Polycentric governance
Coordination through multiple interacting centers of decision rather than one universal controller.
Alignment infrastructure
The practical channels through which goals, evidence, disagreement, correction, and accountability can remain connected over time.

SourcesBeyond Markets and States: Polycentric Governance of Complex Economic SystemsExploration and Exploitation in Organizational LearningConceptualizing and Measuring Trust, Mistrust, and DistrustCooperative Inverse Reinforcement Learning

Home water

Connection is not the end of distance.

When two people understand each other well, they do not merge. They remain two centers of feeling, two private interiors, two lives that can never be viewed completely from the other boat. What grows between them is not perfect access. It is a shared practice of correction: jokes that carry history, a look across a room, a boundary that can be spoken, a promise whose evidence survives the mood that made it.

Alignment, at its most human, is not permanent agreement and not obedience to one person’s map. It is the continuing work of discovering whether a passage exists that respects more than one reality. Sometimes that work produces closeness. Sometimes it changes the contract. Sometimes it reveals that the kindest truth is separation. In unsafe water, it begins with freedom and protection rather than mutuality.

The technical ideas help because they make certain failures visible: partial information, stale models, proxy targets, broken feedback, resistance to correction, concentrated power. But no equation contains the worth of the people involved. The direction of care must come from ethics, experience, and the standing each person has to say what the journey costs them.

Love does not erase the river. Trust does not make maps infallible. Repair does not restore the exact world that existed before the collision. What people can build are lanterns—small, revisable signs that say where the rocks were, which promises held, how to return, and when not to cross.

The river between us never disappears. Connection is the patient work of making some part of it passable without pretending it belongs to only one shore.

Follow the currents to their sources

Sources and deeper paths

These sources support distinct layers of the essay. Evidence about relationships is not proof of a metaphor; formal alignment models are not complete accounts of human beings.

  1. ResponsivenessAmerican Psychological Association Dictionary of Psychology

    An accessible research-grounded definition of responsiveness as attending to and responding supportively to another person’s needs, wishes, and circumstances.

    Human relationships
  2. Can I Tell You How I Feel? Perceived Partner Responsiveness Encourages Emotional ExpressionAmerican Psychological Association · Emotion

    Ruan and colleagues examine how feeling understood, validated, and cared for affects whether people express emotion to a close partner.

    Psychology
  3. Clinical Consensus Strategies to Repair Ruptures in the Therapeutic AlliancePsychotherapy · PubMed Central

    Research on rupture and repair in psychotherapy supports the careful distinction between naming a strain, understanding its contribution, and changing the relationship’s future process.

    Psychology
  4. Conceptualizing and Measuring Trust, Mistrust, and DistrustAnnual Review of Public Health

    A contemporary review that distinguishes trust, mistrust, distrust, and trustworthiness and argues that institutions should become more trustworthy rather than merely demand trust.

    Human relationships
  5. Cybernetics: Or Control and Communication in the Animal and the MachineNorbert Wiener · MIT Press

    Wiener’s foundational account grounds the essay’s limited use of feedback, messages, noise, and correction while also reminding us that human meaning is not exhausted by control theory.

    Feedback and control
  6. Planning and Acting in Partially Observable Stochastic DomainsArtificial Intelligence

    Kaelbling, Littman, and Cassandra formalize action when the state of a changing world cannot be observed directly and must be inferred from partial observations.

    Feedback and control
  7. Categorizing Variants of Goodhart’s LawDavid Manheim and Scott Garrabrant · arXiv

    A technical taxonomy of ways that optimizing a measure can detach it from the value it was supposed to represent.

    AI alignment
  8. Inverse Reward DesignNeurIPS 2017

    Hadfield-Menell and colleagues treat a specified reward as evidence about an uncertain objective rather than as a perfect statement of what the designer values.

    AI alignment
  9. Cooperative Inverse Reinforcement LearningNeurIPS 2016

    A formal cooperative, partial-information model in which assistance depends on learning a human objective rather than assuming it is already known.

    AI alignment
  10. CorrigibilityAAAI Workshop on AI and Ethics

    Soares, Fallenstein, Yudkowsky, and Armstrong ask how an artificial agent might remain cooperative with corrective intervention instead of resisting it.

    AI alignment
  11. Beyond Markets and States: Polycentric Governance of Complex Economic SystemsElinor Ostrom · Nobel Prize lecture

    Ostrom documents coordination through multiple centers of authority, local knowledge, shared rules, and institutions that can adapt rather than depend on one universal design.

    Institutions
  12. Exploration and Exploitation in Organizational LearningJames G. March · Organization Science

    March explains why organizations must balance refining what they already know with preserving variation and learning from alternatives.

    Institutions
  13. Understanding and Addressing Violence Against Women: Intimate Partner ViolenceWorld Health Organization

    WHO distinguishes ordinary relationship conflict from physical, sexual, and emotional abuse, coercion, and controlling behavior; safety takes priority over mutual repair.

    Safety

Continue through neighboring ideas

Three paths from here