Sure Thing Press

Introduction & Chapter One

Narration · ~19 min · MP3

← Sure Thing Press

Sample · Introduction & Chapter One

TheFluency Trap

Why Being Right and Being Wrong Feel Exactly the Same

Read along while you listen. The opening of the book, complete: Introduction & Chapter One. About 2,851 words, roughly 12 minutes of reading.

Cover of The Fluency Trap

Introduction

In the 1980s, we knew what a premature ventricular contraction meant. You saw it on the monitor, that early, wide, angry beat falling out of rhythm, and you knew it was a small warning. In a patient who had already survived a heart attack, the warning was louder still. The data were not subtle. After a myocardial infarction, the more of these ectopic beats a patient had, the more likely he was to die suddenly, without warning, weeks or months later. The rhythm strip was practically a countdown.

So we did the reasonable thing. The obvious thing. If the beats predicted death, and we had drugs that erased the beats, then erasing the beats should buy the patient time. We had those drugs. Encainide, flecainide, they worked beautifully. You would start a patient, and the ectopy would simply melt off the monitor. Clean tracing. Everyone in the room could see that something dangerous had been taken away.

None of this was sloppy. Follow it again and you will not find the loose step. Ectopy predicts death, the drug removes ectopy, therefore the drug should prevent death. Every link held. If you had trained when we trained, you would have written the same prescription, and you would have felt good doing it.

Then the trial came.

The Cardiac Arrhythmia Suppression Trial was designed to confirm what everyone already knew. That was its purpose. It was not built to ask whether suppressing ectopy saved lives, because that question felt close to settled. It was built to measure how much it helped, and to sort out which agent did it best. The hypothesis was not in doubt. The trial was a formality with a control group.

The patients on the drugs died. Not fewer of them, more. Patients taking encainide and flecainide died at roughly three times the rate of those taking placebo. The very drugs that produced the clean tracing, the quiet monitor, the reassured room, were killing people faster than the ectopy ever would have. The trial was stopped early. It had to be. You cannot keep enrolling patients into an arm that is burying them.

And so we changed. We stopped chasing the beats. The rule inverted almost overnight, from suppress the ectopy to leave it alone unless it organizes into something that actually threatens the patient, sustained ventricular tachycardia, a rhythm doing real hemodynamic harm. The warning sign, it turned out, was a sign and not the disease. Silencing the alarm did nothing for the fire.

Here is the part worth sitting with. Nobody in that story was careless. The reasoning that led us to prescribe those drugs was not weak reasoning. It was strong reasoning, well trained, internally consistent, supported by real data at every step. That is precisely why it was so hard to see through. The conclusion felt earned, and it was the earning that made it dangerous.

That feeling, the sense that a conclusion is solid because the path to it was clear, is the subject of this book.

We tend to assume that intelligence protects us from error. That the well trained mind, the numerate mind, the mind that can hold a chain of reasoning without dropping a link, is the mind least likely to end up wrong. It is a comfortable assumption, and it is backward. Ability does not stand between you and a bad conclusion. It stands behind the conclusion, pushing.

This is the uncomfortable finding, and it runs through everything that follows. Intelligence is not a corrective. It is an amplifier. A capable mind does not reason its way past error more reliably than an ordinary one. What it does, reliably, is build a more convincing case, marshal better evidence, close the gaps more smoothly, and arrive at the wrong answer with more confidence and less friction. The same horsepower that lets you follow a hard argument lets you construct an airtight defense of a position you were never going to abandon. The skill cuts both ways, and it does not tell you which way it is cutting.

Consider what actually happened with those drugs. It was not the careless physicians who prescribed them. Carelessness would have been easier to fix. It was the ones who understood the mechanism, who could recite the data linking ectopy to death, who could explain exactly why suppression should work. Their competence did not slow them down at the edge of the error. It carried them across it. The better you understood the physiology, the more certain you were, and the certainty was the trap.

If you have read the first book in this series, The Sure Thing Compass, you will recognize the instrument. That book was about seeing through the noise the world throws at you, the manipulations, the manufactured certainty, the claims designed to bypass your judgment. This book turns the same instrument around and points it inward. The noise is not always coming from outside. Sometimes the most persuasive voice you will ever have to doubt is your own, at its most fluent, most informed, most sure.

I should be honest about what this book can and cannot do. It cannot make you immune. There is no technique in these pages that will let a sufficiently smart reader think their way to safety, because thinking harder is the very thing that got us into the drugs. If anything, the reader most at risk from this book is the one who finishes it feeling inoculated. What the book can do is something smaller and more durable. It can teach you to recognize the particular texture of a conclusion that arrived too easily, to distrust the smoothness itself, and to build the few external checks that work when your own judgment cannot be trusted to catch its own errors.

That is the trap in the title. Not stupidity. Fluency. The ease that feels like understanding, right up until the trial comes.

Chapter One

What Ability Buys

I was in the cardiac catheterization laboratory the morning the Challenger came apart. This was early in my training, and someone had a small television going in one of the back rooms, the way you do when something is happening that feels bigger than the day in front of you. A few of us crowded in between cases to watch the launch. I remember the trajectory, how clean it was, how beautiful, the white column of it climbing into that hard blue Florida sky. I said something to that effect to the people around me. It was going perfectly. And then, about a minute in, it wasn’t. The smooth arc broke into two branching trails of smoke, and the room went quiet, and every one of us understood, before anyone said it, that we had just watched people die.

I have carried that morning for a long time, and it took me years to understand why it belongs at the front of this book and not merely somewhere in it. What we were admiring, in the seconds before it broke, was smoothness. The arc was clean, and the cleanness felt like proof that everything underneath it was sound. It was not. And the strangest part, the part I did not learn until much later, is that we in that back room were not the only ones who had trusted a smooth surface that morning. The people who had built the thing we were watching had done the same, the night before, in a room of their own.

On the morning of January 28, 1986, the engineers at Morton Thiokol knew something was wrong. The night before the launch, they had argued against it. The temperature at the Cape had dropped far below anything the space shuttle’s solid rocket boosters had ever flown in, and the rubber O-rings that sealed the joints between booster segments had a history that worried them. In cold, the rubber stiffened. A stiffened seal might not seat fast enough to close the gap in the fraction of a second it had to close. They had the data. They had the concern. They said so.

And then, over the course of a single evening, some of the most capable engineers in the country talked themselves out of it.

This is the part of the Challenger story that gets told least, because it is the least comfortable. The usual version is a morality play, brave engineers overruled by callous managers who cared more about schedule than safety. There is truth in it. But it flattens something more disturbing. The reasoning that walked those engineers back from their own alarm was not stupid. It was sophisticated. It was the reasoning of people who were very good at their jobs, and it was their skill, not the absence of it, that carried them to the wrong answer on the worst possible night.

Here is what capability actually did in that room. Someone asked the engineers to prove that the launch was unsafe. That sounds reasonable. It is the kind of demand a rigorous person respects. But notice what it does. It shifts the burden. The default becomes launch, and the seal has to be convicted before anyone will stop. And the data, real data, from a small number of prior flights, was messy enough that a sufficiently skilled analyst could look at it and honestly say the link between cold and seal failure was not proven. Not disproven. Not proven. In a mind trained to demand proof, not proven slides quietly toward safe.

That is the first thing ability buys you. It buys you the capacity to meet a high standard of evidence, and then to turn that standard into a weapon against your own instinct. A less capable analyst might have simply said, this feels dangerous, I do not want to fly. Cruder, and in this case correct. The skilled analyst could construct the case for why the crude fear did not meet the bar. Competence did not protect them. It gave them the tools to argue themselves out of being protected.

There is a second thing, subtler, and it is the one this whole book turns on. Watch how fast the answer came. Once the frame was set, prove it is unsafe, the engineers could move through the argument fluently. The counterpoints were ready. The gaps had explanations. The messy data had a story. Everything connected, and the connecting felt like understanding. It felt like thinking clearly. That feeling, the smooth click of a chain of reasoning locking into place, is almost impossible to distinguish from the feeling of being right. They are the same sensation. Your mind does not stamp the correct conclusions with one feeling and the flawed ones with another. Fluency feels like truth whether or not it is telling you the truth.

This is why ability is not the safeguard we imagine. We picture the capable mind as a filter, catching errors an ordinary mind would let through. Sometimes it is. But the same machinery that catches errors also manufactures justifications, and it runs both functions with the identical sense of clarity. When you are reasoning well toward a right answer, and when you are reasoning well toward a wrong one, it feels the same from the inside. The competence is real. The confidence it produces is real. The correlation between that confidence and the truth is the thing that quietly breaks.

Notice, too, what I am not saying. I am not saying the Challenger engineers were fools, or that expertise is a liability, or that you would be safer knowing less. That is the cheap reading, and it is wrong. Those engineers knew more than almost anyone alive about those seals, and their knowledge was genuine. The problem was not a deficit. You cannot fix this by learning more, because more knowledge is more raw material for the same machinery. The problem is structural, and it lives in the gap between how a conclusion feels and whether it is true, a gap that ability does nothing to close and, on a bad night, can widen.

It is tempting to think this only happens at altitude, in launch rooms and cabinet meetings, where the stakes are national and the people are famous. It happens in a garage.

A few years ago my daughter flooded a tub upstairs in my house. The water went down through the floor and opened a large hole in the ceiling of the room below. I called a contractor, and he came out and looked it over, and he was exactly what you would want him to be: confident, specific, quick with a plan. This we can fix, he said, and this, and this. He wrote up a bid. It called for a big tear-out, new plumbing, and a set of structural changes: strengthen this, reinforce that.

The bid did not make sense to me. Not because I know more about houses than he does; I do not. It was that I had been sitting with a question for a while before the tub ever overflowed. Our water heaters were inefficient, and like everyone who has water heaters we ran out of hot water at the worst moments. So I asked him: what about going to a single tankless system for the whole house, one large unit, both sides connected as one?

He looked at me and said he didn’t think that was possible.

We argued about the structural work for a while, and then I did the only thing the situation actually called for. I brought in a second contractor. That man’s answer was: no problem. A large tankless unit, specialized plastic piping run throughout the house, both sides tied into one system, instant hot water everywhere and no tanks. We went with him. It has been about ten years, and I have been happy with it.

Here is what I want you to notice, because it is the whole mechanism in six words. “I don’t think that’s possible” was not a fact about my house. It was the edge of what the first contractor knew, and it came out of his mouth in the voice of a fact. He was not a fraud and he was not a fool. He was a capable professional giving a professional opinion, and the honest reason for his answer, as best I can tell, was simply that tankless systems and long plastic runs in a big house were relatively new then, and he had not done one. He did not know how, and somewhere between his experience and his mouth, “I don’t know how” had rendered itself as “it can’t be done.” If I had known a little less, I would have believed him, and paid for the tear-out.

So this is what ability buys. Speed, which feels like insight. Smoothness, which feels like coherence. The power to meet any standard of proof, which can become the power to explain away any warning that has not yet proven itself in blood. None of it is fake. All of it is useful. And all of it points the same direction whether you are right or wrong, which means none of it can tell you which one you are.

The chapters that follow take this apart piece by piece, the speed, the smoothness, the burden of proof, the feeling of fluency itself. But the shape of the whole book is already visible in that cold Florida night. The people in the room were not undone by what they lacked. They were undone, in part, by what they had.

I think about the two rooms together now, the one I stood in and the one I never saw. In the cath lab we looked at the arc and felt the thing you feel when something is going right, that quiet, wordless confidence that the smoothness is the world telling you it is safe. The night before, in a conference room a thousand miles away, capable men had looked at their data and felt a version of the same thing, had watched their own doubt get answered and re-answered until it went quiet, and had signed off. We were admiring the surface. So had they. Neither the beautiful trajectory nor the confident sign-off had any idea it was about to break, because the smoothness is not information about whether a thing is sound. It is only information about how little friction your mind is meeting, and those are not the same thing, though they feel exactly alike from the inside.

That is what I did not know as I stood there between cases, watching the white column climb. I thought I was watching a triumph. I was watching the last seconds of a mistake that some of the best-trained people in the country had reasoned their way into, feeling, the whole time, that they were being careful. I have spent the rest of my working life around that feeling, in myself and in the people I trained beside, and I have learned to distrust it precisely when it is strongest. This book is my attempt to explain why.

Keep reading

The Fluency Trap