The Algorithm of Us

Chapter 75: The Setback

The Brussels morning was gray and wet, and the audit room was worse—a glass box on the fourth floor of the Belgian data-protection authority, with a view of a parking garage and a thermostat set to a temperature that made no one happy.

Claire laid out the folders in a fan: the registry governance charter, the consent architecture, the cryptographic pseudonymization protocol. Across the table, three regulators sat with laptops open and expressions as neutral as an unread chart.

Ethan sat beside her, hands folded, Anna's pin at Claire's collar catching the fluorescent light.

The lead auditor, a compact woman named Mireille Dossogne, opened with a question Claire had rehearsed for six weeks. "Describe the legal basis for processing patient data originating in member states where consent was obtained under a clinical-trial framework rather than a registry framework."

Claire answered. She answered the next four questions too. It wasn't until the sixth—"Who holds the re-identification key for the pooled dataset?"—that the floor moved.

"Primary custody rests with each contributing institution," Claire said. "The pooled layer is irreversibly pseudonymized. No single party, including us, can reverse the mapping."

Dossogne looked up. "But your cross-national validation paper describes a sub-analysis by sex, race, and income band at the pooled level."

"Derived from fields already present in the pseudonymized record. No re-identification required."

"Ms. Bennett." Dossogne turned her laptop slightly. "Your paper's Appendix 4 describes a machine-learning imputation step for missing demographic values. Imputation requires a model trained on data. On what data was that model trained?"

Claire felt it before she understood it—the specific cold drop in the stomach that preceded a bad reading. "On the pooled training set. De-identified."

"Including European records from the twelve health systems?"

"Yes."

"Then the imputation model itself constitutes a derived processing operation on European patient data," Dossogne said, "for which no adequacy determination exists and no Article 22 safeguards are documented. You have created a multinational inference engine from our citizens' records." She closed the laptop. "We are suspending the audit approval pending a remediation plan. You have until eight tomorrow morning to file. If we don't accept it, the pooled registry is frozen across all member states."

They walked out into the rain without speaking. Ethan held the door. In the street, Claire stopped under an awning and put both hands flat on the damp brick, breathing.

"Say it," he said.

"I didn't see it." Her voice came out level, which was worse than if it hadn't. "I built the imputation layer. I wrote the appendix. I flagged the disparity in November and I couldn't see the one thing that kills the whole registry."

"You saw the accuracy, the recall, the bias. Nobody audits their own blind spot."

"That's a very cardiologist thing to say."

"It's a both-of-us thing to say." He glanced at his watch. "Vermeer."

They found him in the hotel bar two blocks over, nursing an espresso and looking, for a man who'd spent the morning trying to give them advance warning, insufficiently surprised.

"Article 22," he said, before they sat. "Automated decision-making. And a derived-processing finding on top, which is the part that will freeze you."

"Can we litigate it?"

"You can. You'll lose this year and maybe win in two, and by then three health systems will have pulled out and your toolkit will be a footnote." He turned his cup. "The Dutch authority will follow the Belgian lead. So will the Irish. You have one night."

"Then give me something better than one night."

Vermeer studied her a long moment. "I'm on the European advisory panel for federated learning frameworks. There is a route—a prototype standard, not yet blessed, for exactly this: the model never leaves the source institution. Only gradients cross the border. Nothing pooled, nothing inferable at the center."

"Gradients leak," Ethan said.

"If you're careless. Done properly, with differential privacy noise and secure aggregation, it's defensible. That's the argument you make tomorrow." Vermeer stood, dropped a card on the table. "The standard's rapporteur is in Rotterdam. She owes me. Call her, and start writing."

They took a room at the airport hotel because it was the only place with two desks.

Claire worked the legal architecture—consent annexes, Article 22 safeguards, an algorithmic-impact statement for the imputation model that reframed it as a federated gradient, never a pooled dataset. Ethan worked the technical annex, because he understood the clinical stakes better than any lawyer on their team and because someone had to keep her upright.

At 1:14 a.m. he put a hand on her screen. "Eat."

"I'll eat when the draft is coherent."

"You'll eat now, because at 4 a.m. you'll start writing sentences that don't parse and then we lose." He set a plastic container on the desk. Airport risotto. "I've intubated better food."

She ate four bites and went back to work. He stayed on the far desk, typing, occasionally asking her a question that assumed she was competent, which steadied her more than reassurance would have.

At 3:40 she found the crack. The Belgian finding rested on the premise that the imputation model constituted a distinct processing operation. Under the federated architecture, it didn't—the model existed only as aggregated gradients held by an escrow trustee, and the gradients, with Verdant's noise parameters, were provably non-invertible. The safeguards didn't need to be invented. They needed to be *cited*, precisely, paragraph by paragraph, into a frame the auditors already recognized.

"Ethan. Will you check this?"

He read it twice, once as a physician and once as a man who'd spent three months learning this literature well enough to catch a real error. Then he looked up. "This works."

"It works?"

"It works, and it's boring, which is how you know it'll pass." He reached across the desks and took her hand, thumb over her knuckles. "You did it."

"I did it with a card from the man who tried to warn us, a draft standard that doesn't exist yet, and you telling me to eat."

"That's how it's done," he said. "You know that."

At 7:52 they filed. At 11:20 they were called back.

Mireille Dossogne had the remediation plan on her screen, and beside it, on the second monitor, the standing text of the federated-learning framework they had invoked. Claire noted, distantly, that the framework page had been viewed by that account earlier that morning—before Vermeer's call would have reached Brussels. She said nothing.

"Ms. Bennett," Dossogne said. "You have cited a standard that is not final."

"It's the draft adopted by the working group for pilot audits. Annex B, paragraph fourteen, anticipates exactly this finding and prescribes the remediation path we've filed against."

"Anticipates." A pause. "You read the whole document."

"Twice. Once aloud, so I'd hear the parts I wanted to skip."

Something moved at the corner of Dossogne's mouth that was not a smile and not the absence of one. She typed. She made a call. She listened mostly, then said, in Dutch, something short that Claire didn't catch, and hung up.

"Approval with modifications," Dossogne said. "Federated architecture is a mandatory condition, not an option. The pooled registry as described is dead—do not reintroduce a central store under another name or we will find it and I will personally end your program. You will submit to annual technical audit. The toolkit licenses must reflect these terms within ninety days." She looked up. "And Ms. Bennett—your imputation layer is withdrawn from the published paper. Correct the record."

"It's already filed with the journal. I'll write the correction today."

"Good." Dossogne stood and held out her hand. "For what it's worth, the framework's rapporteur does not take calls after nine at night. You got lucky."

"She owed someone a favor."

"Yes," Dossogne said, and her handshake was firm and entirely ungiving. "So did I."

They walked out into the same rain, and this time Claire laughed, once, a sound with a crack in it.

"Federated," she said. "Which means the twelve health systems have to rebuild their data pipelines. Which means the implementation is a year out. Minimum."

"A year."

"A year, and every one of them is now contingent on a standard that isn't final, that could be revised out from under us at any review cycle."

Ethan stopped on the wet pavement and turned to face her. "Claire."

"I'm not catastrophizing. I'm reading the fine print."

"You're reading the fine print at a level I've never seen anyone read it." He took her hands, rain running off his sleeves. "You saved the registry and you're already three steps into the next disaster. Take one step back."

She looked past him at nothing for a second. Then she took out her phone, to text the team, and saw that throughout it all it had been on silent—thirty-one missed calls, and a voicemail from the rural grant committee's chair that had come in at 9:40 Monday morning.

Which was exactly when Whitfield had been testifying at the DMC.

Claire listened. Then she lowered the phone and stood very still in the rain.

"They reviewed early," she said. "The committee met this morning instead of tomorrow. Without the complaint resolved. My lead-investigator role is suspended pending outcome." She looked at Ethan. "And there's a second voicemail. From Quincy. Patient 146's daughter. She says she read about the complaint in STAT and she wants to know—" Claire's voice caught, held, didn't break. "—she wants to know why I never wrote to her first."

Back to book

Sign in or create an account

Sign in with Google to keep your library and reading progress on every device.

Continue with Google

By continuing you agree to our Terms and Privacy.