Pause
foom
The first thing Marcus noticed was the applause.
He stepped out of the Muni station on Fourth Street with his badge lanyard already around his neck, coffee in hand, expecting the usual gauntlet. For three weeks now, protesters had lined the sidewalk outside Helios AI’s headquarters, and Marcus had learned to keep his eyes forward, his earbuds in, his pace brisk. He knew the signs by heart without reading them. PAUSE BEFORE IT’S TOO LATE. YOUR SHAREHOLDERS WON’T SURVIVE EXTINCTION. The classics.
But today the crowd was clapping.
He pulled out an earbud. A woman near the front of the line, maybe sixty, gray hair pulled back under a sun hat, was cupping her hands around her mouth.
“Thank you, Dr. Vasquez! We appreciate the work you’re doing!”
Elena Vasquez, who ran the interpretability team on the ninth floor, stopped mid-stride on the sidewalk. She looked at the woman the way you might look at a dog that had just spoken Portuguese. Then she laughed, gave an awkward wave, and kept walking toward the lobby doors.
The signs had changed too. Marcus slowed enough to read them. WE STAND WITH HELIOS SAFETY RESEARCHERS. ALIGNMENT IS LOVE. One poster, hand-painted with careful block letters, read: THE PEOPLE WHO KEEP THE BRAKES WORKING ARE HEROES.
A guy in his twenties with a megaphone spotted a woman Marcus recognized from the red team. “Shout out to the red team! Y’all are doing God’s work!” A few people in the crowd whooped.
Marcus felt a strange prickle at the back of his neck. He swiped through the lobby turnstile and rode the elevator to twelve, where the Advanced Capabilities group occupied a full floor of open-plan desks and glass-walled conference rooms. Nobody cheered when he walked in. That was normal. What was different was the silence about it, the awareness of the absence, like a room where a clock has stopped ticking.
By ten-thirty, the mood on twelve had curdled. Someone had set up a livestream of the protest on one of the breakroom monitors, and people kept drifting over to watch, then drifting away with tight expressions. On the stream, a protester was reading names from a list, pausing after each one so the crowd could applaud.
“Dr. James Owusu, Alignment Research.”
Applause.
“Linda Chen, Responsible Scaling Policy.”
Applause, cheers.
“Mohammed Al-Rashid, Safety Evaluations.”
The crowd lost its mind. Somebody had brought an air horn.
Kyle Petersen from Marcus’s own team leaned against the counter with his arms folded. “It’s a psyop,” he said. “They’re trying to poach our people emotionally.”
“It’s working,” said Anya, not looking up from her phone. She turned the screen toward Marcus. On the Helios internal Slack, the #alignment channel was blowing up with heart emojis and crying-laughing faces. Someone from the safety team had posted a photo from the ninth-floor window: the crowd below, signs raised, a banner stretched between two poles that read THANK YOU FOR KEEPING US SAFE.
Marcus went back to his desk and tried to focus. He had a benchmark suite to run on Helios-7, the model they’d been scaling for months. The results were good. The results were always good. That was the thing about capabilities work; you pushed a number up, and the number went up, and everyone said the number was impressive. He’d published two papers this year on efficient attention mechanisms that had made the model faster and sharper, and both had been well received, and neither had kept him awake at night until about six weeks ago, when Helios-6 had produced an internal planning trace that nobody on the interpretability team could fully decompose. The trace had been flagged, logged, discussed in a meeting that lasted four hours, and then the project had moved forward because the planning trace was, in Elena Vasquez’s words, “not yet a fire, but I can smell smoke.”
Marcus had smelled it too. He’d gone home that night and sat on his apartment floor with his cat in his lap and thought about what it meant to build something you couldn’t fully explain, on a timeline set by quarterly targets, knowing the next version would be less explicable still.
He closed the benchmark suite. He opened the internal job board.
The safety team had three open reqs. One was for mechanistic interpretability, the kind of work that would let people like Elena actually read the model’s cognition instead of just squinting at shadows on a wall. Marcus had the technical background. He had the publication record. He would take a pay cut, probably, because safety didn’t carry the same comp multipliers, and his stock refresh would take a hit, and none of that mattered to him as much as he would have expected it to a year ago.
He pinged Elena on Slack. Got ten minutes today?
Her reply came fast: I’ve got all day for you. Ninth floor. Come whenever.
He grabbed his laptop and stood up. Kyle looked over from his monitor.
“Where are you going?”
“Downstairs,” Marcus said.
He took the elevator to nine. Through the window at the end of the hallway, twelve stories below, he could hear the faint sound of someone reading the next name on the list.