theloop.felineunion.org
02 03 M
Case 01 — Consumer Platforms WP-01 · The Conditioning Works

The feed is the experiment, and the experiment has concluded.

Engagement-ranked feeds were sold to the public as "what you want to see." They are a continuous A/B test running on several billion people, optimising a single number. The results are in — and the most uncomfortable finding isn't that attention got broken, but how cheaply and with what precision the breaking was achieved.

DomainConsumer Platforms
Length~14 min read
Sources11 cited
StatusPublished

There is a particular kind of argument about social media that has gone out of fashion, and it deserves to come back. The argument is not that the platforms are addictive in some metaphorical, hand-waving sense. It is the literal claim that the systems were built, refined, and instrumented to produce specific, measurable behavioural changes in their users — and that, when the engineers measured whether those changes had occurred, the answer was yes. Not "probably." Not "in some users." Yes, with the kind of statistical confidence that ends a debate.

This isn't a hidden fact. It's in the patent filings, the internal research that leaked during the 2021 Facebook Files episode, the published academic work of the platforms' own data scientists, the gambling industry's adoption of the same patterns, and twenty years of conference talks at events the public was never invited to. The conditioning works. The platforms know it works. The interesting question is what we do with that knowledge.

§ 1.1The loop, stated plainly

Strip out the brand differences and a feed-ranked platform is doing four things in a tight cycle. It shows you content. It measures what you do with that content — scrolls, dwell time, taps, shares, screenshots, the precise pixel coordinates where your thumb lifted. It updates a model of you. And it picks the next piece of content to show, choosing whichever option the model predicts will maximise some target metric, usually a weighted blend of time-in-app and a few interaction counts.

That's it. That's the whole machine. What makes it powerful is not any single decision in the loop; it's that the loop runs perhaps a hundred times per session, hundreds of millions of sessions a day, with the model continuously retraining on the results. There is no human content editor in this process. The optimiser is the editor.

Fig. 1
Loop frequency
~100 ms
Median latency between user action and the next feed-ranking decision on a major short-video platform. The cycle is faster than a human reaction time, and it never stops while the app is open.

Once you see the system this way, a number of mysteries resolve. The mystery of why every platform's feed slowly converges on the same texture — short, emotional, slightly outraged, visually busy — resolves into "because that texture wins the optimiser's metric." The mystery of why platforms can't simply fix the problems they cause without crippling the product resolves into "because the problems and the product are produced by the same mechanism." The mystery of why teenagers in particular seem so flattened by the experience resolves into "because the optimiser has more training data on them per unit time than on anyone else."

§ 1.2The evidence the platforms produced themselves

The strongest evidence that the conditioning works is not from critics. It is from the platforms' own internal research, which was designed to answer a much narrower question — does our product change user behaviour in the direction we want? — and which kept coming back with the answer "yes, and also several directions we don't want."

The 2021 Facebook Files made some of this public. Internal Instagram research found teen users self-reporting that the app made them feel worse about their bodies, and that they kept using it anyway because the algorithmic feed kept surfacing exactly the comparisons that had hurt them. The notable detail is not the harm. The notable detail is that the company had quantified it, internally, with the same rigour it used to quantify ad revenue, and concluded that the harm and the engagement were the same variable measured from two sides.

YouTube's recommendation team published similar work, less dramatically, in machine learning conference proceedings — papers describing how watch-time optimisation produced systematic drift toward longer, more extreme content, and how various dampening interventions affected the metric. The dampening interventions worked too. They simply traded one number for another. Engineers don't write papers about systems that don't work.

The platforms' own data scientists have been publishing the proof-of-concept for two decades. We just kept reading it as marketing.

§ 1.3The gambling tell

The clearest sign that software-layer conditioning has matured into a reliable industrial process is that the gambling industry adopted it wholesale. Online sports betting and slot apps now ship with notification timing, loss-recovery mechanics, near-miss visualisations, and reward variability schedules that are functionally identical to the engagement design of consumer social platforms. They are not similar by coincidence. The same consultancies, the same playbooks, sometimes the same engineers, have moved between the two industries.

Gambling is a useful case because the metric is unambiguous. The slot app's job is to extract money. If the conditioning patterns it shares with Instagram and TikTok didn't work, the gambling sector — which is ferociously empirical about anything that moves the revenue line — would have dropped them. It hasn't. It has doubled down.

Fig. 2
US Online Sports Betting Handle, 2018–2024
3.1×
Growth multiple post-PASPA. The curve closely tracks the rollout of app-native, behaviourally-instrumented sportsbooks built on engagement-design patterns drawn directly from consumer social platforms.

The same loop, deployed against the same neurology, with a different revenue model bolted to the end. That the loop works in both deployments is exactly the point. It is portable, generalisable, and at this stage, well understood by its operators.

§ 1.4What "works" actually means

When I say the conditioning works, I am being deliberately narrow. I mean: the systems reliably produce, at population scale, the behavioural changes their operators are paid to produce. They increase time in app. They increase the probability of a click, a share, a deposit. They reduce churn. They lift the metric the optimiser was pointed at. There is no longer any serious internal debate about this inside the firms that operate them.

What the systems do not do is honour any side constraints that weren't built into the metric. They do not, by default, protect adolescent mental health. They do not protect a healthy information environment. They do not, on their own, refuse to amplify the most enraging item available. These are real failures, but they are failures of the metric, not failures of the technology. The technology is doing what it was built to do. It is the metric that is impoverished.

This is why "the platforms have lost control of the algorithm" is the wrong frame. The platforms have not lost control. The platforms have exactly the control they purchased. The thing they have not done is purchase a metric that lines up with the public interest, because no one is paying them to.

§ 1.5Why this case matters for the others

Consumer platforms are the easy case. The conditioning is visible. You can feel it in your own thumb. The reason this paper treats them as Case 01 rather than the whole story is that the same loop has now been deployed in two domains where the subjects are less free to leave: gig labour and state compliance. Those are Case 02 and Case 03.

The platforms taught a generation of engineers how to bend behaviour with software. Those engineers did not stay at the platforms. They went to logistics companies, fintech startups, government IT contractors, police technology vendors. They took the loop with them. The loop still works. It works on warehouse pickers. It works on benefit claimants. It works on people awaiting an immigration hearing. The mechanism does not care.

Sources & Notes
  1. Wall Street Journal, "The Facebook Files" series (2021). Internal Meta research on teen users of Instagram, leaked and partially published.
  2. US Senate Subcommittee testimony, October 2021 (Frances Haugen). Documentary record of internal engagement-vs-wellbeing tradeoffs.
  3. Covington, Adams, Sargin (2016), "Deep Neural Networks for YouTube Recommendations" — RecSys. The watch-time architecture, described by its authors.
  4. Goodrow (2021) "On YouTube's recommendation system" — YouTube blog post acknowledging amplification dynamics.
  5. Schüll, Addiction by Design: Machine Gambling in Las Vegas (2012). The pre-software industrial conditioning literature; remains foundational.
  6. American Gaming Association — annual commercial gaming revenue tracker for US online sports betting handle, 2018–2024.
  7. FTC staff report, "Bringing Dark Patterns to Light" (September 2022). Federal enumeration of the design techniques in use.
  8. 5Rights Foundation, "Pathways: How digital design puts children at risk" (2021). External corroboration of internal platform findings.
  9. Allcott, Braghieri, Eichmeyer, Gentzkow (2020), "The Welfare Effects of Social Media" — American Economic Review. A natural-experiment estimate of platform impact on user welfare.
  10. Mosseri (2021–2024), public statements from Instagram leadership on ranking objectives. Useful primary record of what is and isn't disclosed.
  11. New York Times investigations on app-based sportsbook design (2022–2024); Pew Charitable Trusts coverage of state-level rollouts.
Next — Case 02

Your manager is a thermostat.

Part of The Conditioning Works · Working paper No. 01 / 2026

Intro

Track 1 of 6 · auto-playing