Download the Book (PDF): Introduction In late January 2024, veterinarians in the Texas Panhandle began getting calls about dairy cows that had stopped eating. The animals were feverish and listless, and their milk had changed: it came out thick and yellow, almost like colostrum, and in some cows production collapsed within a day or two. Most of the sick cows were older and in mid-lactation. Most of them recovered after a few weeks. Farmers and their vets worked through the usual list of suspects, including feed contamination, bacterial mastitis and a new strain of some familiar respiratory bug. Around the same time, cats on the same farms began to die. They walked in circles, went blind and had seizures. On some farms, pigeons, grackles and blackbirds were found dead in the yards. On 25 March 2024, the United States Department of Agriculture confirmed that the cause was highly pathogenic avian influenza A(H5N1), a bird virus that had been circulating the globe for more than two years in wild birds and poultry. No one had ever documented it spreading among cattle. A week later a dairy worker in Texas developed conjunctivitis and tested positive. Over the next two years the virus reached more than a thousand dairy herds in nineteen states. It infected dozens of farm workers, killed cats that had drunk raw milk, and passed from cows back into poultry flocks. In the course of all this it exposed, one agency at a time, almost every structural weakness in how wealthy countries watch for diseases crossing between species. That outbreak runs through this book, because it teaches the book's central lesson better than any hypothetical could. A pandemic does not begin in a hospital. It begins where people, animals and the environment they share come into contact: a farm, a market, a forest edge, a cave, a backyard flock. At that point the pathogen is usually still infecting animals, a few humans at most, and a small geographic area. Whether the event fizzles out or grows into a global catastrophe depends heavily on whether anyone notices, and whether whoever notices has the authority, the resources and the incentive to act. For most of modern history, those conditions have been met in medicine and ignored in agriculture and ecology, or the reverse. The veterinarian who sees the sick cow does not see the sick farm worker. The physician who sees the worker's red eye does not ask about the cows. The ecologist who knows that the local bat colony has lost its winter food supply has no one to tell. The controlling idea This book argues one thing. Zoonotic pandemics are prevented, if they are prevented at all, at the animal-human-environment interface, and surveillance there works only when it is built as a single system: one that reaches upstream to the ecological and economic drivers of spillover, joins the human, animal and environmental sectors in real time, and is tied to people who have the authority and the incentive to act on what they see. Take away any of those three elements and the system fails in predictable ways. The failures show up again and again across a quarter-century of outbreaks, from Nipah virus in Malaysian pig farms to SARS in the markets of Guangdong to H5N1 in American milking parlours. The idea has a name, One Health, and the name has become so familiar that it risks meaning nothing. Every major international health agency has endorsed it. National action plans cite it in their titles. Conference programmes are full of it. Yet the dairy outbreak happened in a country with some of the best-funded human and veterinary public health agencies in the world, and those agencies still struggled for months to share data, test workers, sample milk and persuade farmers to report. The problem was never a shortage of endorsement. The trouble is that One Health is usually treated as an attitude, a willingness to collaborate. What it actually has to be is an architecture: shared data systems, joint decision rights, legal mandates, compensation schemes and funding lines that survive the next budget cycle. This book is mostly about that architecture and why it is so hard to build. Why zoonoses matter so much A few numbers frame the problem, and they are worth stating carefully. In a widely cited 2001 analysis, Louise Taylor and colleagues at the University of Edinburgh catalogued 1,415 species of infectious organisms known to cause disease in humans. About 61 percent were zoonotic, meaning they can pass between vertebrate animals and humans. Among pathogens classed as emerging, zoonoses were about twice as common as non-zoonoses. Seven years later, Kate Jones and colleagues analysed 335 events of emerging infectious disease between 1940 and 2004, published in Nature. They found that 60 percent were zoonotic, that roughly 72 percent of those came from wildlife rather than domestic animals, and that the rate of emergence was rising after controlling for better reporting. The last century's great pandemic and near-pandemic events bear this out. The influenza pandemics of 1918, 1957, 1968 and 2009 were all caused by viruses carrying genes from animal influenza viruses. HIV arose from simian immunodeficiency viruses of chimpanzees and sooty mangabeys, which crossed into people in west-central Africa early in the twentieth century. SARS in 2002 and 2003, MERS from 2012 onward and COVID-19 from 2019 were all caused by coronaviruses whose closest relatives live in bats. The West African Ebola epidemic of 2013 to 2016, which killed more than 11,000 people, began with a single spillover of a virus whose reservoir is thought to be bats. Almost every serious threat on the World Health Organization's list of priority pathogens has an animal reservoir. This does not mean that animals are the enemy or that wildlife should be feared. Most animal viruses never infect people. Most that do infect people never spread between them. Emergence is a rare outcome at the end of a long chain of improbable events. But the chain can be made more or less likely by what humans do: how we clear land, farm animals, trade wildlife, build cities and move goods. Pathogens are not new; the conditions that let them cross are. That is why prevention has to operate on those conditions and not only on the pathogens. What this book covers and what it leaves out The chapters run from biology through ecology and institutions to the two viral families that most concern pandemic planners today, and then to governance. Chapter 1 sets out how spillover actually happens, as a sequence of barriers a pathogen must cross, and why that framing matters for surveillance. Chapter 2 looks at the ecological drivers that make spillover more likely: land-use change, agricultural intensification, the wildlife trade and a changing climate. Chapter 3 examines One Health as an institutional project, its history and its persistent failure modes. Chapter 4 describes the surveillance tools themselves, from indicator-based reporting to genomics and wastewater, and asks which ones catch spillover early and which only confirm it late. Chapter 5 turns to live animal markets, the best-documented amplifiers of zoonotic risk and one of the hardest places to intervene fairly. Chapters 6 and 7 cover avian influenza: first the long history of H5N1 and the global panzootic of clade 2.3.4.4b, then the dairy cattle outbreak as a detailed case study. Chapter 8 covers the coronaviruses, from SARS through MERS to COVID-19, including the unresolved question of SARS-CoV-2's origin and the less discussed problem of human-to-animal spillback. Chapter 9 addresses governance: the International Health Regulations and their 2024 amendments, the WHO Pandemic Agreement adopted in May 2025, the still-unfinished negotiations over pathogen sharing, and the financing and trust on which all of it depends. The Conclusion draws out what should change. Some important subjects receive less space. Vector-borne zoonoses such as West Nile virus, Lyme disease and Rift Valley fever are mentioned where they illustrate a point about ecology but are not treated in depth. Antimicrobial resistance is a genuine One Health problem but a different one, driven by drug use rather than spillover, and it would need a book of its own. Bioterrorism and laboratory biosafety come up only where they bear directly on surveillance and origins. Clinical management of individual zoonotic infections is outside the scope. The book is written for readers who want to understand the field seriously without being specialists: clinicians in training, students of public health and veterinary medicine, policy staff and educated general readers. It avoids jargon where it can and explains it where it cannot; a short glossary appears at the end. All figures are drawn from named sources, and where the evidence is uncertain or contested, particularly on the origins of COVID-19, the book says so directly instead of choosing a side the evidence does not support. One more framing point. It is tempting to write about pandemic prevention as a technical problem: better sequencing, faster diagnostics, more computing power to predict which viruses will jump. Those tools matter and later chapters discuss them. But the dairy outbreak was not slowed by a shortage of sequencing machines. It was slowed because farmers feared losing their markets, workers feared losing their jobs or their immigration status, state and federal agencies had overlapping and unclear authority, and nobody had built the compensation schemes, legal mandates and trusted relationships that would make reporting rational. Surveillance is a social system with laboratory equipment attached. The chapters that follow try to keep both halves in view. Chapter 1: The Anatomy of Spillover A pathogen that lives in a bat colony in a limestone cave poses no threat to a person three hundred kilometres away. For that to change, a long series of things must happen in the right order. The virus must be abundant in the bats at a particular time. It must leave their bodies in saliva, urine or faeces, and it must survive in the environment long enough to reach another host. A person, or an animal that later contacts a person, must be exposed at a dose large enough to start an infection. The virus must be able to bind to cells in that new host, get inside, replicate and evade the immune response. Even then, most infections go nowhere. For a pandemic, the virus must also spread efficiently from one person to the next, and keep doing so. Each of these steps is a barrier, and each one filters out almost every potential event. Understanding spillover as a sequence of barriers, not a single leap, is the most useful idea in the field, because it tells us where surveillance can look and where intervention can work. Barriers, not leaps In 2017, Raina Plowright and colleagues published a framework in Nature Reviews Microbiology that organised spillover into three broad stages. The first is the dynamics of pathogen pressure: how much of the pathogen is present in the reservoir host population, how it is distributed in space and time, and how much is released into the environment. The second is exposure: the behaviour of humans and recipient animals that brings them into contact with that pathogen, and the survival and dispersal of the pathogen between hosts. The third is susceptibility of the recipient: whether the pathogen can infect the new host once it arrives, which depends on receptor compatibility, dose, route of exposure and the host's immunity. The probability of spillover is roughly the product of the probabilities at each stage. That multiplication has an important consequence. Reducing the probability at any single stage cuts overall risk proportionally, so intervention does not need to target the virus itself. It can target bat food supplies, farm layouts, market hygiene, occupational protective equipment or the timing of human activities. The framework also explains why spillover is so patchy in space and time. All the barriers have to line up at once, which happens only occasionally, in particular places, under particular conditions. Hendra virus in Australia illustrates the stages clearly. The virus lives in flying foxes, large fruit bats of the genus Pteropus. It was first identified in 1994, when it killed horses and their trainer at a stable in the Brisbane suburb of Hendra. Spillover goes from bats to horses, usually through horses eating grass or fruit contaminated with bat urine, and occasionally from horses to people who handle sick animals. There has never been any documented bat-to-human or human-to-human transmission. Every one of the handful of human cases has involved close contact with an infected horse, and the case fatality has been high. The horse is therefore an intermediate, or bridge, host. It amplifies the virus and brings it into close contact with people. Recognising this gave Australia its most effective intervention: an equine vaccine, licensed in 2012, which blocks the horse-to-human route without having to do anything about the bats. It is a clean example of acting on one barrier to break the whole chain. Its limits are also instructive. Uptake among horse owners has been uneven, partly because of cost and partly because of unfounded fears about side effects. A technically perfect intervention still depends on human decisions. Reservoirs, bridges and dead ends Three kinds of host recur throughout this book, and it helps to define them early. A reservoir host maintains the pathogen over the long term, usually without serious disease. Bats are reservoirs for many coronaviruses, henipaviruses such as Hendra and Nipah, and filoviruses such as Marburg. Wild waterfowl, especially ducks, geese and gulls, are the natural reservoirs for influenza A viruses. Rodents carry hantaviruses and arenaviruses such as Lassa virus. The pathogen and reservoir have often co-evolved for a very long time, and the host tolerates infection. A bridge or intermediate host carries the pathogen from reservoir to humans. It may amplify the pathogen, allow it to adapt to mammalian cells, or simply bring it physically closer to people. Pigs amplified Nipah virus in Malaysia in 1998 and 1999. Dromedary camels transmit MERS coronavirus to people in the Arabian Peninsula. Domestic poultry are the main bridge for avian influenza. Civets and raccoon dogs were implicated in SARS. In 2024, dairy cattle became an unexpected new bridge for H5N1. A dead-end host can be infected but does not pass the pathogen on. Most human infections with avian influenza have been dead ends: the person gets sick, sometimes dies, but does not infect others. Dead ends matter for surveillance because each one is a signal that the earlier barriers have been crossed. They also matter because every infection is an opportunity for the pathogen to adapt. A dead end today may not be a dead end after the virus has had many more chances. The distinction between these categories is not fixed. A species can be a dead end for one virus lineage and a bridge for another. Humans themselves can become a reservoir for animals, a phenomenon called reverse zoonosis or spillback, which Chapter 8 discusses in the case of SARS-CoV-2 in farmed mink and wild white-tailed deer. What matters is the network of hosts and the flow of the pathogen through it. Table 1 sets out several of the major zoonotic emergences of recent decades by reservoir, bridge host and the principal human activity that connected them. Table 1. Selected zoonotic emergences by reservoir, bridge host and driver. Disease (first recognised) Reservoir Bridge host Main human driver Hendra (1994, Australia) Flying foxes Horses Bats foraging near stables and suburbs Nipah (1998, Malaysia) Fruit bats Pigs Fruit orchards beside intensive piggeries SARS (2002, China) Horseshoe bats Civets and other market animals Wildlife farming and market trade MERS (2012, Saudi Arabia) Bats (inferred) Dromedary camels Camel husbandry and trade COVID-19 (2019, China) Bats (inferred) Unresolved Contested; market and laboratory hypotheses H5N1 in cattle (2024, USA) Wild waterfowl Dairy cattle Intensive dairying and cattle movement Why a few families dominate Emerging zoonoses are not random draws from the world's viruses. Certain families appear again and again: influenza viruses, coronaviruses, paramyxoviruses such as the henipaviruses, filoviruses, and arenaviruses. Most are RNA viruses. That is not a coincidence. RNA viruses replicate with enzymes that lack proofreading, so they mutate fast and generate enormous genetic diversity in each infected host. Influenza viruses also carry their genome in eight separate segments, so when two different strains infect the same cell they can swap segments. This process, called reassortment, produced the pandemic viruses of 1957, 1968 and 2009. Coronaviruses recombine frequently. Diversity is the raw material for adaptation to a new host. Host traits matter too. In a 2017 analysis in Nature, Kevin Olival and colleagues examined 586 viral species across 754 mammal species. They found that the number of zoonotic viruses a mammal species carries is predicted by its phylogenetic relatedness to humans, the extent of its geographic range overlapping with human populations, and how intensively it has been studied. After adjusting for research effort, bats carried a significantly higher proportion of zoonotic viruses than other mammal orders. Rodents and primates also stood out. The authors used their model to map where undiscovered zoonotic viruses were most likely to be, and the hotspots included northern South America, central Africa and parts of South and Southeast Asia. The emphasis on bats has attracted attention and some misunderstanding. Bats are an enormously diverse order, with more than 1,400 species, and they live in dense colonies, fly long distances and live long lives for their size. Several features of bat immunology, including dampened inflammatory responses, seem to let them tolerate viruses that cause severe disease in other mammals. But bats are not uniquely dangerous in some moral sense, and culling them tends to make things worse. When colonies are disturbed, stressed or dispersed, viral shedding can increase and bats spread into new areas. Bats also pollinate crops, disperse seeds and eat enormous quantities of insects. The practical goal is to reduce the conditions that bring bat viruses into contact with people and domestic animals, not to eliminate the bats. Stuttering chains and the last barrier The final barrier, onward spread between people, deserves separate attention, because it is where a local spillover either ends or becomes an epidemic. Epidemiologists describe it with the reproduction number, usually written R: the average number of people each infected person goes on to infect. If R is well below one, each chain of transmission dies out after a generation or two. If R is above one, chains can grow without limit. Between those poles lies a zone that matters greatly for surveillance, in which R is below one but not by much. Here a spillover produces what are called stuttering chains: clusters of a few, sometimes a dozen or more, linked human cases before transmission fizzles out. Nipah virus in Bangladesh illustrates the zone. Since 2001, Bangladesh has recorded human Nipah infections almost every winter, concentrated in a band of districts in the west and centre of the country. Investigations led by the International Centre for Diarrhoeal Disease Research, Bangladesh, and partners traced most primary cases to drinking raw date palm sap, a seasonal delicacy collected overnight in clay pots hung on the trees. Fruit bats visit the pots to drink the sap and contaminate it with saliva and urine. Unlike the Malaysian outbreak, no livestock amplifier is needed. And unlike Malaysia, the Bangladesh virus spreads between people, typically to family members and others who care for severely ill patients, through contact with respiratory secretions. In an outbreak in Faridpur district in 2004, a chain of person-to-person transmission ran through several generations. Yet across two decades, the chains have always ended. The virus's R in people has stayed below one. The theoretical significance of stuttering chains was set out in a 2003 paper in Nature by Rustom Antia and colleagues. They showed that a pathogen with an R below one in its new host can still evolve toward an R above one, because each human infection gives the pathogen a chance to acquire adaptive mutations. The longer the chains, the more chances. A pathogen with an R of 0.9 generates many more human infections per spillover than one with an R of 0.2, and therefore many more opportunities to cross the threshold. The practical conclusion is that surveillance should pay particular attention to spillovers that produce clusters, even small ones, and to any evidence that cluster sizes are growing over time. A shift in the size distribution of clusters can be an early warning that a pathogen is adapting to people before any sustained epidemic begins. This framing also explains why the frequency of spillover matters, not only its severity. A pathogen that spills over once a decade has few chances to adapt. One that spills over hundreds of times a year, as avian influenza now does into mammals, has many. Every infection prevented at the interface removes a chance for evolution, even if that particular infection would have been a dead end. Prevention and surveillance at the interface are therefore not merely about catching the one spillover that matters. They are about reducing the number of lottery tickets the pathogen gets to play. The Bangladesh case shows, too, how surveillance can be designed around the barrier where it is cheapest to intervene. Researchers found that covering the sap-collection pots with inexpensive bamboo or cloth skirts prevented bats from reaching the sap. Public health messaging to avoid raw sap, or to boil it, targets the same exposure. Neither requires knowledge of the virus's genome or any sampling of bats. Both depend on understanding a local practice and persuading people to change it, which has proved harder than the biology. Sap collectors have economic reasons to prefer uncovered pots, and raw sap is valued for its taste. Community-based approaches that involve collectors in designing the interventions have done better than instructions from outside. What the barrier model means for surveillance Once spillover is understood as a series of barriers, surveillance can be designed to watch each one. That means looking in three places, and most systems look only in the last. The first place is the reservoir. Is pathogen prevalence rising in bats, birds or rodents? Are new variants circulating? Are the animals under ecological stress that tends to increase shedding? This is the domain of wildlife ecology and virology, and it is where surveillance is weakest and hardest to fund. Wildlife is difficult to sample. Results are hard to interpret without long baseline series, and nobody's livelihood depends on the health of a bat colony. The second place is the interface: the bridge hosts and the settings where animals and people meet. Domestic livestock, farmed wildlife, market animals, companion animals and the people who work with them are all candidates. This is where early warning is most practical. The populations are defined, they are often already subject to veterinary oversight, and a signal there comes before widespread human disease. In the H5N1 dairy outbreak, dead cats and falling milk yields were signals at the interface weeks before the virus was identified. The third place is the human population. Traditional disease surveillance lives here: clinicians reporting unusual cases, laboratories reporting positive results, hospitals reporting clusters of severe respiratory illness. It is essential and it is late. By the time a novel pathogen is detected in humans, it has already cleared most barriers. If it spreads efficiently between people, the window for containment may be days. The barrier model also shows why surveillance in any single sector will miss things. A virus can amplify in pigs without killing them, so farm mortality data will not reveal it. A human infection may be mild and never tested. A wild bird die-off may be recorded by an ecologist who has no line to the public health department. Only when the three sectors are joined, so that a signal in one prompts investigation in the others, does the chain of barriers become visible as a whole. This joining is what One Health promises. Before examining whether it delivers, the next chapter asks the prior question: why are the barriers falling more often now than they used to? The answer lies in how humans have changed the landscapes and food systems through which pathogens move. Chapter 2: The Ecological Drivers of Spillover In the winter of 1998, pig farmers in the Kinta district of Perak, in northern peninsular Malaysia, began to notice that their animals had developed a harsh, barking cough. Some pigs had trembling and spasms. Shortly afterwards, farm workers and people living near the farms started coming down with encephalitis. At first the outbreak was attributed to Japanese encephalitis, a mosquito-borne virus already known in the region, and the response focused on mosquito control and vaccination. The cases kept coming, and they did not fit: the victims were overwhelmingly adult men who worked with pigs, not the children usually affected by Japanese encephalitis, and people who had been vaccinated were falling ill. By the time the real cause was identified in 1999, as a previously unknown paramyxovirus named Nipah after the village where it was isolated, the outbreak had spread along the pig trade to other states and to Singapore. It caused about 265 cases of encephalitis and more than 100 deaths in Malaysia. To stop it the government culled more than a million pigs, and the country's pig industry was devastated. The subsequent investigation became one of the classic stories of ecological emergence. The reservoir was fruit bats. The index farm was large and intensive, with thousands of pigs in open-sided pens. Mango trees had been planted around the pens, a common practice that gave farmers a second income. Bats fed in the trees and dropped partly eaten fruit and urine into the pig enclosures. The pigs became infected, amplified the virus, and passed it to each other and to the people who worked with them. Researchers later argued that the timing was influenced by broader forces: deforestation and forest fires in Southeast Asia, worsened by the severe El Niño of 1997 and 1998, may have reduced the bats' wild food supplies and pushed them toward cultivated fruit. The exact contribution of each factor is still debated, but the essential pattern is not. A chain of human decisions about land, farming and trade assembled the conditions for spillover, and the virus took advantage. This chapter examines the main drivers of that assembly, grouped under four headings: land-use change, agricultural intensification, the wildlife trade and climate change. None acts alone, and all of them act through the barriers described in the previous chapter. Four drivers Land-use change and the forest edge Deforestation is the most frequently cited driver of zoonotic emergence, and the evidence supports it, though the mechanism is more interesting than simple contact with the forest. When a continuous forest is cut into fragments by roads, farms and settlements, the amount of edge habitat increases enormously. Edges are where people, livestock and wildlife overlap. They are also where the structure of wildlife communities changes. In 2020, Rory Gibb and colleagues published an analysis in Nature of nearly 7,000 ecological communities across six continents. They found that in human-dominated landscapes such as farmland, pasture and urban areas, the species that remain tend to be ones that host a larger number of human pathogens, including zoonotic ones, compared with the species that disappear. Rodents, bats and passerine birds that thrive around people are often fast-living species that invest less in immune defence and more in reproduction, which may make them better hosts. When a forest is converted to farmland, the losers tend to be large, slow-breeding specialists, and the winners tend to be generalists that also carry the most shareable pathogens. This is a probabilistic effect across many communities, not a law for every patch of land, and ecologists continue to debate the so-called dilution effect, the idea that biodiversity in general protects against disease. For some diseases, such as Lyme disease in the northeastern United States, biodiversity seems to matter. For others the relationship is weak or reversed. The robust finding is narrower and more useful. Land conversion tends to favour the kinds of animals that carry zoonotic pathogens, and it brings them into close contact with people and livestock at the same time. Mining, logging and road building also bring people into forests in a particular way: large numbers of mostly young men, living in temporary camps, often hunting wildlife for food, and connected by new roads to cities. Several outbreaks of Ebola in Central Africa have been linked to hunting or handling of wild animal carcasses, and the expansion of roads into previously remote areas has shortened the distance between a spillover in a village and a case in a capital. The West African Ebola epidemic of 2013 to 2016 appears to have started with a single child in the village of Meliandou in Guinea, in a region with extensive forest loss. The epidemic became catastrophic mainly because the region was densely connected to cities and borders, and because health systems had been hollowed out by years of conflict and underinvestment. Agricultural intensification and the livestock bridge The largest mammal population on Earth after humans is not wild. It is domestic livestock. By most estimates, cattle, pigs, sheep and goats together outweigh all wild mammals many times over, and domestic poultry outnumber all wild birds by biomass. That vast population of domestic animals is the most important bridge between wildlife pathogens and people. Intensive livestock production creates particular risks. Large numbers of genetically similar animals are housed densely, which gives a pathogen many hosts at once and high contact rates. Rapid turnover means a constant supply of young, immunologically naive animals. Animals, feed, equipment and people move frequently between farms and regions, often across long distances. Where biosecurity is excellent and animals are fully enclosed, the risk of contact with wildlife can be very low. Where farms are semi-open, as in the Malaysian piggeries, or where wild birds can reach feed, water or bedding, the dense population becomes an amplifier. The H5N1 epidemic in dairy cattle, discussed in Chapter 7, is a textbook case of the second risk: movement. Genomic analysis indicates that the virus entered cattle probably in a single spillover from wild birds in the Texas Panhandle in late 2023, and was then carried across the country mainly by the movement of lactating cows, milking equipment and people between farms. The density of dairy operations and the frequency of animal movements, not the number of wild birds, decided how far it spread. Intensification is not uniquely risky compared with the alternative. Backyard and smallholder systems, in which chickens, ducks and pigs roam freely and mix with wild birds and with each other, have their own well-documented risks. Much of the human H5N1 infection in Asia, Egypt and Cambodia has been associated with backyard flocks. The dangerous configurations are the mixed ones: free-ranging ducks on rice paddies used by wild waterfowl, backyard birds sold into markets supplied by commercial farms, or intensive units with holes in their biosecurity. Surveillance needs to cover the whole production system, including the parts that are informal and unregistered. The wildlife trade The trade in wild animals ranges from subsistence hunting to industrial farming of species such as civets, raccoon dogs, bamboo rats and mink, to international trade in exotic pets. It moves live animals of many species, often stressed and in poor health, through networks that bring them together in close quarters and into contact with large numbers of people. Chapter 5 examines live animal markets in detail. Here the point is broader: the trade connects distant reservoirs to dense human populations, and it mixes species that would never meet in nature. The SARS outbreak of 2002 and 2003 made this concrete. Early cases in Guangdong province were disproportionately among people who handled or prepared wild animals for food. Researchers who sampled animals in a Shenzhen market in 2003 found SARS-like coronaviruses in masked palm civets and a raccoon dog. Later work showed that civets were not the reservoir: farmed civets away from the markets were largely uninfected, and the ancestral viruses were eventually traced to horseshoe bats. The civets were an intermediate host infected through the trade. When Chinese authorities temporarily banned the trade and culled civets in markets, SARS-like virus detection in the markets dropped. The international pet trade has also moved pathogens. In 2003, an outbreak of mpox in the United States Midwest was traced to prairie dogs that had been housed with rodents imported from Ghana. Several dozen human cases were confirmed or judged probable. No one died, but the outbreak showed how easily a pathogen from a West African rodent could reach an American child through a pet shop. Climate change and shifting ranges Climate change acts on spillover mainly by moving animals. As temperatures rise and rainfall patterns shift, species move toward the poles and up mountainsides, and they encounter other species they have never met. In a 2022 study in Nature, Colin Carlson and colleagues modelled how the geographic ranges of more than 3,000 mammal species would shift under several climate scenarios. They projected that by 2070, species would come into contact with new species for the first time more than 300,000 times, resulting in at least 15,000 new cross-species transmission events of viruses between mammals. Bats, because they fly, dominated those projected events, and the hotspots were concentrated in high-elevation, species-rich areas in Africa and Asia that also have growing human populations. The authors noted that much of this reshuffling may already be under way, even under the most optimistic warming scenario. These are modelled estimates, not observations, and the assumptions are strong. But the direction is supported by direct evidence of climate-driven change in disease systems. Mosquito-borne diseases such as dengue are spreading to higher latitudes and altitudes. Migration timing of wild birds, which carry avian influenza, is shifting. Extreme weather events, droughts and fires disrupt the food supplies of animals such as bats, which can trigger the kinds of stress and movement discussed below. A worked example: Hendra and the loss of winter food The most complete account of how ecological change drives spillover comes from a long-term study of Hendra virus in Australia, published in Nature in 2023 by Peggy Eby, Raina Plowright and colleagues. It deserves attention because it shows what surveillance upstream could look like. The team assembled 25 years of data on flying fox behaviour, habitat, climate and Hendra spillovers to horses. They found that spillovers began clustering from about 2006 onward, and that the clusters followed a specific sequence. First, a strong El Niño brought drought, which led to a food shortage for flying foxes the following winter. Hungry bats abandoned their traditional nomadic foraging in native forests and dispersed into smaller colonies in agricultural and urban areas, where they fed on less nutritious but reliable food such as introduced plants and garden trees. Under nutritional stress, the bats shed more virus. Horses in the paddocks below became infected. The decisive long-term change was the loss of the winter-flowering eucalyptus forests that had historically fed the bats through the lean season. Most of those forests had been cleared for agriculture and development. In years when the remaining forest flowered heavily, bats returned to it en masse, abandoned the agricultural roosts, and spillovers stopped, even after an El Niño year. The authors concluded that restoring and protecting winter-flowering habitat could be a durable way to prevent spillover, and that food shortages and flowering events could be used to forecast high-risk periods up to two years ahead. This is the barrier model working end to end. Land clearing reduced food supply. Climate variability made the shortage acute. Bat behaviour shifted, increasing contact with horses, and nutritional stress increased viral shedding. Each link could be monitored with ecological data, not virological sampling, and each could be targeted. It is also a warning about timescales. The drivers built up over decades, and the fix, restoring forests, will also take decades. An objection: are the drivers overstated? A fair-minded reader might object that the link between these drivers and emergence is asserted more often than it is demonstrated. The objection has some force and deserves an answer. First, much of the evidence is correlational. Studies that map emerging disease events find them concentrated in places with high human population density, high biodiversity and rapid land-use change. But those same places are often where research effort and reporting have grown fastest, and statistical corrections for reporting bias are imperfect. An apparent hotspot can partly reflect where scientists work. Second, the drivers interact in ways that make simple claims unreliable. Deforestation can increase contact with some wildlife and reduce contact with others. Intensive farming can raise the density of hosts while also raising biosecurity. Climate change can expand the range of some vectors and shrink the range of others. A statement such as "deforestation causes pandemics" is too crude to guide policy. Third, human mobility and health system weakness often decide whether a spillover becomes an epidemic, independent of how the spillover arose. The West African Ebola epidemic was catastrophic because of urban connectivity and health system collapse, not because the initial spillover was unusual. The answer is not to abandon the drivers but to be precise about them. The strongest evidence comes from specific systems studied in depth, such as Hendra in Australia and Nipah in Malaysia and Bangladesh, where the mechanism from land use or farm design to exposure has been traced step by step. The broad, global correlations are best treated as a guide to where to look, not as proof of cause in any particular place. And the value of acting on drivers does not depend on each one being proven individually. Reducing forest clearance, improving farm biosecurity and regulating wildlife trade have other benefits for biodiversity, climate and animal welfare, which makes them reasonable bets even under uncertainty about their exact contribution to spillover risk. There is also an asymmetry worth noting. The costs of surveillance and prevention at the interface are modest and fairly certain. The costs of a pandemic are enormous and, as COVID-19 showed, can run to many trillions of dollars and millions of lives. Where the evidence for a driver is plausible and the intervention has other benefits, the burden of proof should not fall entirely on those who want to act. What drivers mean for surveillance The practical lesson of this chapter is that some of the most powerful early warning signals for spillover are not pathogen detections at all. They are measures of the drivers: forest loss in particular regions, expansion of livestock operations into bat habitat, changes in the wildlife trade, food shortages among reservoir species, climate anomalies. These data are gathered, often in great detail, by agencies of agriculture, environment, forestry and meteorology that have no formal link to public health. A surveillance system that uses them would treat a failed eucalyptus flowering season in Queensland, a new pig farm next to a fruit bat roost in Bangladesh or a surge in wildlife farming in a province as reasons to increase monitoring. It would not wait for sick people. That requires a kind of institutional integration most countries have never attempted, and it requires those other agencies to see disease prevention as part of their job. The next chapter asks why that integration has been so slow to arrive, despite decades of consensus that it is needed. Chapter 3: One Health as an Institution, Not a Slogan The idea that human and animal medicine are one discipline is old. Rudolf Virchow, the nineteenth-century German pathologist who coined the word "zoonosis", argued that there was no scientific dividing line between human and animal medicine and that none should exist. William Osler, who trained partly under Virchow's influence, lectured at a veterinary college in Montreal and wrote on animal disease. In the twentieth century, the American veterinary epidemiologist Calvin Schwabe revived the argument under the phrase "one medicine" in his textbook on veterinary medicine and human health, first published in 1964. For most of the twentieth century, though, the practical history went the other way. Human medicine and veterinary medicine grew into separate professions, with separate schools, licensing bodies, ministries, budgets and international organisations. Environmental science emerged later and separately again. Human health came under ministries of health and the World Health Organization, founded in 1948. Animal health came under ministries of agriculture and what was then the Office International des Epizooties, founded in 1924 and now the World Organisation for Animal Health (WOAH). Food and agriculture belonged to the Food and Agriculture Organization of the United Nations (FAO), and the environment eventually got the United Nations Environment Programme (UNEP). Each built its own surveillance systems, its own data standards and its own legal instruments. The division made sense for many purposes. It made very little sense for zoonoses, which by definition fall between the silos. This chapter traces how One Health moved from a principle to a set of institutions, what those institutions do, and why they still fall short. From principle to programme The modern revival of One Health has a date and a place. In September 2004, the Wildlife Conservation Society convened a meeting at Rockefeller University in New York titled "One World, One Health". It produced twelve recommendations, the Manhattan Principles, calling for an integrated approach to preventing epidemic and epizootic disease that recognised links among human, domestic animal and wildlife health and the threat disease posed to ecosystems. The timing was not accidental. SARS had just shown how a wildlife virus could travel the world in weeks, and H5N1 avian influenza was spreading through poultry across Asia and killing people. H5N1 did more than any other threat to turn the principle into institutions. Its spread from 2003 onward forced ministries of health and agriculture to cooperate on culling, compensation, surveillance and risk communication. International donors funded integrated preparedness programmes. In 2010, FAO, WOAH (then OIE) and WHO signed a Tripartite concept note committing them to share responsibilities and coordinate global activities on health risks at the animal-human-ecosystem interface. In 2022 UNEP joined, forming what is now called the Quadripartite. Two documents from 2021 and 2022 define the current consensus. The first is a definition developed by the One Health High-Level Expert Panel (OHHLEP), a group of experts convened by the four organisations. Its full text is long, but its core states that One Health is an integrated, unifying approach that aims to sustainably balance and optimise the health of people, animals and ecosystems, recognising that these are closely linked and interdependent. The definition emphasises that the approach mobilises multiple sectors, disciplines and communities at varying levels of society, and it explicitly includes ecosystems and the environment as equal partners, not just a backdrop for animal and human health. That last point matters. Earlier versions of One Health were, in practice, mostly about human doctors and veterinarians talking to each other. Environmental agencies and ecologists were frequently absent. The environmental sector's entry into One Health was signalled by a 2020 report from UNEP and the International Livestock Research Institute, Preventing the Next Pandemic: Zoonotic Diseases and How to Break the Chain of Transmission. It identified seven human-driven factors behind the emergence of zoonoses: increasing demand for animal protein; unsustainable agricultural intensification; increased use and exploitation of wildlife; unsustainable use of natural resources accelerated by urbanisation, land-use change and extractive industries; increased travel and transportation; changes in food supply chains; and climate change. The list maps closely onto the drivers discussed in Chapter 2. Its significance lay less in novelty than in authorship. An environmental agency was stating, in its own name, that decisions about land, agriculture and resource extraction are pandemic prevention decisions. That reframing has not yet changed how most environment ministries set their priorities, but it has given them a mandate to take part. The second document is the One Health Joint Plan of Action for 2022 to 2026, launched by the Quadripartite in October 2022. It sets out six action tracks: building One Health capacity in health systems; reducing the risks from emerging and re-emerging zoonotic epidemics and pandemics; controlling and eliminating endemic zoonotic, neglected tropical and vector-borne diseases; strengthening assessment, management and communication of food safety risks; curbing the silent pandemic of antimicrobial resistance; and integrating the environment into One Health. The plan is a framework for coordination. It does not come with binding obligations or large dedicated funds, and its period of implementation ends in 2026, the year this book was written. Tools that turn principle into procedure Beyond the high-level frameworks, the most useful contributions of the One Health movement have been practical tools that countries can use to build joint working. Three are worth describing. The first is joint prioritisation. The One Health Zoonotic Disease Prioritization process, developed by the United States Centers for Disease Control and Prevention and used in dozens of countries, brings representatives from human health, animal health, environment and other sectors into a room for several days to agree on a short list of zoonoses that deserve joint attention, usually five to seven. The value is partly in the list and partly in the process: it makes officials from different ministries define shared criteria, argue through their differences, and leave with named contacts in each other's departments. In many countries the most commonly prioritised diseases include rabies, zoonotic influenza, anthrax, brucellosis and viral haemorrhagic fevers. The second is operational guidance. The Tripartite Zoonoses Guide, published in 2019 by FAO, WOAH and WHO, sets out how to establish coordination mechanisms, conduct joint risk assessments, run joint outbreak investigations and share surveillance information. It is accompanied by specific tools, such as the Joint Risk Assessment Operational Tool, which walks teams from different sectors through a structured assessment of a particular zoonotic threat so that they arrive at a common view of the risk and the uncertainties. The third is assessment. Under the International Health Regulations, countries can undergo a Joint External Evaluation, a voluntary peer review of their capacity to prevent, detect and respond to public health threats, which includes indicators for zoonotic disease and for coordination between human and animal health. WOAH runs a parallel process, the Performance of Veterinary Services Pathway, that evaluates national veterinary systems. The two have been bridged through joint workshops that bring the results together and identify gaps where neither sector is doing its job. These tools have created real One Health structures in many countries, often called One Health platforms or coordination units, typically housed in a ministry or the prime minister's office. Kenya established a Zoonotic Disease Unit jointly staffed by the ministries of health and agriculture in 2011, and it has become a frequently cited model. Several countries now run joint rabies and anthrax investigations as routine. These are genuine achievements, and they were built with very modest money. A worked example: rabies The clearest demonstration that One Health can work is also the oldest zoonosis on most priority lists: rabies. It is worth looking at in some detail, because it shows what sustained joint action achieves and why it is still unfinished. Rabies kills tens of thousands of people every year. A widely cited 2015 study led by Katie Hampson estimated about 59,000 human deaths annually, most of them in Africa and Asia, and a large proportion of them children. Almost all are caused by bites from infected dogs. Once symptoms begin, the disease is virtually always fatal. Yet it is entirely preventable: prompt post-exposure prophylaxis, consisting of wound washing, vaccine and in some cases rabies immunoglobulin, prevents death in people who are bitten, and vaccinating dogs stops the virus circulating at its source. The economics of rabies make the One Health argument in miniature. Treating people after bites is expensive, and it never ends, because as long as the virus circulates in dogs, people keep getting bitten. Vaccinating dogs is cheaper over time, and modelling and field experience suggest that vaccinating around 70 percent of a dog population in annual campaigns can interrupt transmission. But the costs of dog vaccination fall on veterinary budgets, while the savings accrue to human health budgets. Without a mechanism to join the two, the rational choice for each ministry, taken separately, is to underinvest. Latin America shows what happens when that mechanism exists. From 1983, under a regional programme coordinated by the Pan American Health Organization, countries in the Americas ran mass dog vaccination campaigns alongside improved access to post-exposure prophylaxis and integrated surveillance of human and animal cases. Human rabies transmitted by dogs fell by more than 95 percent across the region over the following decades, and several countries have eliminated it. The remaining human rabies in much of the Americas now comes from wildlife, especially vampire bats, which raises a different set of problems. Globally, WHO, WOAH, FAO and the Global Alliance for Rabies Control launched a strategic plan in 2018, known as Zero by 30, with the goal of ending human deaths from dog-mediated rabies by 2030. Progress has been uneven. Where it has come, it has come from integrated programmes that share data between human and animal health, such as integrated bite case management, in which every reported dog bite triggers both assessment of the person for prophylaxis and investigation of the animal. That practice turns each bite into a surveillance event for both sectors at once. Rabies is not a pandemic threat, but it teaches three lessons that apply directly to one. Joint action pays when costs and benefits are pooled across sectors. Integration works best when it is built into routine practice, such as the handling of each bite, rather than reserved for emergencies. And the hard part is not the technical intervention, which has been known for more than a century, but sustaining funding and political commitment across ministries year after year. Where the silos persist Despite this progress, One Health remains weakest exactly where it matters most for pandemic prevention: in the fast, joint response to a novel event at the interface. The reasons fall into five groups, and Table 2 summarises the differences in how the human, animal and environmental sectors typically operate. The first is mandate. Ministries of health exist to protect human health. Ministries of agriculture exist, in large part, to support agricultural production and trade. When a zoonotic pathogen appears in livestock, these goals can conflict directly. Aggressive surveillance and reporting in animals protects human health but threatens trade, since a confirmed outbreak can trigger export bans from trading partners. An agriculture ministry is not acting in bad faith when it hesitates. It is doing what it was built to do. The second is data. Human disease surveillance systems collect personal health information under strict privacy rules. Animal disease systems often collect farm-level data that owners regard as commercially sensitive. Environmental monitoring collects data in yet other formats. There are few common identifiers, standards or platforms to link a human case to a farm or a wildlife event. Even within a single country, sharing data across ministries may require legal agreements that take months to negotiate. The third is authority. Veterinary services typically have strong legal powers over animals, including the power to quarantine, test and cull. Public health authorities have strong powers over human disease reporting and isolation. But powers over farm workers as workers, over wildlife as wildlife, or over the environment as a source of risk are often weak, fragmented, or held by agencies with no health role. In federal systems such as the United States, powers are divided again between federal and state governments. The fourth is money. International funding for human health has for decades dwarfed funding for animal health and environmental health. Veterinary services in many low-income countries have been starved since structural adjustment reforms of the 1980s and 1990s reduced public veterinary employment. Wildlife health surveillance is often funded by short-term research grants, not permanent budgets. One Health coordination bodies frequently have almost no budget of their own. The fifth is incentive. Farmers, traders, hunters and workers are the people who see disease first. Whether they report it depends on what happens next. If reporting leads to culling without fair compensation, loss of market access, or trouble with immigration authorities, the rational choice is silence. Every successful animal disease control programme, from rinderpest eradication to the containment of foot-and-mouth disease, has depended on making reporting worthwhile for the people who report. Table 2. How the human, animal and environmental health sectors typically differ. Feature Human health Animal health Environmental health Lead ministry Health Agriculture Environment or natural resources International body WHO WOAH, FAO UNEP Primary mandate Protect population health Protect animal health, production and trade Protect ecosystems and biodiversity Main legal powers Case reporting, isolation Quarantine, movement control, culling Land use, protected species Main data sources Clinics, laboratories, hospitals Farm inspections, abattoirs, labs Field ecology, remote sensing Typical weakness Late detection Trade conflict, underfunding Rarely linked to disease response What a working One Health system requires The sections above point to a set of requirements that distinguish a working system from a slogan. None is technically difficult. All are politically difficult. A working system needs standing joint structures with real authority, not coordination committees that meet only when there is a crisis. It needs agreed rules, set in advance, for when a signal in one sector triggers investigation in another: for example, that any confirmed highly pathogenic avian influenza in a mammal triggers active case-finding among exposed people within a defined time. It needs data-sharing agreements and interoperable systems in place before an outbreak, with legal protections for commercially sensitive information that allow rapid sharing without exposing farms to ruin. It needs compensation and support schemes that make reporting rational for farmers and workers, funded in advance so they can pay promptly. It needs sustained funding for animal and environmental surveillance that does not depend on the last crisis. And it needs trust, built through repeated routine collaboration, between people in different agencies who will have to work together fast under pressure. The test of these requirements is what happens when something unexpected occurs. In 2024, the United States, a country with sophisticated human and animal health systems, well-trained professionals and a long record of One Health rhetoric, faced a novel event at the interface. Chapter 7 describes how its system performed. Before that, the next chapter sets out the tools a surveillance system has at its disposal, from the traditional to the experimental. Hashtags: #ZoonoticDiseaseSurveillance #OneHealthApproach #PandemicPrevention #ZoonoticDiseases #SpilloverRisk #AnimalHumanEnvironmentInterface #OneHealthSurveillance #EmergingInfectiousDiseases #ReservoirHosts #BridgeHosts #WildlifeSurveillance #LivestockSurveillance #EcologicalSurveillance #PathogenSurveillance #GenomicSurveillance #AvianInfluenza #H5N1 #PandemicPreparedness #SpilloverPrevention #LandUseChange #AgriculturalIntensification #WildlifeTrade #ClimateDrivenEmergence #OneHealthGovernance #FutureOfPandemicPrevention Pasted markdown

Download the Book (PDF): Introduction A nine-year-old boy in a resource room hits his head against the table when a worksheet is placed in front of him. His teacher, a behavior analyst, and his parents want to know two things: what will reduce the head hitting, and how they will know that whatever they try is responsible for the change. The first question is clinical. The second is experimental, and it is the subject of this book. The usual answer to the question "does this intervention work?" is a randomized controlled trial. Recruit a few hundred children, assign half to the intervention and half to a comparison condition, and compare the group means at the end. That design has earned its authority, and nothing here argues against it. But it answers a question about averages across populations, and the people who work with this boy need an answer about him. They also need it within weeks, not years, and they need it in a form that tells them when to change course. A group average of a moderate effect size says nothing about whether this child is among those who improved, those who did not change, or those who got worse. Single-case experimental designs were built for that situation. The name misleads a little. These are not case studies, and they rarely involve a single case. They are experiments in which each participant serves as his or her own control, behavior is measured repeatedly over time, and the investigator deliberately introduces and removes, alternates, or staggers an intervention so that changes in behavior can be attributed to it rather than to maturation, a change in medication, a new classroom aide, or any of the dozens of other things that happen in a child's life during a school term. A well-run single-case study typically involves three to eight participants, and its conclusions rest on replication of an effect within and across those participants. Why these designs matter now Single-case research is not a niche curiosity. It is the dominant experimental method in applied behavior analysis and one of the main sources of evidence for interventions in special education, including many of the practices now listed as evidence-based for autistic learners, for students with emotional and behavioral disorders, and for learners with severe intellectual disabilities. It is increasingly used in neuropsychological rehabilitation, speech-language pathology, occupational therapy, sports science, and clinical psychology. When the What Works Clearinghouse of the US Institute of Education Sciences began reviewing single-case studies in 2010, it signaled that this evidence could stand alongside group experiments in policy decisions, provided the studies met explicit standards. The designs matter for three practical reasons. First, many of the populations served in special education are small and heterogeneous. A randomized trial of an intervention for children with a rare genetic syndrome and self-injury may be impossible to recruit for, and even if it were, the heterogeneity of the sample would swamp the effect. Second, the interventions themselves are often individualized. A function-based behavior support plan for one child is not the same treatment as the plan for another, even if both are described as "function-based." Third, practitioners need a way to make defensible decisions about individual students, and the logic of single-case design, applied with care, gives them one. What this book argues The controlling idea of this book is simple to state and harder to practice: a single-case design is an argument built from predicted and replicated changes in an individual's behavior, and it is the design's logic of prediction, verification, and replication, not any statistic computed afterward, that demonstrates experimental control. Visual analysis and non-overlap metrics are tools that serve that argument. They cannot rescue a design that does not contain it. This matters because the field has spent the past two decades arguing about analysis. Should visual inspection of graphs be replaced by statistics? Which of the dozen non-overlap indices is best? Should single-case studies report effect sizes comparable to Cohen's d so they can enter meta-analyses alongside group designs? These are good questions, and later chapters take them seriously. But a common error in both published research and practice is to treat the metric as the finding. A study with three data points in baseline, a Tau-U of 0.92, and no replication of the effect across time or participants has not demonstrated anything, however impressive the number. A study with clean replications across four participants whose intervention was introduced at staggered, randomly determined times has demonstrated a great deal, even if the investigators never computed an index at all. How the book is organized The book moves from logic to measurement, then through the three major design families named in its title, then to analysis, and finally to the standards by which a design is judged. Chapter 1 sets out the logic of within-subject experimentation: the steady-state strategy inherited from the experimental analysis of behavior, the triad of prediction, verification, and replication, and the threats to internal validity that each design must answer. Chapter 2 is about measurement, because no design can compensate for a poorly defined, unreliably recorded, or insensitive dependent variable. It covers operational definitions, recording systems, interobserver agreement, procedural fidelity, and how many data points are enough. Chapters 3, 4, and 5 treat the three design families. Reversal and withdrawal designs, the ABAB family, demonstrate control by showing that behavior changes when an intervention is introduced, returns toward baseline when it is removed, and changes again when it is reinstated. Alternating treatments and multielement designs compare two or more conditions by rapidly alternating them within the same participant, which makes them the natural design for functional analysis and for comparing instructional methods. Multiple baseline and multiple probe designs stagger the introduction of an intervention across participants, behaviors, or settings, which makes them the design of choice when behavior cannot or should not be reversed. Chapter 6 treats visual analysis in detail: the six features of level, trend, variability, immediacy, overlap, and consistency; structured protocols; decision aids such as the conservative dual-criterion method; and the evidence about how reliably trained analysts agree. Chapter 7 covers the statistical non-overlap metrics and effect sizes, from the percentage of non-overlapping data through non-overlap of all pairs, Tau-U and its successors, to log response ratios and the between-case standardized mean difference, with worked calculations and a frank account of each index's weaknesses. Chapter 8 addresses experimental control directly: how the What Works Clearinghouse and other bodies judge whether a design has demonstrated an effect, how randomization strengthens single-case inference, how studies should be reported, and what social validity adds. The book closes with an argument about what follows from all this for researchers, practitioners, reviewers, and those who train them. Who this book is for The intended reader is a graduate student, a practitioner, a researcher from a neighboring field, or a reviewer who needs to judge single-case evidence. No statistical training beyond an introductory course is assumed. A few calculations appear, worked through in prose with small numbers, because non-overlap indices are easiest to understand by computing one by hand. Readers who already design single-case studies will find the later chapters on analysis and standards most useful; readers new to the method should read in order, because each design chapter builds on the logic set out in Chapter 1. One scope note. The book concentrates on the designs named in its title and treats the changing-criterion design and combined designs more briefly, where they illuminate the main families. It also concentrates on behavioral and educational outcomes. The logic applies equally to single-case studies in medicine, including the n-of-1 trials used to individualize drug treatment, but those have their own conventions and are touched on only in passing. Chapter 1. The Logic of Within-Subject Experimentation Every experiment answers a counterfactual question: what would have happened to these participants if the intervention had not been delivered? Group designs answer it by comparison across people. A randomized control group stands in for the treated group's unobserved alternative, and randomization makes the two groups equivalent in expectation. Single-case designs answer the same question by comparison across time within the same person. The participant's own baseline stands in for the alternative, and the design's structure makes that stand-in credible. Understanding how that works, and where it can fail, is the foundation for everything else in this book. From the laboratory to the classroom The single-case tradition in behavioral science comes from the experimental analysis of behavior, the laboratory science associated with B. F. Skinner. Skinner's work with rats and pigeons in the 1930s through the 1950s did not use groups and statistical tests. He studied individual organisms intensively, recorded their responding continuously, and treated a change in the rate of responding that followed a change in conditions, and reversed when the conditions were restored, as the finding. Murray Sidman's Tactics of Scientific Research, published in 1960, codified this approach. Sidman argued that the reliability of an effect should be established by replication, directly with the same organism and systematically with variations in organisms and conditions, rather than by inferential statistics applied to group means. He also argued that variability in an individual's behavior is a phenomenon to be controlled and explained, not noise to be averaged away. When researchers carried these methods into classrooms, clinics, and institutions in the 1960s, they faced a harder environment. A pigeon's chamber holds every variable constant except the one being manipulated. A classroom does not. Teachers change, peers come and go, children get sick, holidays interrupt routines, medication is adjusted. The founding statement of applied behavior analysis, the article "Some Current Dimensions of Applied Behavior Analysis" by Donald Baer, Montrose Wolf, and Todd Risley in the first issue of the Journal of Applied Behavior Analysis in 1968, confronted this directly. It named two designs, the reversal and the multiple baseline, as the means by which an applied researcher could show that a behavior change was due to the intervention and not to the many uncontrolled events of applied settings. The article called this property of a study "analytic," and it remains the core criterion by which single-case research is judged. The phrase that captures the goal is "experimental control." A study demonstrates experimental control when the investigator can turn the behavior change on and off, or produce it at will at different times or in different places, by manipulating the independent variable. Control in this sense is a demonstrated property of the data, not an assertion about the procedure. A study can follow a textbook design and still fail to demonstrate control if the data do not change when and only when the design predicts they should. Baseline logic: prediction, verification, replication The reasoning of a single-case experiment has three parts, and every design in this book is a different way of arranging them. The terminology comes from Cooper, Heron, and Heward's widely used textbook on applied behavior analysis, but the ideas are older. Prediction. A stable baseline allows the investigator to predict future behavior if nothing changes. Suppose a student completes between 30 and 40 percent of assigned math problems across seven consecutive sessions, with no upward or downward drift. The reasonable prediction is that, absent intervention, the next sessions will also fall between about 30 and 40 percent. This prediction is the single-case equivalent of the control group. Its credibility depends on the baseline being long enough and stable enough to extrapolate. A baseline that is climbing steeply predicts continued improvement, which means that improvement after intervention is not evidence of anything. A baseline that bounces between 5 and 90 percent predicts almost nothing. Affirmation of the consequent. When the intervention is introduced and the data depart from the predicted path, for example when math completion jumps to between 75 and 90 percent, the investigator has a result consistent with the hypothesis that the intervention caused the change. But it is only consistent. The logic here is what philosophers call affirming the consequent: if the intervention works, behavior will change; behavior changed; therefore the intervention works. The inference is invalid on its own, because something else could have changed behavior at the same moment. A new seating arrangement, a change in the curriculum, or the student's parents beginning a home reward system in the same week could produce the same data. Verification. The design must then show that the baseline prediction would have held had the intervention not been introduced. In a reversal design, this is done by withdrawing the intervention: if behavior returns toward baseline levels, the prediction from the first baseline is verified, because behavior in the absence of the intervention looks like what was predicted. In a multiple baseline design, verification comes from the tiers that remain in baseline. If a second student's math completion stays flat while the first student's rises, the second student's continued baseline verifies that nothing in the shared environment produced the change. Replication. Finally, the effect must be reproduced. In a reversal design, reinstating the intervention and observing the same change again replicates the effect. In a multiple baseline design, introducing the intervention to the second and third students at later points and observing the change in each replicates it. Each replication makes an alternative explanation less plausible, because the alternative would have to coincide with the intervention not once but several times, at points the investigator chose. This is why the field settled on a rule of thumb, now built into formal standards, that a design must provide at least three demonstrations of an effect at three different points in time. One demonstration is a correlation. Two could still be coincidence. Three, at times chosen by the investigator and in the presence of verified baselines, make coincidence implausible enough to act on. The rule is not a statistical threshold. It is a judgment, shared across the field, about how many independent coincidences an alternative explanation would need before it becomes less credible than the intervention. What the baseline must do Because the baseline carries so much of the argument, the conditions for starting an intervention deserve care. Three properties matter. The first is stability, or more precisely, predictability. A baseline need not be perfectly flat. It needs to be describable well enough that the investigator can say where the next points would fall. Low variability around a flat level is ideal. A trend is acceptable if it runs in the direction opposite to the expected effect, because then an improvement after intervention contradicts the baseline prediction rather than continuing it. A trend in the therapeutic direction is the worst case: if a child's tantrums are already declining from ten per day to six to four, a further decline to two after intervention cannot be distinguished from the existing trajectory. The second is length. How many points are enough is a question without a single answer, and Chapter 2 returns to it. Formal standards now require at least three data points per phase for a study to be considered at all and five for it to be considered without reservations. Those are minimums for review, not targets for design. In practice, investigators extend a baseline until it is predictable, and they justify stopping early only when the behavior is dangerous or when the baseline is so stable at zero or near-zero levels that further sessions add no information. The third is representativeness. The baseline must be collected under the conditions that will prevail during intervention, except for the intervention itself. If baseline sessions are run by one therapist in the morning and intervention sessions by another in the afternoon, the design cannot separate the intervention from the therapist or the time of day. This is a design problem, not an analysis problem, and no graph or statistic can correct it after the fact. Threats to internal validity in a within-subject design The vocabulary of validity threats comes from Donald Campbell and Julian Stanley's 1963 monograph on quasi-experimental designs, and it applies to single-case designs with some adjustments. Each design family handles the threats differently, and knowing which threats a design leaves open is the first step in reading any single-case study critically. History is any event outside the study that coincides with the intervention and could produce the change. In applied settings it is the most common threat. The reversal design answers it by showing that behavior tracks the intervention through repeated introductions and withdrawals, which a one-time external event would not produce. The multiple baseline answers it by showing that behavior changes in each tier only when that tier receives the intervention. Maturation covers changes within the participant over time, such as development, fatigue, recovery from illness, or growing familiarity with the setting. A child with a newly acquired brain injury will often improve regardless of rehabilitation, which is why neuropsychological single-case studies take particular care with baseline trends. Testing refers to the effect of repeated measurement itself. Being assessed daily on the same set of sight words can teach the words, especially if feedback is given. Multiple probe designs, discussed in Chapter 5, were developed partly to reduce the burden and reactivity of continuous baseline measurement. Instrumentation refers to changes in the measurement process. Observers drift in how they apply a definition, especially when they know which phase is in effect and what result is expected. Interobserver agreement checks, discussed in Chapter 2, exist to detect this, and blind or naive observers reduce it. Regression to the mean matters when participants are selected because their behavior is extreme. A student referred because of a week of severe aggression may simply be at a temporary peak. A stable, extended baseline protects against this, because regression would appear during baseline rather than coinciding with the intervention. Multiple-treatment interference and carryover are specific to designs in which one participant experiences more than one condition. Exposure to one treatment can alter responding to another. This threat is central to alternating treatments designs and is treated in Chapter 4. Attrition and selection have single-case analogues. If an investigator begins with six participants and reports on the three whose data showed clear effects, the study is compromised just as a group trial would be if it dropped its non-responders. Current reporting guidelines ask for every participant who entered the study to be reported, with reasons for any who did not complete it. Why not simply compare before and after? It is worth being explicit about what a single-case design adds to the simple AB comparison that practitioners routinely make. In an AB design, behavior is measured in baseline, the intervention is introduced, and behavior is measured again. If the change is large and immediate, many readers find it convincing, and in routine clinical practice AB data are often the best available basis for a decision. But the AB design contains prediction and a single affirmation of the consequent. It lacks verification and replication. Every threat described above remains open. The child might have improved because a new teacher arrived in the same week, or because the behavior had peaked and was regressing, or because observers changed their scoring once they knew treatment had begun. Formal standards do not accept an AB design as an experimental demonstration. That is not pedantry. Practitioners who conclude from AB data that an intervention works for a child will sometimes be wrong, and the cost of being wrong includes continuing an ineffective intervention while a better one is overlooked, and attributing progress to an intervention that the child's next teacher will then maintain for no reason. A partial remedy, widely used in clinical research, is to replicate the AB design across several participants who start treatment at different times. This is not yet a multiple baseline, because the baselines are not deliberately staggered and verified against each other, but each replication at a new point in calendar time makes a single coincident history event less likely. The difference between a series of replicated AB designs and a true multiple baseline is precisely the verification step, and Chapter 5 shows how much that step adds. A useful discipline is to ask of any claimed effect: what would the data look like if the intervention had done nothing and something else had caused the change? If the answer is "exactly like this," the design has not done its work. Each of the designs in the following chapters is a different way to make the answer "no, the data would look different." The replication logic compared with sampling logic Group designs generalize from a sample to a population through sampling logic: if participants are drawn at random, results generalize to the population they were drawn from, with a quantifiable margin of error. Single-case designs rarely have random samples, and they do not claim to. Their route to generality is replication logic, a distinction the methodologist Robert Yin also drew for case study research more broadly. Sidman distinguished direct replication, in which the same investigator repeats the same procedure with the same or similar participants, from systematic replication, in which the procedure is repeated with deliberate variations in participants, settings, behaviors, or implementers. Direct replication establishes reliability: the effect is real for this kind of participant under these conditions. Systematic replication establishes generality: the effect holds across a range of conditions, and the boundaries where it fails become visible. Functional communication training, for example, was first shown to reduce problem behavior in a small number of children with developmental disabilities in the mid-1980s by Edward Carr and Mark Durand. Its current status as a well-established intervention rests not on any single large trial but on hundreds of single-case replications across ages, diagnoses, response topographies, communication modalities, and settings, many of them documenting the conditions under which it works less well. This route to generality has a known weakness, which is publication bias. If studies that fail to show an effect are less likely to be published, the body of replications overstates the reliability and generality of an intervention. Evidence from surveys of single-case researchers and from comparisons of dissertations with published articles suggests that this bias is real in the single-case literature, as it is elsewhere. It is one reason the field has moved toward effect sizes and formal meta-analysis, which allow the size and consistency of effects to be estimated and bias to be probed, and it is a theme of Chapter 8. What a design commits the investigator to A final point sets up the design chapters. Choosing a design is a commitment made before data collection about which comparisons will count as evidence. The reversal design commits the investigator to withdrawing the intervention and to accepting that behavior should return toward baseline. The multiple baseline commits the investigator to holding some tiers in baseline while others receive the intervention, and to accepting that behavior in those untreated tiers should not change. The alternating treatments design commits the investigator to the claim that the participant can discriminate between rapidly changing conditions and that responding to each will be differentiated. Each commitment also creates a way for the study to fail, and that is the source of its strength. A design that cannot fail cannot demonstrate anything. The response-guided flexibility that single-case research prizes, adjusting phase lengths according to the data, has to operate within these commitments. When it does not, when phases are extended until an effect appears or tiers are reordered after the fact, the design's logic is quietly abandoned while its appearance is preserved. The chapters that follow describe each design's commitments, the ways investigators honor or evade them, and what the data must look like for the commitment to be satisfied. Chapter 2. Measurement Before Design A single-case study is only as good as its dependent variable. The design logic of Chapter 1 assumes that each data point is an accurate and reliable record of the behavior of interest, collected often enough to reveal its course over time. When that assumption fails, no design can compensate. A reversal that "works" because observers relaxed their definition during intervention phases is not a demonstration of control. It is a demonstration of observer drift. This chapter treats the measurement decisions that precede and constrain every design choice. Defining the behavior The first decision is what to measure, and the standard is an operational definition that an unfamiliar observer could apply with the same results. Definitions in single-case research are usually built from three components. The first is a label, such as "aggression" or "on-task behavior." The second is a description of what counts, stated in observable terms: "hitting, kicking, pushing, biting, or throwing objects at another person, with or without contact." The third is a set of examples and non-examples at the boundary: "a high-five during a game is not aggression; throwing a pencil that lands within a meter of a peer is aggression." The boundary cases are where definitions fail in practice. A definition of "on-task" that reads "engaged with assigned materials" leaves observers to decide whether a student looking out the window while holding a pencil is on task. Two observers resolving that ambiguity differently will disagree on a large share of intervals, and a single observer resolving it differently on different days will introduce variability into the data that looks like a behavioral phenomenon. The fix is iterative. Investigators write a draft definition, observe with it alongside a second observer, discuss disagreements, add examples and non-examples, and repeat until agreement is consistently high before baseline begins. A second decision is whether to define behavior by its topography, what it looks like, or by its function, what it produces. Topographical definitions are easier to score. Functional definitions often matter more. A child who screams, drops to the floor, and pushes materials away may be doing all three to escape the same demand, and treating them as a single response class defined by that function can make both measurement and intervention more coherent. When a functional analysis has been conducted, the response class it identified should usually be the dependent variable of the subsequent treatment evaluation. Social significance is the third consideration. Baer, Wolf, and Risley's 1968 article asked applied researchers to study behaviors that matter to the person and to society, and Montrose Wolf's 1978 article on social validity extended the question to whether the goals, procedures, and outcomes are acceptable to those affected. A precise measure of a trivial behavior is precise and trivial. Sometimes the socially important outcome, such as independent living or employment, cannot be measured session by session, and investigators choose a proximal measure that can be. The choice should be defended, and the link between the proximal measure and the important outcome should be stated rather than assumed. Choosing a recording system Once the behavior is defined, the investigator must choose how to record it. The choice depends on the dimension of behavior that matters (how often, how long, how quickly, how accurately) and on practical constraints such as whether a dedicated observer is available. Table 1 summarizes the common systems. Table 1. Common recording systems in single-case research. System What it records Best suited to Known bias Event (frequency) recording Each occurrence, reported as count or rate Discrete behaviors with clear onset and offset Hard to use for very high-rate or long-duration behavior Duration recording Total or per-episode time Tantrums, engagement, on-task time Needs clear onset and offset rules Latency recording Time from cue to response onset Compliance, response initiation Sensitive to how the cue is defined Partial-interval recording Whether behavior occurred at any time in each interval Behaviors targeted for reduction Overestimates duration; can distort rate Whole-interval recording Whether behavior occurred throughout each interval Behaviors targeted for increase Underestimates duration Momentary time sampling Whether behavior is occurring at the end of each interval Duration-type behaviors; teacher-collected data Unbiased for proportion of time only with short intervals; misses brief events Event recording is the most direct. Each occurrence is counted, and when observation sessions vary in length the count is converted to a rate per minute or per hour so sessions can be compared. Rate is the natural measure of behaviors like requests, self-injurious hits, or correct words read, and it was the fundamental datum of the laboratory tradition. When behavior occurs in response to discrete opportunities, such as instructional trials, the count is usually expressed as a percentage of opportunities, which is appropriate so long as the number of opportunities is reported. A student who answers two of two questions correctly and one who answers 40 of 40 are both at 100 percent, but the data carry very different information. Duration and latency recording capture temporal dimensions. They require precise onset and offset rules: a tantrum might begin with the first scream and end after ten seconds without screaming, crying, or flopping. Without such rules, duration data can vary as much with the observer's judgment as with the behavior. Interval recording systems divide an observation into short intervals, commonly ten to fifteen seconds, and score each interval as containing the behavior or not. They are practical for behaviors that are hard to count, but they produce estimates with known biases. Partial-interval recording, which scores an interval if the behavior occurred at any point, overestimates the proportion of time the behavior occupied, and it cannot distinguish one brief occurrence from ten in the same interval. Whole-interval recording, which scores an interval only if the behavior lasted throughout, underestimates it. Momentary time sampling, which scores only whether the behavior is occurring at the moment the interval ends, produces approximately unbiased estimates of the proportion of time a behavior occurs when intervals are short relative to the behavior's episodes, and it has the practical advantage that a teacher can collect it while doing other things. Simulation studies over several decades have shown that the size of these errors depends on interval length, behavior rate, and episode duration, and that the errors can mask or exaggerate change between phases. A reduction in a high-rate behavior from twelve to four occurrences per minute may show up as no change at all in partial-interval data with fifteen-second intervals, because nearly every interval still contains at least one occurrence. For reduction targets, a common recommendation is to choose partial-interval recording, because its bias is conservative with respect to claiming improvement: it overstates remaining behavior. For increase targets, whole-interval recording plays the same conservative role. That recommendation holds only if the bias is roughly constant across phases, which is not guaranteed when the behavior's rate and duration change together. Interobserver agreement The main check on measurement in single-case research is interobserver agreement, in which a second observer independently records a sample of sessions and the two records are compared. Agreement does not establish accuracy. Two observers can agree perfectly and both be wrong, for example if both were trained on the same flawed definition. But agreement is the most practical evidence available that the definition is being applied consistently and that the data reflect the behavior rather than the observer. The calculation depends on the recording system. For event recording, total count agreement divides the smaller count by the larger: if one observer records 18 hits and the other 20, agreement is 90 percent. That index is easy to compute and easy to fool, because the observers could have recorded 18 and 20 hits at entirely different moments. Mean count-per-interval agreement is stricter. The session is divided into short intervals, agreement is computed within each, and the results are averaged. Exact count-per-interval agreement is stricter still, counting an interval as an agreement only if both observers recorded exactly the same number. For interval data, interval-by-interval agreement divides the number of intervals scored identically by the total. When behavior is rare, most intervals will be scored as non-occurrence by both observers, which inflates interval-by-interval agreement; the scored-interval method, which considers only intervals in which at least one observer recorded the behavior, corrects for this. For very frequent behavior, unscored-interval agreement plays the parallel role. Cohen's kappa adjusts agreement for chance and is sometimes reported alongside or instead of percentages. The What Works Clearinghouse pilot standards of 2010 set minimum thresholds that the field has broadly adopted: agreement collected in at least 20 percent of sessions in each phase and for each condition, with percentage agreement of at least 80 percent or kappa of at least 0.60. Those figures are floors, and many journals and reviewers expect agreement data to be reported by participant and phase, not simply as a single average across the study. A study-wide mean of 91 percent can conceal a phase in which agreement was 70 percent. Three practices strengthen agreement data. The first is to collect it throughout the study rather than only at the start, since observer drift develops over time. The second is to collect it in every phase and condition, since drift that differs across conditions is the kind that threatens internal validity. The third is to keep the second observer as uninformed as possible about the phase and the expected result, or to score from video in randomized order. Studies that do this are rare but notably more persuasive, particularly when the effect is modest. A worked agreement example A small example shows why the choice of agreement index matters. Two observers record a student's hand raising during a 10-minute session divided into ten 1-minute intervals. Observer 1 records counts per interval of 0, 1, 0, 2, 0, 0, 1, 0, 0, 1, for a total of 5. Observer 2 records 1, 0, 0, 2, 1, 0, 0, 0, 1, 0, also totalling 5. Total count agreement is 5 divided by 5, or 100 percent. On that index the observers agree perfectly. Exact count-per-interval agreement tells a different story. The observers recorded the same count in only four of the ten intervals, the third, fourth, sixth, and eighth, which is 40 percent. They agreed about how much hand raising happened in the session but disagreed about when it happened in six of ten intervals. Mean count-per-interval agreement, which scores each interval as the smaller count divided by the larger and treats two zeros as full agreement, gives the same 40 percent here because every disagreement involved one observer scoring zero. Which figure is honest depends on what the data will be used for. If only the session total enters the graph, total count agreement answers the relevant question, although it remains vulnerable to observers who agree by accident. If the analysis depends on timing, for example on whether hand raising follows a teacher prompt, the interval-level index is the relevant one, and 40 percent means the data cannot support the analysis. The general rule is to report the strictest index that matches the use of the data and to state which index was used. A study reporting "IOA = 100%" without naming the method gives the reader nothing to evaluate. Procedural fidelity The independent variable also needs to be measured. Procedural fidelity, sometimes called treatment integrity or implementation fidelity, is the degree to which the intervention was delivered as designed. It matters for internal validity in both directions. If fidelity is low, a null result may reflect poor implementation rather than an ineffective intervention. If fidelity is not measured in baseline, the study cannot show that the intervention components were absent when they should have been. A teacher who has just been trained in behavior-specific praise may begin delivering more of it during baseline sessions, contaminating the comparison. Fidelity is typically measured with a checklist of the intervention's components, scored as each opportunity arises, and reported as the percentage of components correctly implemented. Reviews of single-case literature in special education over the past two decades have repeatedly found that fewer than half of published studies report fidelity data, and fewer still report fidelity for baseline conditions. The trend has improved as journals and standards have begun to require it. A study that reports fidelity of 95 percent in intervention phases and documents the absence of intervention components in baseline has closed a gap that many studies leave open. How much data, and how often Single-case designs depend on repeated measurement, and the density of measurement determines what can be seen. A behavior measured once a week cannot show an immediate effect; by the time of the first intervention measurement, a week of change has occurred and been averaged. Measurement should be frequent relative to the expected speed of change: daily or per session for most classroom behavior, several times per session for rapidly changing skills, less often only when the behavior itself changes slowly. The number of points per phase is a trade-off between confidence and time. Short phases produce weak predictions and let a few unusual sessions dominate the picture. Long phases delay intervention, and in the case of dangerous behavior, they expose the participant to harm. The What Works Clearinghouse standards set three data points per phase as the minimum for a phase to count at all and five as the minimum for a design to meet standards without reservations, and that five-point convention has become the common benchmark. Simulation work on statistical power in single-case designs, such as the analyses underlying randomization tests and multilevel models, suggests that power to detect even moderately large effects with short phases is lower than visual analysts typically assume, especially when data are autocorrelated. The practical implication is that five points should be regarded as a floor and that more is better when the baseline is variable. Data should also be graphed as they are collected. Single-case design is response-guided: the decision to change phases depends on what the data show. That flexibility is legitimate only if decisions follow rules stated in advance, such as "the intervention will begin when five consecutive baseline points fall within a range of 20 percentage points and show no therapeutic trend." Chapter 8 returns to the tension between response-guided decisions and randomization. For now the point is simply that the graph is a working instrument during the study, not a figure prepared for publication at the end. Sensitivity, floors, and ceilings A last measurement concern is the scale's capacity to show change. If a student's baseline accuracy on a reading probe is already 90 percent, the probe can register at most a ten-point improvement, and statistical indices computed on such data will be misleading. Ceiling and floor effects are common with percentage measures and with rating scales. They also matter for non-overlap metrics, discussed in Chapter 7, because many indices behave oddly when data sit at zero or at the maximum. A reduction design in which the target behavior falls to zero in every intervention session is, for visual analysis, a clean result. For several effect size indices, it produces values that cannot be interpreted as a magnitude. The general remedy is to choose, before baseline, a measure with room to move in the expected direction, and to report raw counts and opportunities rather than only transformed scores. For skill acquisition, probes that include material the learner has not yet mastered keep the measure away from its ceiling. For behavior reduction, rate per hour may preserve information that a percentage of intervals would lose. These choices, taken together, determine whether a design can deliver the argument it promises. A reversal design built on a vague definition, measured with a biased interval system, with agreement checked only in baseline and no fidelity data, has the shape of an experiment and little of its substance. The design chapters that follow assume the measurement has been done properly, because only then does the design's logic have anything to work on. Chapter 3. Reversal and Withdrawal Designs The reversal design is the clearest expression of single-case logic. Behavior is measured in a baseline condition, an intervention is introduced, the intervention is withdrawn, and it is introduced again. If behavior changes each time the condition changes, and only then, the investigator has turned the effect on, off, and on again. No other design makes the functional relation between an intervention and a behavior so visible in a single participant. It is also the design with the most obvious practical and ethical limits, and understanding both its power and its limits is essential to using it well. The ABAB design and its logic In the conventional notation, A denotes baseline and B denotes the intervention, and each letter is a phase containing several sessions. The ABAB design has four phases and three phase changes. The first change, from A to B, provides an initial demonstration: behavior departs from the prediction made by the first baseline. The second change, from B back to A, provides verification: behavior returns toward the level the first baseline predicted, which shows that the first baseline's prediction would have held without the intervention. The third change, from A to B again, provides replication: the effect reappears when the intervention does. Three phase changes, each accompanied by a change in behavior in the predicted direction, give the three demonstrations of an effect at three points in time that current standards require. One of the first published studies in applied behavior analysis used this design. In the first article of the first issue of the Journal of Applied Behavior Analysis in 1968, R. Vance Hall, Diane Lund, and Deloris Jackson reported a series of experiments in elementary classrooms in which teachers were taught to attend to students when they were studying and to ignore non-study behavior. For one first-grade boy, study behavior during baseline occupied only about a quarter of observed intervals; it rose to roughly 70 percent when the teacher's attention was made contingent on study; it fell back when the teacher returned to her previous pattern of attending to non-study behavior; and it rose again when contingent attention was reinstated. The design was simple and the effect unmistakable, and the study became a model for a generation of classroom research. The logic is compelling because an alternative explanation would have to account for all three changes. A history event, such as a new classmate, might explain the first rise but would not explain why study fell in the second baseline and rose again in the second intervention phase, exactly when the teacher's attention changed. Maturation predicts steady change, not reversals. Regression to the mean predicts a single return toward average, not a pattern that tracks the conditions. Withdrawal versus reversal Terminology in this area is loose, and it helps to be precise. Strictly speaking, what most studies call a reversal design is a withdrawal design: the intervention is simply removed in the second A phase. A true reversal, in the sense Baer and colleagues used the term, changes the contingency so that it applies to a different behavior. In a withdrawal design, a teacher who has been praising on-task behavior stops praising. In a reversal design, the teacher praises off-task behavior or delivers praise on a schedule independent of any behavior. The reversal in this strict sense can produce a faster and more complete return to baseline levels, because it actively supports the competing behavior, but it raises obvious ethical concerns when the competing behavior is harmful. A related variant uses a noncontingent control condition. In place of withdrawing reinforcement entirely, the investigator delivers the same reinforcer at the same rate but independently of behavior. If behavior returns to baseline levels under noncontingent delivery, the effect can be attributed to the contingency rather than to the reinforcer itself. This distinction matters. An intervention that works because a child receives more adult attention overall is different from one that works because attention is made contingent on appropriate requests, and the practical implications differ too. Another variant uses differential reinforcement of other behavior, often abbreviated DRO, as the reversal condition: reinforcement is delivered for any behavior except the target. If the target behavior falls under DRO and rises when contingent reinforcement returns, the contingency's role is established. Each of these variants is a different answer to the question "what exactly is being withdrawn?", and a careful study states which answer it has chosen. Common variations The ABAB design is the prototype, but many variations appear in practice. The ABA design ends in baseline. It provides one demonstration and one verification but no replication, and it leaves the participant without the intervention at the end of the study, which is rarely acceptable in applied work. Formal standards do not accept it as sufficient because it contains only two demonstrations. The BAB design begins with the intervention, withdraws it, and reinstates it. It is useful when the behavior is too dangerous for an extended initial baseline or when an intervention is already in place and the question is whether it is responsible for current performance. Its weakness is the absence of an initial baseline, which means the first B phase cannot be compared with a pre-intervention prediction. It provides two phase changes rather than three. Multiple-treatment designs such as ABACA or ABCBC compare two interventions within a reversal structure. In an ABACA design, each intervention is introduced after baseline and then withdrawn. In an ABCBC design, the investigator alternates between two interventions without returning to baseline between them. These designs can show that intervention C adds something to intervention B, but they are vulnerable to sequence effects: the response to C may depend on having experienced B first. The standard remedy is to counterbalance the order across participants, so that some receive ABACA and others ACABA. When only one participant is available, sequence effects cannot be ruled out, and the conclusion must be stated conditionally. Component analyses extend the logic to multi-component interventions. A package combining visual schedules, a token system, and a response cost procedure may be evaluated by removing components one at a time in successive phases. If behavior worsens when the token system is withdrawn but not when the visual schedules are, the investigator learns which components are doing the work. Component analyses are laborious and depend on components not interacting, but they are the main single-case route to understanding why a package works. Parametric analyses vary the intensity of an intervention across phases, for example testing reinforcement delivered after every response, after every third response, and after every tenth. They reveal dose-response relations that are hard to obtain any other way. When reversal is not appropriate The reversal design has two structural limitations that no variation fully removes. The first is irreversibility. The design assumes that behavior will return toward baseline when the intervention is withdrawn. For many behaviors, that assumption is false, and should be. A child who has learned to read a set of words will not unlearn them when instruction stops. A student who has acquired a new social skill may continue to use it because peers now respond to it, so natural contingencies have taken over from the programmed ones. Skill acquisition generally, and any behavior that comes under the control of natural reinforcement, is poorly suited to reversal. Attempting a reversal with such behaviors produces a second A phase in which behavior stays high, which the design must interpret as a failure to verify, even though the intervention may have been fully effective. Behavior that persists after withdrawal is a clinical success and a design failure at the same time. Partial reversals are a related problem. Behavior may fall in the second baseline, but only halfway toward the first baseline level. Whether that counts as verification is a judgment. If the second A phase is clearly different from the preceding B phase and moves in the predicted direction, many analysts will accept it, but the demonstration is weaker, and it is worth considering whether the partial reversal reflects learning, maturation, or history during the first intervention phase. The second limitation is ethical. Withdrawing an effective intervention for severe self-injury, aggression, or dangerous elopement exposes the participant and others to renewed harm. Several practices limit this cost. Withdrawal phases can be brief, sometimes only three sessions, and terminated as soon as a clear change is seen. Reversals can use a criterion that stops the phase when behavior reaches a safety threshold. Protective equipment and additional staff can be used during reversal phases. And in many cases, the reversal can be replaced by a multiple baseline design, discussed in Chapter 5, which demonstrates control without ever withdrawing an effective treatment. There is also a social cost that is easy to underestimate. Teachers and parents who have seen a child improve may be unwilling to withdraw an intervention, and asking them to do so can damage the working relationship on which the intervention depends. Some will decline, and a design that requires a reversal is then incomplete. It is better to anticipate this at the design stage than to discover it after the first intervention phase. A worked example Consider a hypothetical but realistic study. Maya, an eleven-year-old with autism, calls out during whole-class instruction in a general education classroom. The investigator defines calling out as any vocalization directed to the teacher or the class without having been called on, and records it by event recording during a daily 30-minute math lesson, reporting rate per ten minutes. A second observer records a third of sessions in each phase. In the first baseline, seven sessions produce rates of 4.3, 5.0, 3.7, 4.7, 5.3, 4.0, and 4.7 calls per ten minutes, with no visible trend and a range of 1.6. The prediction is that, without intervention, calling out will continue at between about four and five per ten minutes. The intervention combines a visual cue card on Maya's desk with a token for each five-minute interval without calling out, exchangeable at the end of class for preferred activities. In the first intervention phase, six sessions produce rates of 2.3, 1.3, 1.0, 0.7, 0.7, and 0.3. The change is immediate, with the first intervention session already below the lowest baseline point, and it continues downward. After consultation with the teacher, a brief withdrawal phase of four sessions removes the tokens and the cue card. Rates are 2.0, 3.3, 3.7, and 4.0. Calling out returns toward baseline, though not immediately to the baseline mean, and the upward trend within the phase suggests it would have continued rising. The intervention is reinstated for eight sessions: 1.3, 0.7, 0.3, 0.7, 0.3, 0.0, 0.3, 0.0. Reading this record, an analyst would note three phase changes, each accompanied by a change in level in the predicted direction. The first change is immediate and the data do not overlap. The withdrawal change is somewhat delayed, with the first point in the second baseline closer to intervention levels than to baseline, which is common and often reflects the lingering effect of recent reinforcement. The reinstatement is immediate. The pattern across the four phases is consistent: the two baseline phases resemble each other, as do the two intervention phases. Agreement data averaging above 90 percent in every phase, and fidelity data showing tokens delivered correctly in the intervention phases and not at all in the withdrawal, would complete the case. The study demonstrates a functional relation between the token and cue-card package and calling out for Maya. What the study does not show is also worth stating. It does not show which component, the tokens or the cue card, produced the effect. It does not show that the effect would generalize to other lessons or be maintained when the tokens are faded. And as a single-participant study, it says nothing about how many students like Maya would respond similarly. Those are questions for component analyses, generalization probes, and systematic replication. When the withdrawal phase does not reverse Consider what an investigator should do when the second baseline shows no change. Suppose, in a study of a peer-mediated social skills intervention for a nine-year-old, initiations to peers rise from about one to about six per recess when trained peers begin prompting and reinforcing initiations. When the peer prompting is withdrawn, initiations stay near six for five sessions. Several interpretations are possible, and the investigator's task is to consider each honestly. The behavior may have come under the control of natural reinforcement: the child's initiations now produce enjoyable play, which maintains them without the programmed prompts. The peers may not have fully withdrawn the intervention, continuing to prompt out of habit, which fidelity data for the withdrawal phase would reveal. A history event, such as a new friendship formed outside the study, may have produced the original change and would explain its persistence. Or the change may be a coincidence of timing, with the original rise caused by something other than the intervention. The design cannot distinguish these explanations, and the study cannot claim a functional relation from the reversal. What it can do is add an analysis that does not depend on reversal. If the investigator had planned for this possibility, a second and third participant could be brought in on a staggered schedule, converting the study into a multiple baseline across participants with an embedded reversal in the first tier. Alternatively, the intervention could be tested for the same child in a second setting, such as lunch, where initiations remain low. These fallbacks are more credible if they are planned in advance than if they are improvised after a failed reversal, which is another reason to consider, at the design stage, whether a behavior is likely to reverse at all. Reporting the non-reversal openly also contributes to the literature: it is evidence that peer-mediated intervention may produce durable change for some children, which is useful knowledge even though it defeats the design. Reversal designs in functional analysis and beyond The reversal logic appears in many places beyond the classic ABAB. Treatment evaluations following a functional analysis often use it, since the functional analysis has already identified a reinforcer whose withdrawal is expected to restore problem behavior. Studies of medication in individuals with developmental disabilities sometimes use placebo-controlled reversal designs, with drug and placebo phases alternated under double-blind conditions. The n-of-1 trials used in clinical medicine, in which a patient alternates between drug and placebo in randomized blocks, are a formalized cousin of the reversal design, with randomization and blinding added. The design's persistent appeal lies in its directness. When it works, the graph tells the story in a way that a skeptical reader, a parent, or a school administrator can follow without technical training: this is what the behavior looked like before, this is what happened when we started, this is what happened when we stopped, and this is what happened when we started again. That directness is a scientific virtue as well as a communicative one. A demonstration that relies on no assumptions beyond the stability of baselines and the reversibility of behavior is about as close to a direct experimental test as applied work allows. Checklist for a sound reversal study Several questions, asked before the study starts, prevent most reversal design failures. • Is the target behavior likely to reverse when the intervention is withdrawn, or has it been, or will it be, taken over by natural contingencies? • Is it ethically acceptable to withdraw the intervention, and for how long? What safety criterion will terminate a withdrawal phase early? • Will the people implementing the intervention agree to withdraw it? • What exactly is removed in the withdrawal phase: the whole package, the contingency only, or a specific component? • Are there at least four phases planned, with at least three and preferably five data points in each? • If more than one intervention is being compared, how will sequence effects be controlled? • What decision rules will govern phase changes? When the answers are favorable, the reversal design is the most powerful demonstration of experimental control available to an applied researcher. When they are not, the designs of the next two chapters offer alternatives that trade some directness for wider applicability. Hashtags: #SingleCaseExperimentalDesigns #SingleCaseResearch #WithinSubjectExperimentation #ExperimentalControl #BaselineLogic #PredictionVerificationReplication #ReversalDesign #WithdrawalDesign #ABABDesign #AlternatingTreatmentsDesign #MultielementDesign #MultipleBaselineDesign #MultipleProbeDesign #BehaviorMeasurement #InterobserverAgreement #ProceduralFidelity #VisualAnalysis #LevelTrendVariability #ImmediacyOfEffect #DataOverlap #NonOverlapMetrics #TauU #RandomizationTests #SocialValidity #FutureOfSingleCaseResearch

Download the Book (PDF): Introduction A single-cell RNA sequencing experiment produces a table of numbers. The rows are genes, the columns are cells, and each entry is a count of how many times a particular transcript was observed in a particular cell. Everything else — the coloured scatter plots, the named clusters, the trajectories, the claims about novel cell states — is an interpretation of that table. The table itself is the experiment's only real output, and its quality was determined long before any software was opened. This is the argument the booklet makes, and it is worth stating plainly at the outset because the field's centre of gravity has drifted away from it. The visible, citable, prize-winning part of single-cell work is computational. Methods papers arrive at a rate no working biologist can track. Tutorials begin with a pre-made count matrix, as though the matrix were a natural object rather than a manufactured one. A newcomer could reasonably conclude that single-cell transcriptomics is a data analysis discipline that happens to require some wet-lab preparation. It is the other way around. The dominant sources of variation in most published single-cell datasets are technical, and they enter the data during tissue handling, dissociation, cell capture, and library construction. A pipeline can characterise them, sometimes model them, occasionally subtract an estimate of them. It cannot recover transcripts that were never captured, distinguish a stress response induced by a protease from one that existed in the animal, or separate a batch effect from a biological difference when the design confounded the two. The computational stage is where the consequences of the experimental stage become visible. It is not where they are undone. None of this makes the computation unimportant. Single-cell data are unlike almost anything else biologists have handled: extremely high-dimensional, extremely sparse, with a noise structure that changes systematically with expression level. Naive analysis of such data produces confident nonsense with remarkable ease. Two of the most widely used tools in the field — t-distributed stochastic neighbour embedding and uniform manifold approximation and projection — are visualisation methods that compress twenty thousand dimensions into two, and they necessarily discard most of the structure they are shown. Readers routinely interpret the distances between blobs on a UMAP as though those distances meant something. Mostly they do not. So the booklet runs the length of the pipeline, from a piece of tissue to a set of annotated cell types, and asks at each stage the same two questions: what is actually happening to the molecules, and what does that imply for what you are allowed to conclude. The order is the order of the experiment, because the errors compound in that order. What this covers, and what it leaves out The core is the now-standard workflow: droplet-based capture of individual cells or nuclei, barcoded reverse transcription with unique molecular identifiers, short-read sequencing of a 3' or 5' tag, alignment and counting, quality control, normalisation, dimensionality reduction, graph-based clustering, and cell-type annotation. This is what the overwhelming majority of single-cell experiments look like in practice, and it is the workflow whose failure modes are best characterised. Plate-based full-length protocols and combinatorial indexing appear where they clarify a trade-off, since understanding why droplet methods dominate requires knowing what they gave up. Multimodal extensions — surface protein measurement, chromatin accessibility, spatial transcriptomics — are mentioned at the points where they change a design decision, but they are not treated in depth. Each is a subject in its own right, and a short book that gestured at all of them would explain none of them. Trajectory inference, RNA velocity, and differential expression between conditions get one chapter near the end, framed mainly around the statistical traps they set, because these are the analyses where single-cell papers most often overreach. The recurring mistake Across thousands of single-cell papers, one error appears more than any other: treating a cluster as a discovery. A clustering algorithm run on single-cell data will always return clusters. It will return them from a homogeneous cell line. It will return them from random noise with the right correlation structure. The algorithms in standard use have a resolution parameter that trades directly against the number of clusters returned, and there is no principled, universally applicable way to set it. When someone reports finding "seventeen cell states" in a tissue, the seventeen is a function of a parameter they chose, applied to a graph they built, from a low-dimensional representation they computed, of a matrix whose contents were shaped by how long the tissue sat in collagenase. That is not a reason to distrust the method. It is a reason to understand what a cluster is: a hypothesis, generated by an algorithm, that a group of cells shares something worth naming. Whether it is worth naming depends on evidence that the clustering cannot supply — reproducibility across independent samples, coherent marker genes with known biology, orthogonal validation, robustness to the analytical choices that were made arbitrarily. The habit this booklet tries to build is the reflex of asking, at every stage, "what else could have produced this?" A rare population expressing heat-shock genes, mitochondrial transcripts, and immediate-early genes is usually damage, not a cell type. A cluster present in one sample and absent in another is usually a batch effect, unless the design allows you to say otherwise. A smooth gradient in a UMAP is often an artefact of the embedding rather than a developmental continuum. These are not exotic failures; they are the normal output of a correctly executed pipeline applied to imperfect data, which is all data. Who this is for It assumes a working knowledge of molecular biology — what mRNA is, what reverse transcription does, roughly how short-read sequencing works — and no particular computational background. Where statistical ideas matter, they are explained in words, because the concepts that cause trouble in practice are conceptual rather than mathematical. Understanding why a negative binomial distribution is the right model for counts matters more than being able to derive its variance. It is written for the person who will design an experiment and then have to defend its conclusions: the postdoc planning a first single-cell study, the principal investigator deciding whether the proposed design can answer the question, the collaborator asked to interpret someone else's atlas. For those readers, the most valuable thing is not a list of recommended tools, which will be obsolete within a few years, but a clear picture of where the information in the data comes from and where it leaks away. The field has matured enough that the genuinely important choices are stable even as the software churns. How you get cells out of a tissue, how you block your samples against batch effects, how many cells you need, what a doublet does to a cluster, why you should not run differential expression across thousands of cells as though each were an independent replicate — none of these depend on which package version you install. They are the parts worth learning properly. By the end, the goal is a reader who can look at a single-cell figure — their own or someone else's — and reconstruct the chain of decisions that produced it, then say which links in that chain are load-bearing and which are assumptions in a coloured wrapper. That is a more useful skill than knowing any particular pipeline, and it is the one the literature most conspicuously lacks. Chapter 1: What the Experiment Actually Measures Before any question about clustering or trajectories can be answered sensibly, it is worth being precise about what a single-cell RNA sequencing experiment measures, because the answer is narrower than the phrase suggests and the narrowness explains most of what follows. The experiment does not measure the transcriptome of a cell. It samples it — sparsely, with a capture efficiency that is usually between five and thirty per cent, in a manner that is biased by transcript length, sequence composition, polyadenylation status, and the position of the transcript within the cell at the moment of lysis. What lands in the count matrix is a random subsample of the molecules that survived every step between the intact tissue and the sequencer. Understanding that sentence properly resolves an enormous amount of confusion downstream, including the perennial argument about whether single-cell data contain "dropouts", how to normalise counts, and why two cells of the same type can share only a few thousand detected genes out of the twelve thousand each is actually transcribing. The molecular budget A typical mammalian cell contains somewhere between 100,000 and 500,000 mRNA molecules, transcribed from perhaps 10,000 to 15,000 distinct genes. The distribution across genes is extremely skewed. A handful of genes — ribosomal proteins, mitochondrial transcripts, actin, a lineage-defining structural gene or two — may account for a third or more of the total molecules. Thousands of genes are present at one, two, or five copies per cell. Transcription factors, the genes biologists most want to see, live almost entirely in this low-copy regime. Now capture fifteen per cent of those molecules. The highly expressed genes are unaffected in any practical sense: if a cell holds 3,000 copies of a ribosomal protein transcript, you will observe something in the neighbourhood of 450, and the sampling noise is negligible relative to the signal. A gene present at three copies is a different matter. Fifteen per cent capture means that, on average, you observe 0.45 molecules. Roughly two-thirds of the time you observe zero. The gene is transcribed, the protein may be functionally decisive, and the count matrix records nothing. This is the origin of sparsity. A typical droplet-based dataset has 90 to 95 per cent zeros. Those zeros are not measurement failures in the usual sense, and they are not a special "dropout" phenomenon requiring a special model. They are what binomial sampling from a skewed distribution looks like. The clearest demonstration of this came from work showing that droplet-based single-cell counts are well described by a simple negative binomial distribution without any extra zero-inflation component — the zeros are exactly as numerous as ordinary count sampling predicts, once the mean expression and the cell's total depth are accounted for. Plate-based protocols with more amplification steps show more excess zeros, which is itself informative: the excess comes from the chemistry, not from biology. The practical consequence is that a zero in a count matrix carries information, but weak and asymmetric information. A zero for a highly expressed gene in a well-sequenced cell is strong evidence of absence. A zero for a low-expressed gene is nearly uninformative. Analysis methods that treat all zeros alike — and many do implicitly — throw away this distinction. Why unique molecular identifiers changed everything The other half of the counting problem is amplification. A single cell contains picograms of RNA; a sequencer needs nanograms of library. Something on the order of a million-fold amplification stands between them, achieved by PCR, and PCR is not uniform. Different templates amplify at different efficiencies depending on length, GC content, and secondary structure, and those differences compound exponentially across cycles. Two molecules present at equal abundance in the cell can differ tenfold in read count after amplification, with the difference varying unpredictably between cells. Unique molecular identifiers solve this by tagging each original molecule before amplification. The reverse transcription primer carries, alongside the cell barcode, a stretch of random nucleotides — typically ten to sixteen bases — that is essentially unique to that particular capture event. After sequencing, reads sharing a cell barcode, a gene, and a UMI are collapsed to a single count. What you count is therefore molecules captured, not reads generated, and PCR bias largely disappears from the quantification. The qualifier "largely" matters. UMI collapsing is imperfect for three reasons. Sequencing errors in the UMI sequence create spurious distinct UMIs, inflating counts, which is why tools apply error-tolerant collapsing that merges UMIs within a Hamming distance of one. Highly expressed genes can saturate the UMI space — with a ten-base UMI there are about a million possible sequences, but the birthday problem bites long before that, and a gene with 10,000 molecules in a cell will show collisions where two distinct molecules received the same tag. And PCR chimeras can transfer a UMI between templates. None of these is usually fatal, but all of them mean that a UMI count is an estimate of molecules captured, not an exact tally. UMIs also change what sequencing depth buys you. Without UMIs, more reads means more precise quantification indefinitely. With UMIs, more reads means more of the captured molecules get observed at least once, and this saturates. Once you have sequenced deeply enough that most of the library's distinct molecules have been seen, additional reads add duplicates and nothing else. The saturation curve is the single most useful diagnostic for deciding whether a run was sequenced adequately, and it is discussed properly in Chapter 5. What a count matrix is not Three misreadings of the count matrix are common enough to be worth naming. It is not a measure of concentration. The count for a gene in a cell depends on the number of molecules in that cell and on that cell's total capture, and the latter varies enormously — a well-captured cell might yield 20,000 UMIs and a poorly captured one 1,500. Comparing raw counts between cells is meaningless. This is why normalisation exists, and why the normalisation choice has real consequences (Chapter 7). It is also why a "high expression" claim requires care: a cell with twice the counts of its neighbour may be twice as transcriptionally active, twice as large, or simply better captured. It is not a measure of the cell in vivo. Every step from tissue to library alters the transcriptome. Dissociation induces stress responses within minutes. Cells die and release RNA into the suspension, which is then captured alongside intact cells. Fragile cell types are lost preferentially. The matrix describes cells as they were at the moment of lysis in the droplet, which may be an hour or more after the tissue left the animal (Chapter 3). It is not a complete inventory of even the captured molecules. Standard droplet chemistry sequences a short tag from one end of each transcript — usually the 3' end, sometimes the 5'. That tag identifies which gene the molecule came from, but says nothing about splice isoforms, allelic origin at most loci, mutations elsewhere in the transcript, or transcript length. A 3' assay cannot distinguish two isoforms that share a terminal exon, and most isoforms do. Single-cell work is, with few exceptions, gene-level work. The variance structure that drives everything The last property worth internalising is how noise scales with expression. For count data of this kind, the variance is approximately the mean plus a term proportional to the mean squared. The first component is Poisson sampling noise, unavoidable and dominant at low counts. The second is biological and technical variability in the underlying expression level, dominant at high counts. This has an immediate consequence that trips up almost everyone at first: the genes with the largest raw variance across cells are simply the genes with the largest means. Ribosomal and mitochondrial genes top every raw variance ranking, not because they distinguish cell types but because they are abundant. Selecting variable genes therefore requires modelling the mean-variance relationship and picking genes whose variance exceeds what their mean predicts. Every serious feature selection method does some version of this, and the naive alternative — take the top genes by variance — reliably selects housekeeping genes and produces clusters that separate cells by depth rather than identity. The same structure explains why log transformation is ubiquitous and why it is imperfect. Taking logs stabilises variance reasonably well for moderately expressed genes, which is most of what drives structure. It behaves poorly at the low end, where counts of zero and one dominate and the pseudocount added to avoid log(0) starts doing the work. Alternatives built explicitly on count models — Pearson residuals, generalised linear model PCA — handle the low end better and have gained ground accordingly, though log-normalisation remains the default in most pipelines and is not, in practice, the thing that ruins an analysis. The chain of custody It helps to hold the whole measurement chain in mind as a chain of custody for information. The cell holds, say, 200,000 molecules. Lysis and reverse transcription capture perhaps 20,000 of them. Library construction, size selection, and sequencing yield reads covering perhaps 15,000 distinct molecules at typical depth. Alignment assigns most but not all of those reads to genes; multi-mapping reads and reads falling in ambiguous regions are discarded. Quality filtering removes some cells entirely and, with them, everything they contained. At each link, information is lost irreversibly and selectively — not at random, but in ways correlated with transcript properties and cell properties. The count matrix is the residue. Everything the analysis can do is rearrange that residue into a more interpretable form. It cannot add back what was dropped, and no statistical method, however sophisticated, can distinguish a gene that was never expressed from one that was expressed and not captured, except by borrowing information from other cells and hoping the borrowing is valid. This is the sense in which experimental design dominates. The decisions that determine how much of the original information survives are made at the bench. The computation works with what arrives. A worked example of the sampling problem Numbers make the abstraction concrete. Consider a T cell holding 250,000 mRNA molecules. Suppose the transcription factor FOXP3 is present at eight copies — enough, in a regulatory T cell, to be functionally decisive. Suppose further that the assay captures twelve per cent of molecules, which is realistic for a well-run droplet experiment. The expected count for FOXP3 is 0.96 molecules. Under Poisson sampling, the probability of observing zero is about 38 per cent. So in a population of a thousand genuine regulatory T cells, roughly 380 will show no FOXP3 at all. If you gate on FOXP3-positive cells, you discard more than a third of the population you are trying to study, and you discard them non-randomly: the cells with the lowest expression and the lowest capture go first. Now scale the problem. Suppose you want to identify these cells by a signature of five genes, each at similar abundance. The probability that all five are detected in a given cell is roughly 0.62 to the fifth power — about nine per cent. A signature that looks robust when you think about it in terms of biology becomes a coin-flip in practice. This is why single-cell analysis leans so heavily on aggregation. Scoring a module of fifty co-regulated genes is far more stable than scoring one gene, because the sampling noise averages out. Clustering pools information across thousands of genes and thousands of cells simultaneously, which is why clustering works at all on data this sparse. The moment you look at individual genes in individual cells, you are back in the regime where noise dominates, and the correct response is scepticism rather than a better plot. It also explains the reliability gradient in published claims. "This cluster is enriched for an interferon response programme" rests on aggregate evidence across many genes and cells and is usually trustworthy. "This cell co-expresses gene A and gene B, so a hybrid state exists" rests on two low-count observations in one cell and usually is not — particularly since doublets produce exactly that pattern by construction (Chapter 6). Cells are not the same size The count matrix conflates two things that biologists usually want to keep apart: how much of a gene a cell contains, and how much RNA the cell contains in total. Total mRNA content varies by an order of magnitude across cell types. A plasma cell, dedicated to immunoglobulin secretion, holds vastly more mRNA than a resting lymphocyte. A large hepatocyte holds more than a small granulocyte. Proliferating cells in G2 have roughly twice the RNA of the same cells in G1. Neurons, with their enormous cytoplasmic volume, hold more than most glia. In the count matrix, these differences appear as differences in total UMIs per cell — and standard normalisation, which divides each cell's counts by its total, deliberately erases them. After normalisation, every cell is treated as though it held the same total quantity of RNA, and what remains is the proportion of the transcriptome devoted to each gene. That choice is defensible and nearly universal, but it has a consequence worth stating: single-cell expression measurements are compositional. If a plasma cell devotes sixty per cent of its transcriptome to a handful of immunoglobulin genes, every other gene's proportion falls, and those genes will appear "downregulated" relative to a cell without that burden, even if their absolute copy number is unchanged. The same artefact appears in any cell type with a dominant transcript: haemoglobin in erythroid cells, surfactant genes in alveolar type II cells, collagens in activated fibroblasts. Practically, this means two habits are worth adopting. First, look at what fraction of a cluster's counts is taken up by its top few genes; when that fraction is large, treat modest changes in other genes with caution. Second, be suspicious of "global downregulation" results, which are frequently the shadow of a single gene's upregulation. Some pipelines address this by excluding dominant gene families from the normalisation total — immunoglobulin, haemoglobin, and mitochondrial genes are common candidates — which is a reasonable defensive move when a dataset is dominated by one secretory lineage. Spike-ins and the question of absolute numbers If proportions are all standard workflows give you, can absolute molecule counts be recovered? In principle yes, by adding a known quantity of synthetic RNA to each reaction — the External RNA Controls Consortium spike-in set is the standard reagent — and using the recovery of those known molecules to calibrate the recovery of everything else. Spike-ins were routine in the plate-based era, where each cell sits in its own well and receives an identical dose. They largely disappeared with droplet methods, for a straightforward physical reason: in a droplet workflow the spike-in RNA is dissolved in the bulk reagent and is partitioned into every droplet, including the empty ones, so it consumes a fraction of the sequencing budget across tens of thousands of partitions rather than concentrating in the cells you care about. Controlling the dose per cell is also much harder when cells arrive stochastically. The loss is real but modest for most questions. Comparative work using spike-ins established the capture efficiencies quoted throughout this booklet and showed that droplet methods trade sensitivity for throughput in a predictable way — full-length plate protocols detect more genes per cell, droplet protocols detect fewer genes in vastly more cells. For the great majority of studies, which ask which cell types are present and how their expression profiles differ, proportions suffice. For studies that genuinely need absolute quantities — measuring transcriptional burst sizes, calibrating models of transcription kinetics — spike-ins or a plate-based protocol remain necessary, and the choice has to be made at design time. Nuclei hold a different transcriptome One further complication belongs here because it changes the interpretation of the count matrix itself. When tissue cannot be dissociated into intact cells — frozen archival material, adipose tissue, skeletal muscle, adult brain — the standard alternative is to isolate nuclei and sequence those instead. A nucleus contains perhaps ten to twenty per cent of the cell's mRNA, so counts per barcode are correspondingly lower: 1,000 to 3,000 UMIs is typical where a whole-cell experiment might give 5,000 to 15,000. More importantly, the nuclear RNA population differs in composition. It is enriched for unspliced pre-mRNA, because splicing is incomplete at the point of nuclear export, which is why nuclear datasets require counting reads in introns as well as exons to recover adequate signal. It is depleted of mitochondrial transcripts, which live in the cytoplasm — a property that makes the usual mitochondrial quality filter useless for nuclear data. And it under-represents stable cytoplasmic transcripts with long half-lives, while over-representing genes under active transcription at the moment of isolation. The two assays therefore measure related but distinct quantities, and correlations between matched whole-cell and single-nucleus datasets from the same tissue are good but far from perfect. Cell type proportions also differ, sometimes dramatically, because the biases in what survives dissociation are not the biases in what survives nuclear isolation. Comparing a nuclear dataset directly against a whole-cell dataset — as though they were two batches of the same measurement — is a design error, and integration methods will happily produce a plausible-looking merged embedding that hides it. Chapter 2: Designing an Experiment That Can Answer the Question Most single-cell studies are designed backwards. The question is settled, a platform is chosen, samples are collected as they become available, and the design — the actual allocation of samples to batches, the replication structure, the number of cells — emerges from logistics rather than from the inference the study needs to support. The result is a dataset in which the biological contrast of interest is partly or wholly confounded with a technical one, and no amount of computational correction can separate them, because the information required to do so was never collected. This chapter is about the decisions that must be made before any tissue is touched. They are unglamorous and they determine whether the study can succeed. Replication means biological replication The first and most consequential error is the one that looks most like a solution: treating cells as replicates. A single-cell experiment on one mouse yields ten thousand cells. It is enormously tempting to regard those as ten thousand observations, and the statistical machinery in most single-cell packages will happily oblige, returning p-values of 10⁻⁵⁰ for differences between two conditions. Those p-values are wrong, sometimes by dozens of orders of magnitude, and the reason is simple: the cells within an animal are not independent. They share that animal's genotype, its environment, its infection status, the batch of enzyme used on its tissue, the day it was processed. The effective sample size for a between-animal comparison is the number of animals, not the number of cells. This is not a subtle point, but it took the field an embarrassingly long time to act on it. Systematic re-analyses of published single-cell differential expression results showed that methods treating cells as independent produce large numbers of false positives, and that aggregating each sample's cells into a pseudobulk profile before testing recovers a much more honest picture. The effect is not marginal: the gene lists change substantially, and many of the genes that vanish are the ones the original papers built their conclusions on. Chapter 10 returns to the mechanics. The design implication is immediate and severe. If you plan to compare two conditions, you need multiple independent biological samples per condition. Three per group is the practical minimum for any claim about differential expression, and three is not generous. Two per group supports descriptive claims — which cell types are present, roughly what their profiles look like — and essentially nothing inferential. One per group supports nothing at all, however many cells it contains. This is where budgets collide with statistics. Sequencing one sample very deeply is cheaper than sequencing four samples shallowly, and produces a dataset that looks richer. It is nonetheless worth less, because depth within a sample buys precision about that sample, and precision about a single animal answers no question about the population of animals. When the budget is tight, the correct sacrifice is cells per sample, not samples. Confounding, and why it is usually invisible The second error is confounding the variable of interest with a processing variable. It happens almost by default. Consider a study of tumour versus adjacent normal tissue. The tumours arrive from surgery on Tuesdays; the normals are collected from a different surgical list on Thursdays. Or: all control samples were processed in the first month while the protocol was being optimised, and all treated samples in the second. Or, most commonly: each sample was loaded on its own microfluidic chip on the day it arrived, so sample identity and chip identity are perfectly aligned. In each case a technical factor tracks the biological one exactly. When the analysis finds differences, there is no statistical way to attribute them, because "attribute" requires at least one instance of the biological condition measured under the other technical condition. Batch correction methods do not solve this; they assume the batches contain overlapping biological populations and align them on that assumption. Applied to a confounded design, they will either erase the biological difference along with the technical one or leave both intact, and you cannot tell which from the output. The defences are the classical ones. Randomise the assignment of samples to processing days and to positions within a run, so that no technical factor systematically tracks a biological one. Block deliberately where randomisation is impractical: if you must process in two batches, put half of each condition in each batch. Record everything — the operator, the reagent lot, the dissociation time, the chip, the flow cell, the time from excision to loading — because a factor you did not record cannot be modelled, and because these variables have measurable effects on the data. The hardest case is when confounding is structural. Post-mortem human brain tissue cannot be collected in a randomised order; patients present when they present. Here the honest response is to acknowledge the limitation in the design, collect covariates that let you at least check for association, and temper the claims accordingly. Multiplexing: the design tool that changed the calculus The single most useful technical development for single-cell design is multiplexing — pooling several samples into one capture reaction and assigning cells back to their source computationally afterwards. The benefit is not primarily cost, though pooling eight samples into one lane does reduce per-sample cost substantially. The benefit is that every pooled sample experiences identical chemistry: the same droplet run, the same reverse transcription mix, the same amplification cycles, the same sequencing lane. Batch effects between samples in a pool are essentially eliminated, because there is no batch between them. A design that pools all conditions together in every run converts the worst confounding problem in the field into a non-problem. Multiplexing also solves doublet detection almost for free. When cells from different samples are pooled, a droplet containing two cells has a good chance of containing cells from two different samples, which the demultiplexing step identifies directly. With eight pooled samples, roughly seven-eighths of doublets are detectable this way — far more reliable than inferring doublets from expression profiles alone. Four approaches are in general use, and they differ in what they require and what they deliver, as Table 1 sets out. Table 1. Multiplexing strategies for pooling samples in one capture. Approach How cells are tagged Requires Detects cross-sample doublets Main limitation Genetic demultiplexing Natural SNP differences between donors Genetically distinct individuals Yes Useless for inbred animals or same-donor samples Antibody hashing Oligo-tagged antibodies against ubiquitous surface proteins Good surface epitopes; extra library Yes Poor on cells with low surface protein; extra cost Lipid-modified oligos Oligos inserted into the plasma membrane Intact membranes Yes Not usable on nuclei; tag transfer if pooled early Fixed-cell barcoding Barcoded probes hybridised after fixation Fixation-compatible chemistry Partially Probe panel limits transcript coverage Genetic demultiplexing is the most attractive when it is available: it costs nothing extra at the bench, uses variation that is already present, and cannot be lost by a failed staining step. Human studies pooling unrelated donors should default to it. It fails entirely for inbred mouse strains, for repeated samples from one patient, and for comparisons within a single genetic background — which is precisely where hashing earns its place. A caution about hashing: it works well on cells with abundant, uniformly expressed surface proteins and poorly on cells without them. In practice this means it performs well on blood and lymphoid tissue and variably on solid tissue, where some cell types stain weakly enough that a substantial fraction of cells cannot be assigned confidently. Those unassigned cells are then dropped, and whether they are dropped at random depends on cell type — a selection effect that is easy to miss. How many cells, and how deep The third design question is allocation: given a fixed budget, how many cells should you capture, and how many reads should each get? The two are in direct tension. A sequencing run delivers a fixed number of reads. Splitting them across more cells means fewer reads per cell, which means fewer of each cell's captured molecules get observed, which means a sparser matrix. The right balance depends entirely on the question. For identifying cell types, including rare ones, cells matter far more than depth. Cell type identity is encoded redundantly across hundreds of genes, and clustering aggregates across all of them, so it survives sparsity well. Datasets at 10,000 to 20,000 reads per cell cluster essentially as well as the same cells sequenced at 100,000. Spending a budget on more cells at moderate depth is almost always the better trade when the goal is a census. For measuring expression within a known population — quantifying a specific pathway, comparing levels of a moderately expressed gene between conditions — depth matters more, because the precision of a per-cell estimate depends on how many molecules of that gene were observed. Theoretical treatments of the trade-off converge on the same qualitative answer: for detection-type questions, spread reads thin; for estimation-type questions, concentrate them. Around 50,000 reads per cell is a common working figure for the latter. For rare populations, the governing arithmetic is simple sampling. To have a high probability of capturing at least twenty cells of a type present at one per cent, you need roughly three thousand cells; at one in a thousand, thirty thousand. And twenty cells is a bare minimum for a cluster to separate reliably — below roughly fifty cells, a population frequently fails to form its own cluster at all and is absorbed into a neighbour. If the target population is rare and the point of the study, enrichment by sorting before capture is usually a better investment than sequencing a vast unenriched sample. Two further considerations bound the answer from above. Loading more cells per droplet run increases the doublet rate roughly linearly — a standard droplet platform gives about 0.8 per cent doublets per thousand recovered cells, so a run recovering 20,000 cells carries a sixteen per cent doublet rate. Multiplexing makes high loading safe, because most of those doublets become detectable; without it, high loading is a straightforward way to manufacture fictional intermediate cell states. And there is a point of diminishing returns in sequencing depth per cell: once the saturation curve flattens, additional reads are duplicates of molecules already counted, and the money is better spent on another sample. Write the analysis plan first A discipline borrowed from clinical trials transfers well here. Before collecting anything, write down what the analysis will be: which comparisons will be made, at what level (cell type, pseudobulk sample), with what covariates in the model, and what result would count as support for the hypothesis. The exercise is quick and it exposes design failures while they are still fixable. A plan that reads "compare treated and control within each cell type using a mixed model with sample as a random effect" immediately reveals that you need several samples per group. A plan that reads "identify cell types present only in disease" reveals that you need enough cells per sample to detect a population at the relevant frequency, and that you need a way to distinguish a genuinely absent population from one lost during dissociation. It also protects against the characteristic single-cell failure of exploratory drift: cluster, notice something, subcluster, notice something else, and arrive at a conclusion the data were never designed to support. Exploration is legitimate and often the point, but a pre-specified plan makes the line between confirmation and exploration visible in the write-up, which is where it belongs. Pilot before you commit Single-cell experiments fail in ways that are obvious in retrospect and invisible in advance. A dissociation protocol that works beautifully on mouse spleen destroys mouse kidney. A tumour yields ninety per cent dead cells. A tissue releases so much ambient RNA that every droplet looks like a hepatocyte. None of this is predictable from the literature, because published protocols report the version that worked on the tissue the authors had. A pilot run — one or two samples, a small number of cells, processed exactly as the full study will be — costs a fraction of the main experiment and answers the questions that matter most. Does the dissociation produce a viable single-cell suspension? What is the viability, and does it drop between the end of dissociation and loading? Which cell types appear, and are the ones you expected present in plausible proportions? How much ambient RNA is there? Are the cells you care about surviving? The last question deserves emphasis, because the most damaging dissociation failures are silent. A protocol that destroys a fragile population does not announce itself; it simply returns a dataset in which that population is absent, and absence is indistinguishable from "this tissue does not contain that cell type" unless you know better from orthogonal evidence. Comparing the proportions in your pilot against flow cytometry or histology on the same tissue is the only reliable check, and it is worth the effort whenever the study's conclusions depend on composition. A pilot also calibrates the arithmetic. It tells you the actual recovery rate — the fraction of loaded cells that become usable barcodes, which is rarely the number in the manufacturer's documentation — and the actual saturation behaviour, which together let you plan the full run's loading and sequencing with real numbers instead of assumptions. Fresh, frozen, or fixed How samples will be preserved between collection and processing is a design decision, not an operational detail, because it constrains everything downstream. Fresh processing — tissue to loaded chip within a couple of hours — gives the best data and is often impossible. Surgical material arrives unpredictably, clinical samples come from multiple sites, and a study spanning fifty patients cannot process each one on arrival without confounding sample with day. Cryopreserving intact cells in a dimethyl sulphoxide-based medium works well for blood and for lymphoid tissue, where cells are already in suspension and tolerate freeze-thaw. It works poorly for many solid tissues, where dissociated cells are fragile and thawing produces heavy debris. The important point for design is that freeze-thaw is itself a batch variable: samples processed fresh and samples processed from frozen should never be compared as though the difference were negligible. Snap-freezing whole tissue and later isolating nuclei is the most robust option for difficult material and for retrospective studies on archived specimens. It shifts the assay to single-nucleus sequencing, with the interpretive consequences described in Chapter 1, and it should be applied to every sample in the study or none. Chemical fixation — methanol, or the formaldehyde-based chemistries built into probe-hybridisation workflows — decouples collection from processing entirely, allowing samples to accumulate and then be processed together in one batch. That is a substantial design advantage: it converts a multi-site, multi-month collection into a single processing batch. The cost is a restriction on what is measured. Probe-based assays quantify a fixed panel of targeted transcripts rather than the whole transcriptome, which is fine for a well-defined census and unsuitable for discovering unannotated biology. The rule that follows from all of this is simple and frequently broken: choose one preservation route and apply it uniformly. A dataset mixing fresh, frozen, and fixed samples contains a technical axis larger than most biological effects, and if that axis happens to align with the comparison of interest, the study is unsalvageable. Power, honestly Formal power calculations for single-cell studies exist, and tools for them are available, but the honest position is that they are less useful than they look. Power depends on the effect size, the between-sample variance, the cell type's abundance, and its expression level — quantities that are rarely known in advance and vary by orders of magnitude across genes. What is useful is a rough feasibility check, done in two parts. First, the detection question: given the expected frequency of the population of interest and the number of cells per sample, how many cells of that type will each sample contribute? If the answer is fewer than about fifty, the study cannot make per-sample statements about that population, and the design needs enrichment or more cells. Second, the comparison question: how many independent samples per group, and is that number in the range where between-sample variance can even be estimated? Below three, it cannot. Answering those two questions honestly will kill a fair number of proposed experiments, which is the point. The alternative — running the study and discovering at analysis time that the key population contributed eleven cells in one sample and two in another — is far more expensive. Chapter 3: Getting Cells Out of Tissue Tissue is not a suspension of cells. It is cells embedded in extracellular matrix, joined by junctional complexes, wrapped around vessels, and in many organs physically interlocked. Converting it into a suspension of intact, viable, singly separated cells is a violent process, and the violence is recorded in the data. This is the step where the most information is lost and where the loss is least visible afterwards. A count matrix gives no direct indication that a third of the cells in the original tissue never made it into the suspension, or that the ones that did spent forty minutes at 37 °C mounting a stress response. The consequences show up as missing populations, distorted proportions, and clusters defined by genes that have nothing to do with the biology under study. What dissociation does to cells The standard approach is enzymatic. Tissue is minced and incubated with proteases — collagenase, dispase, trypsin, papain, or proprietary cocktails — at 37 °C, with mechanical agitation, until the matrix is degraded and cells release. Times range from ten minutes for soft lymphoid tissue to over an hour for fibrotic tumours or adult heart. Three things happen during that incubation, all of them problems. Cells transcribe. Warm cells with intact machinery respond to their circumstances, and being torn from a tissue while enzymes digest the surface is a circumstance that provokes a strong response. Within fifteen to thirty minutes, dissociated cells induce immediate-early genes — FOS, JUN, JUNB, EGR1 — followed by heat-shock proteins and, in many cell types, inflammatory mediators. The magnitude is not subtle. Careful comparisons of warm enzymatic dissociation against protocols designed to suppress transcription have shown that hundreds of genes change, and that the induced programme is large enough to drive clustering: cells separate by how stressed they became rather than by what they were. Cells die. Enzymatic digestion kills a fraction of every population, and the fraction varies by cell type. Neurons, adipocytes, and large epithelial cells are fragile; lymphocytes and fibroblasts are robust. Dying cells release their contents into the buffer, creating the ambient RNA pool that contaminates every subsequent droplet (Chapter 6). Cells are lost mechanically. Filtering, centrifugation, and washing each remove a share of the suspension, and again not at random. Large cells are lost to filters; small ones to inadequate centrifugation. Cells that remain in undigested fragments are discarded with the fragments. The combined effect is that the cell type proportions in a single-cell dataset are not the proportions in the tissue. They are the proportions in the tissue, multiplied by each type's survival probability through the whole procedure. Since those probabilities are unknown and tissue-specific, composition claims derived from single-cell data alone should be treated as provisional unless corroborated by a method that does not require dissociation — imaging, flow cytometry on minimally processed material, or single-nucleus sequencing, which has different biases rather than none. Suppressing the stress response Two strategies reduce the artefact, and both are worth knowing. The first is to dissociate in the cold. Proteases active at low temperature — a bacterial protease isolated from Bacillus licheniformis is the best characterised — permit digestion at 4 to 6 °C, where transcription and translation are largely arrested. Comparisons of cold and warm dissociation of the same tissue show markedly reduced stress signatures and, in several tissues, better recovery of fragile populations. The trade-off is slower, sometimes less complete digestion, and the need for protocol development on each tissue. The second is to block transcription pharmacologically. Adding actinomycin D, triptolide, or a combination of transcription and translation inhibitors to the dissociation buffer prevents the induction of new transcripts. This works well and is straightforward, but it carries an interpretive caveat that is easy to overlook: blocking transcription does not freeze the transcriptome, because degradation continues. Short-lived transcripts decay while nothing replaces them, so the measured profile drifts in its own direction. For most purposes the drift is a smaller problem than the stress response, but it is not zero. A third strategy avoids the issue rather than solving it: skip the cells entirely and isolate nuclei from frozen tissue, discussed below. Whichever route is chosen, the residual artefact must be handled analytically. The standard practice is to score every cell for a dissociation-associated gene module — the immediate-early and heat-shock genes, using a published list appropriate to the species — and to check whether that score drives any cluster. A cluster defined by high stress score and little else is an artefact, and treating it as a cell state is one of the most common errors in the literature. Regressing the score out is possible but risky: in tissues where the immediate-early genes carry real signal, such as neurons responding to activity, regression removes biology along with the artefact. Cells or nuclei For a growing share of tissues, the answer to "how do I dissociate this?" is "do not". Single-nucleus RNA sequencing isolates nuclei from mechanically homogenised tissue, typically frozen, using a detergent-containing lysis buffer that strips the plasma membrane while leaving nuclear membranes intact. The advantages are substantial. Frozen and archival material becomes usable, which opens up biobanks and multi-site clinical collections. Tissues that resist dissociation — adult brain, skeletal muscle, heart, adipose, kidney, bone — become tractable. Cell types that cannot survive dissociation at all, such as adipocytes and large neurons, are recovered in something closer to their true proportions. And because homogenisation is fast and cold, the stress-response artefact largely disappears. The costs are those set out in Chapter 1 — lower complexity per barcode, a nuclear rather than whole-cell transcriptome, heavy reliance on intronic reads — plus two practical ones. Ambient contamination in nuclear preparations is often worse, because homogenisation releases cytoplasmic RNA from every cell in the sample into the buffer, and that soup is then partitioned into droplets alongside the nuclei. And the quality control metrics differ: mitochondrial fraction is meaningless as a filter, so other criteria must carry the load. Direct comparisons on the same tissue make the trade-off concrete. In kidney, whole-cell dissociation under-represents certain tubular epithelial populations and over-represents immune cells, while nuclear isolation recovers the epithelium in proportions closer to histology. In brain, whole-cell protocols on adult tissue recover glia and lose neurons almost entirely; nuclear isolation recovers both. In neither case is one method simply better — they are differently biased, and the right choice follows from which populations the study depends on. The design rule is uniformity. Mixing cells and nuclei within a study introduces a technical axis that dwarfs most biological signals, and integration methods will merge them into a shared embedding that conceals rather than resolves the difference. Enrichment and its consequences When the population of interest is rare, enriching for it before capture is far cheaper than sequencing everything. Fluorescence-activated cell sorting, magnetic bead selection, and density gradients are all in routine use. Sorting has two costs. It takes time — often an hour or more between dissociation and loading — during which the stress response continues and viability declines. And it imposes an additional selection on the population, since the sort gate is defined by a small number of surface markers whose relationship to transcriptional identity is imperfect. A gate that captures ninety per cent of the target type also captures whatever else shares those markers, and the resulting dataset's composition reflects the gate as much as the tissue. Negative selection by magnetic depletion is gentler and faster. Removing an abundant population — red cells, or a dominant epithelial fraction — enriches everything else proportionally without gating on the cells you want to keep, which avoids biasing the population of interest by the markers used to select it. A useful alternative to physical enrichment is computational enrichment through multiplexing: pool many samples, load heavily, and accept that you are sequencing a large number of common cells to reach the rare ones. When sequencing is cheap relative to sample collection, this is often the better trade, and it avoids the stress and selection costs of sorting entirely. Whatever route is chosen, record it and report it. An enriched dataset's composition is a statement about the enrichment protocol, not about the tissue, and readers who treat cluster proportions as biology will draw the wrong conclusion unless the enrichment is made explicit. Viability, debris, and the number that matters The practical gate before loading is a viability count, usually by dye exclusion. The usual target is above eighty per cent, and above ninety per cent for demanding applications. The number matters because dead cells contribute disproportionately to the problems downstream. A dead cell may still be counted as a barcode, contributing a profile dominated by mitochondrial transcripts. More importantly, cells that have lysed are no longer counted at all, but their RNA is still in the buffer, and that free RNA is the ambient contamination that will appear in every droplet. A suspension at sixty per cent viability has, by definition, released a great deal of RNA, and the resulting dataset will show a strong ambient signature — typically the transcriptome of whichever cell type was most abundant and most fragile, superimposed faintly on everything else. Two practical moves help when viability is poor. Dead cell removal by magnetic bead or column depletion improves the ratio, though it does not remove RNA already in solution — a wash after depletion does that, and is the more important step. And loading fewer cells reduces the absolute quantity of ambient material per droplet, at the cost of yield. The habit worth building is to treat the suspension itself as a measured object, not a step to get through. Record viability, cell concentration, the presence of clumps or debris, and the elapsed time from tissue collection. These numbers explain more about a dataset's eventual quality than anything measured afterwards, and when a run disappoints, they are usually where the explanation lies. Four tissues, four different problems Generic advice about dissociation is of limited use because the difficulties are specific. Four examples show the range. Peripheral blood is the easy case and the reason so many methods papers use it. Cells arrive already in suspension; the only processing needed is density gradient separation of mononuclear cells or red cell lysis. Viability is routinely above ninety-five per cent, stress signatures are minimal, and ambient RNA is low. The main hazards are platelet contamination, which appears as a spray of platelet transcripts across all barcodes, and the loss of granulocytes, which are removed by standard density gradients and are in any case poorly represented in droplet data because of their low RNA content and high ribonuclease levels. A dataset described as "peripheral blood mononuclear cells" that reports no neutrophils has not discovered anything about neutrophils. Solid tumours are the hard case. They are heterogeneous in composition and in mechanical properties, often fibrotic, frequently necrotic, and the necrotic regions contribute large quantities of free RNA and dying cells. Digestion long enough to release cells from the stroma is long enough to damage the lymphocytes. Malignant cells are frequently larger and more fragile than the immune cells around them, so aggressive protocols return an immune-dominated dataset from a tumour that was mostly malignant tissue — a discrepancy large enough that studies comparing single-cell composition against histology on the same tumour routinely find twofold or greater distortions. Dissociation protocol is therefore a first-order determinant of what a tumour single-cell paper concludes. Adult brain resists whole-cell dissociation almost completely. Neurons have extensive processes that are severed during dissociation, and the resulting cells either die or survive as damaged somata missing much of their cytoplasm. Whole-cell protocols on adult mouse or human brain return datasets heavily skewed towards microglia and other small, robust cells. This is the tissue that drove the adoption of single-nucleus sequencing, and for adult neural tissue the nuclear route is now standard rather than a fallback. Lung illustrates a subtler failure. It dissociates reasonably well, but the alveolar type I cells — enormous, thin, and structurally integral to the alveolus — are almost entirely destroyed, while alveolar type II cells survive. A naive reading of the resulting data would conclude that type I cells are rare in lung, when in fact they cover most of the alveolar surface. The general lesson is that structural cells with extreme morphology are systematically under-recovered, and their apparent rarity in single-cell atlases is an artefact of the assay. Time is the variable you control Almost everything that goes wrong between tissue and chip gets worse with time. Stress transcripts accumulate. Viability declines. Free RNA builds up in the buffer. Cells aggregate. None of these is reversible. Most of the elapsed time in a typical workflow is not digestion; it is the intervals around it — transport from the operating theatre, waiting for a sorter, counting cells, a second wash, a delay before the instrument is free. Each interval is negotiable in a way the digestion is not, and compressing them is the cheapest available quality improvement. Practical discipline follows from this. Have every reagent prepared and every instrument booked before the tissue arrives. Keep the suspension on ice from the end of digestion onward. Do the viability count once, quickly, rather than repeating it. If sorting is required, sort into cold medium with protein carrier and load immediately afterwards. Where a study spans many samples, standardise the timings and record them, so that a sample processed in ninety minutes can be distinguished from one processed in four hours when the data are analysed. Consistency matters as much as speed. A study in which every sample took two hours is more analysable than one in which samples took between forty minutes and five hours, even though the second contains some faster preparations. Variable handling time introduces a continuous technical covariate that will show up in the embedding, and unless it was recorded, it will be mistaken for biology. Clumps, filters, and the doublet you make at the bench The last bench-level hazard is aggregation. Cells released from tissue carry sticky surface proteins and free DNA from lysed cells, and both promote clumping. A clump that enters a droplet produces a barcode containing several cells' RNA — a doublet, or worse, generated before the microfluidics ever sees the sample. Filtering through a 30 or 40 micrometre strainer immediately before loading is the standard defence and should be treated as mandatory rather than optional. Adding a DNase step during or after digestion reduces the free DNA that glues cells together and is usually worth the extra few minutes. Resuspending gently, with wide-bore tips, avoids shearing that creates debris. The reason to take this seriously is that bench-generated multiplets are not fully removable afterwards. Computational doublet detection works by recognising profiles that look like mixtures of two distinct cell types, and it performs adequately on droplet-level doublets of dissimilar cells. A clump of three cells of the same type is invisible to it, appearing simply as a large, well-captured cell of that type — and it will sit at the edge of its cluster looking like a distinct, high-expressing state. What to report Because dissociation determines so much, the methods section of a single-cell paper should contain enough detail for a reader to judge the biases. That means the specific enzyme and supplier, the concentration, the temperature, the total digestion time, the mechanical steps, the filtration mesh size, whether transcription inhibitors were used, the measured viability, the cell concentration at loading, and the elapsed time from tissue collection to capture. Most published methods sections contain a fraction of this, which is one reason cell type proportions differ so widely between studies of the same tissue. A reader who cannot reconstruct the protocol cannot distinguish a biological difference between cohorts from a difference in how the tissue was handled, and in practice the second explanation is more often correct. The same information should be recorded per sample, not just per study. Within a multi-sample project, the variation between samples in viability and handling time is usually larger than anything reported in the methods, and having those numbers as columns in the sample metadata turns an unexplained batch effect into a diagnosable one. Hashtags: #SingleCellRNASequencing #SingleCellTranscriptomics #DropletBasedSequencing #UniqueMolecularIdentifiers #UMICounting #CountMatrix #ExperimentalDesign #BiologicalReplication #SampleMultiplexing #GeneticDemultiplexing #CellHashing #TissueDissociation #SingleNucleusRNASeq #AmbientRNA #DoubletDetection #QualityControl #Normalization #HighlyVariableGenes #DimensionalityReduction #GraphBasedClustering #CellTypeAnnotation #PseudobulkAnalysis #DifferentialExpression #TrajectoryInference #FutureOfSingleCellTranscriptomics

Download the Book (PDF): Introduction A pathologist looking at a stained section of a breast tumour sees a great deal. She sees whether the malignant cells form glands or sheets, whether they have crossed a basement membrane, how pleomorphic their nuclei are, whether lymphocytes crowd the stroma or stay politely at the margin. She sees all of this in two colours, haematoxylin and eosin, and she integrates it with decades of training into a grade and a diagnosis. What she cannot see is which of the lymphocytes are cytotoxic T cells, which are regulatory T cells, which of those are exhausted, which macrophages express PD-L1, which tumour cells have lost HLA class I, and whether the cytotoxic cells are actually touching the tumour cells or are held at arm's length by a ring of fibroblasts. Those are the questions that now decide whether a patient receives an immune checkpoint inhibitor, and whether it works. The methods described in this book were built to answer that second set of questions without losing the first. Imaging mass cytometry (IMC) and multiplexed ion beam imaging (MIBI) stain a single tissue section with forty or more antibodies at once, each carrying a different heavy metal isotope rather than a fluorophore or an enzyme. A laser or a beam of ions then removes the tissue point by point, and a mass spectrometer counts the metal atoms that come off each point. The result is a stack of images, one per antibody, perfectly registered to one another because they were read from the same physical spot at the same moment. From that stack an analyst can outline every cell, record how much of each protein it holds, assign it an identity, and then ask how the identities are arranged in space. Both methods appeared in print in the spring of 2014. Charlotte Giesen, Bernd Bodenmiller and colleagues in Zurich, working with the Canadian team that had built the CyTOF mass cytometer, coupled a laser ablation system to that instrument and published IMC in Nature Methods. Michael Angelo, Sean Bendall, Garry Nolan and colleagues at Stanford adapted a secondary ion mass spectrometer and published MIBI in Nature Medicine the same month. Twelve years on, both have become commercial platforms, both have produced landmark atlases of cancer, infection and pregnancy, and both have forced the field to confront the fact that the hard part of spatial proteomics is rarely the instrument. The hard parts are choosing the forty antibodies, proving that each one binds what it claims to bind in fixed tissue, separating real signal from the noise and crosstalk inherent to mass spectrometry, drawing boundaries around cells that are packed tightly and cut at arbitrary angles, and building statistical models of spatial organisation that do not simply rediscover tissue anatomy. The controlling idea This book argues one thing: a multiplexed image is a measurement chain, and its conclusions are only as strong as its weakest link. Every step, from the chelating polymer on the antibody to the permutation test on the neighbourhood graph, carries assumptions that propagate forward. A mislabelled isotope channel becomes a phantom cell type. A segmentation mask that spills membrane signal from one cell into its neighbour manufactures double-positive cells that do not exist, and those cells then appear as a "novel interaction" in the spatial analysis. A study of thirty patients with two small regions each becomes, after cell counting, a data set of a million cells, and its p-values come out astronomically small because the analyst forgot that the patient, not the cell, is the unit of replication. The technology is extraordinary. The errors it permits are ordinary, and they compound. Reading the methods this way changes what a practitioner pays attention to. It moves the emphasis away from the headline number of markers and towards the quality of each one. It makes the choice of regions of interest a question of study design rather than a convenience. It treats segmentation as a measurement with an error rate, not a preprocessing chore. It insists that spatial statistics be compared against the right null model. And it clarifies where IMC and MIBI earn their place relative to cheaper cyclic fluorescence methods and to the spatial transcriptomics platforms that have surged since 2020. What the book covers The chapters follow the chain in order. Chapter 1 sets out the problem that mass-tag imaging solves, why fluorescence runs out of colours, and how suspension mass cytometry made the leap to tissue possible. Chapter 2 explains the physics of the two instruments: laser ablation feeding an inductively coupled plasma in IMC, and a primary ion beam sputtering secondary ions from the surface in MIBI. It compares their resolution, speed, sensitivity and sample requirements. Chapter 3 covers antibody metal-tagging: the lanthanide chemistry, the polymer chelators, the isotopes outside the lanthanide series, and the logic of assigning antibodies to channels. Chapter 4 moves to the bench and the instrument: fixation, antigen retrieval, staining, slide substrates, acquisition parameters, and the design of regions of interest. Chapter 5 deals with what happens to the raw ion counts: spillover compensation, hot pixels, shot noise, background, denoising, and batch correction. Chapter 6 is about segmentation, the step that turns pixels into cells, and the ways it fails. Chapter 7 covers phenotyping, the assignment of identities to segmented cells by clustering, gating, or pixel-level approaches. Chapter 8 is about spatial modelling: neighbourhood enrichment, cellular neighbourhoods, point-pattern statistics and the null models against which all of them must be judged. Chapter 9 turns to study design and to what the major published studies have actually shown, with an eye to what they can and cannot support. The Conclusion draws out what follows for anyone planning, reviewing or funding this kind of work. Who this is for, and what it assumes The intended reader knows what an antibody is, has seen a stained tissue section, and is comfortable with the idea of clustering data. That reader might be a pathologist asked to collaborate on a spatial study, a graduate student about to run a first panel, a computational biologist handed a folder of multichannel TIFF files, a core facility manager deciding between instruments, or a reviewer trying to judge whether a manuscript's interaction claims are real. No prior knowledge of mass spectrometry is assumed; Chapter 2 builds what is needed from first principles. Two scope decisions deserve mention. First, the book treats IMC and MIBI together because they share nearly everything downstream of the detector: the reagents, the image-processing problems and the analytical frameworks. Where they differ, mainly in the physics of sampling and in practical throughput, the differences are made explicit. Other highly multiplexed protein imaging methods, notably cyclic immunofluorescence, CODEX (now PhenoCycler) and the commercial Orion and COMET systems, appear where they illuminate a point or offer an alternative, but they are not described in operational detail. Second, the book does not reproduce vendor protocols. Instrument software and reagents change every few years, and the reader who needs the exact current protocol should get it from the manufacturer and from the published community protocols cited in the Notes. What does not change quickly is the reasoning behind each step, and that is what the chapters aim to give. A final point on tone. Spatial proteomics has had its share of enthusiasm, and some of that enthusiasm has outrun the evidence, particularly in claims about cell–cell interactions inferred from static snapshots. The book is written from the position of someone who thinks these methods are among the most useful tools tissue biology has acquired in a generation, and who for that reason wants them used carefully. The measured sceptic and the committed user want the same thing: images whose conclusions survive replication. Chapter 1. Why Count Proteins in Place Every tissue is a society of cells whose behaviour depends on who their neighbours are. A CD8-positive T cell in the lymph node paracortex is waiting to be activated; the same cell type in the stroma of a colorectal carcinoma, sitting ten micrometres from a macrophage that expresses PD-L1 and IDO1, may be exhausted and functionally inert. A beta cell in a pancreatic islet under attack in early type 1 diabetes is defined as much by the infiltrating lymphocytes at its periphery as by its insulin content. Dissociating these tissues into single-cell suspensions, as flow cytometry and single-cell RNA sequencing require, destroys precisely the information that distinguishes these states. The purpose of spatial proteomics is to keep that information while measuring enough proteins per cell to say with confidence what each cell is and what it is doing. Dissociation does more than erase position; it also distorts composition. Enzymatic digestion releases lymphocytes easily and fibroblasts, neurons, adipocytes, hepatocytes and many epithelial cells poorly. Neutrophils are fragile and often die before they reach the instrument. Surface epitopes can be cleaved by the enzymes used, so a marker measured on dissociated cells may under-report what was on the cell in situ. Anyone who has compared cell-type proportions from single-cell RNA sequencing of a tumour with a pathologist's estimate from the same tumour has seen the result: immune cells over-represented, stromal cells under-represented, and large tumour cells sometimes missing altogether. Measuring in place does not remove every bias, because sectioning and segmentation introduce their own, but it removes the largest one. There is also a practical argument. The world's pathology archives hold hundreds of millions of formalin-fixed, paraffin-embedded (FFPE) tissue blocks, many linked to clinical outcomes over decades. Fresh tissue for dissociation must be collected prospectively and processed within hours. A method that reads deep protein phenotypes from archival FFPE sections opens retrospective cohorts that would take a decade to assemble prospectively. Both IMC and MIBI work on FFPE material, and most of the major studies described in this book were built on archival blocks, often arranged as tissue microarrays. The colour ceiling Conventional immunohistochemistry detects one antigen per section with an enzyme, usually horseradish peroxidase, that deposits a brown chromogen. It is cheap, robust and the backbone of diagnostic pathology. Chromogenic duplex and triplex stains exist, but distinguishing more than three chromogens by eye or by colour deconvolution becomes unreliable, particularly where signals overlap in the same compartment. Immunofluorescence raises the ceiling but not by much. Fluorophores have broad emission spectra, typically 30 to 50 nanometres wide at half maximum, and the useful window of visible and near-infrared light, from about 400 to 800 nanometres, fits perhaps five to seven well-separated channels on a standard microscope. Spectral unmixing, as implemented in multispectral systems such as the Akoya Vectra and PhenoImager platforms using tyramide signal amplification (the Opal chemistry), pushes the practical number to six to nine markers plus a nuclear counterstain. That is enough for many clinical questions, such as scoring PD-L1 on tumour and immune cells together or quantifying CD8 density in tumour and stroma, and these panels have been validated across laboratories for exactly that reason. Tissue autofluorescence, strongest in formalin-fixed material and in tissues rich in collagen, elastin, red cells and lipofuscin, adds a background that competes with weak signals. The most widely adopted way through the ceiling is to cycle: stain with a few fluorescent antibodies, image, remove or inactivate the fluorophores, and repeat. Cyclic immunofluorescence (CyCIF), developed by Peter Sorger's group, bleaches fluorophores chemically between rounds. CODEX, from Garry Nolan's laboratory and now sold by Akoya as PhenoCycler, stains once with antibodies carrying DNA barcodes and then reads them in cycles by hybridising and stripping fluorescent complementary oligonucleotides. Methods such as these routinely reach forty to sixty markers, and some studies have exceeded a hundred. Their weaknesses are cumulative: each cycle takes time, tissue can detach or deform, image registration between cycles must be near perfect, and bleaching or stripping is never quite complete. They also inherit fluorescence's autofluorescence problem. Mass instead of light The alternative is to change the reporter so completely that the physics of detection no longer limits multiplexing. If each antibody carries a different stable isotope of a heavy metal, and if a mass spectrometer can resolve those isotopes by mass, then the number of channels depends on how many usable isotopes exist and how cleanly the instrument separates them. Mass peaks from a time-of-flight analyser are far narrower relative to their spacing than fluorescence emission spectra are; neighbouring isotopes one atomic mass unit apart can be separated with only a small fraction of a percent of crosstalk. And biological tissue contains almost none of the heavy metals used as tags, so there is essentially no equivalent of autofluorescence. A channel that reads zero in unstained tissue reads zero. This idea was proven first in suspension. Scott Tanner, Vladimir Baranov, Dmitry Bandura, Olga Ornatsky and colleagues at the University of Toronto developed the mass cytometer, which nebulises single cells stained with metal-tagged antibodies into an inductively coupled argon plasma at roughly 7,000 kelvin. The plasma atomises and ionises each cell completely, and a time-of-flight mass spectrometer counts the metal ions from each cell's ion cloud. Bandura and colleagues described the instrument in Analytical Chemistry in 2009. Commercialised by DVS Sciences as CyTOF, later acquired by Fluidigm (renamed Standard BioTools in 2022), the mass cytometer allowed Sean Bendall, Garry Nolan and colleagues to publish in 2011 a single-cell atlas of human bone marrow built from more than thirty simultaneous measurements per cell, including intracellular signalling states. Suspension mass cytometry became the method of choice for deep immune phenotyping of blood. The tissue problem was that CyTOF destroys each cell as it measures it and has no knowledge of where the cell came from. Two solutions arrived together. The Zurich group, led by Bernd Bodenmiller with Charlotte Giesen and Detlef Günther's laser ablation expertise at ETH, built a laser ablation cell that vaporised stained tissue one micrometre spot at a time and carried each plume of ablated material on a gas stream into a CyTOF. Each laser shot became one pixel. The Stanford group, led by Michael Angelo and Sean Bendall in Garry Nolan's laboratory, took a different route: they used a focused beam of primary ions to sputter the surface of a stained section in a secondary ion mass spectrometer, a type of instrument long used in materials science and geology, and read the metal ions that came off. Both reported breast cancer tissue stained with panels of a few dozen antibodies, and both showed images in which distinct cell populations and their arrangement could be recognised. The two papers appeared within days of each other in April 2014. What multiplexing buys It is worth being precise about what forty markers achieve that eight do not, because the cost difference is large and the value is not automatic. The first gain is identity. Many cell types can only be defined by combinations. A regulatory T cell is CD3-positive, CD4-positive and FOXP3-positive, and ideally CD25-high and CD127-low. A tissue-resident memory CD8 T cell expresses CD103 and CD69. Distinguishing classical monocytes, monocyte-derived macrophages, tissue-resident macrophages and dendritic cell subsets requires CD14, CD16, CD68, CD163, CD206, CD11c, HLA-DR and often more. Fibroblasts have become a zoo of subtypes defined by combinations of alpha-smooth muscle actin, fibroblast activation protein, PDGFR-beta, podoplanin and CD34. An eight-marker panel forces a choice between immune depth and stromal depth; a forty-marker panel can cover both, plus tumour cell states. The second gain is state. Once identity markers are in place, remaining channels can report functional state: proliferation (Ki-67), checkpoint molecules (PD-1, PD-L1, LAG-3, TIM-3, IDO1), activation (granzyme B, CD45RO), antigen presentation (HLA class I, HLA-DR), hypoxia (carbonic anhydrase IX, GLUT1), signalling (phosphorylated proteins, where antibodies work in fixed tissue), and lineage plasticity. The joint distribution of identity and state across space is what the most informative studies have analysed. The third gain is context from a single section. Serial sections stained with different panels cannot be aligned at single-cell resolution, because a four-micrometre section contains only part of each cell and adjacent sections contain different parts. Multiplexing on one section means every marker is read on the same physical cells. This matters most when material is scarce, as with core needle biopsies, and when the question is about rare cells that would be lost between sections. What multiplexing does not buy, on its own, is sensitivity or throughput. A mass-tag channel is not intrinsically more sensitive than a tyramide-amplified fluorescent channel; for low-abundance targets it is often less sensitive, because there is no enzymatic amplification. And the time to acquire a square millimetre is much longer for IMC and MIBI than for a whole-slide fluorescence scanner. The rational use of these methods starts from that trade. A worked case: when eight markers stop being enough Consider a concrete question that has driven much of the field: why do some patients with triple-negative breast cancer have abundant tumour-infiltrating lymphocytes and still fail to benefit from them? Stromal lymphocyte density, scored on an ordinary H&E slide, is prognostic in this disease, and a pathologist can estimate it in a few minutes. But the score treats every lymphocyte as equivalent and says nothing about where the lymphocytes are relative to tumour cells. A first refinement uses a six-plex fluorescence panel: CD8, CD4, FOXP3, PD-L1, pan-cytokeratin and a nuclear stain. That panel can distinguish cytotoxic from helper and regulatory T cells, and can separate intratumoural from stromal locations using the cytokeratin boundary. It is a good clinical panel. Now suppose the analysis reveals two groups of tumours with similar CD8 densities, one where CD8 cells sit among tumour cells and one where they are confined to stroma. The obvious next question is what separates them. Are the excluded tumours surrounded by a particular fibroblast population? Are the tumour cells in the excluded group presenting antigen, or have they lost HLA class I? Is PD-L1 on tumour cells or on macrophages, and which macrophages? Are B cells forming tertiary lymphoid structures in one group and not the other? Are the T cells proliferating or exhausted? Each of those sub-questions needs two to five more markers. HLA class I and beta-2 microglobulin for antigen presentation; CD68, CD163 and CD11c for macrophage and dendritic subsets; alpha-smooth muscle actin, FAP and collagen or vimentin for stroma; CD20 and CD21 for B cells and follicular dendritic cells; Ki-67, PD-1, LAG-3 and granzyme B for T cell state; CD31 for vessels; and a few tumour markers such as keratins, EGFR and p53 to distinguish tumour cell states. Add these to the original six and the count passes thirty. On a fluorescence system this would require several consecutive sections or several cycles. On IMC or MIBI it is one stain and one acquisition. This is essentially the design of the 2018 MIBI study of triple-negative breast cancer by Leeat Keren, Michael Angelo and colleagues, which imaged forty-one patients with a thirty-six-marker panel and found that tumours fell into a spectrum from "cold" to "mixed" to "compartmentalised" architectures, the last with immune and tumour cells segregated into separate regions. The compartmentalised pattern was associated with better survival, and in those tumours PD-L1 and IDO were expressed on immune cells at the tumour border. Whether that pattern holds in larger cohorts and how it should inform treatment are questions for later chapters. The point here is that the finding could not have been reached with any single low-plex panel chosen in advance, because nobody knew in advance which of the thirty-six markers would matter. That is the core case for multiplexing: it lets a study ask the second and third question in the same experiment as the first, on the same cells, without having to guess which follow-up markers will be needed. The cost is paid in panel development, acquisition time and analytical complexity, and a study that does not need the second and third question should not pay it. Where the methods sit in 2026 The spatial biology landscape has become crowded. On the protein side, cyclic fluorescence platforms (PhenoCycler-Fusion, Lunaphore COMET, Miltenyi MACSima, and open-source CyCIF) image whole slides with thirty to a hundred markers. RareCyte's Orion uses spectral separation to read around twenty markers in a single round on a whole slide. On the RNA side, sequencing-based spatial transcriptomics (10x Genomics Visium and Visium HD, and a range of barcoded-array methods) and imaging-based methods (10x Xenium, Vizgen MERSCOPE, NanoString CosMx, now part of Bruker) measure hundreds to thousands of genes, several with subcellular resolution. Some of these also offer protein panels. In this landscape, IMC and MIBI occupy a defined niche. Their advantages are the absence of autofluorescence, single-round acquisition without cyclic registration, a linear and wide dynamic range of ion counting, straightforward quantitation of metal-containing drugs such as platinum chemotherapy, and, in MIBI's case, resolution down to a few hundred nanometres. Their disadvantages are slower acquisition over large areas, destructive sampling of the section (IMC removes the tissue entirely; MIBI removes a thin layer, which allows some re-imaging), and the need for metal-conjugated antibodies that are not stocked as widely as fluorescent ones. Commercially, Standard BioTools sells the Hyperion family for IMC, with the Hyperion XTi introduced in 2023 to speed acquisition, and Ionpath sells the MIBIscope. A growing number of core facilities hold one or the other. One more comparison matters for study design. Protein and RNA are not interchangeable. mRNA levels correlate only loosely with protein levels for many genes, and some of the most important biology, such as surface checkpoint ligands, phosphorylation states and secreted proteins held in extracellular matrix, is visible only at the protein level. Conversely, transcriptomic platforms can discover cell states nobody thought to look for, while a protein panel sees only what it was designed to see. Many recent studies combine the two: a transcriptomic atlas to discover states and a protein panel to validate and quantify them at scale across patient cohorts. What a spatial proteomics study actually produces It helps to fix in mind what the end product of an IMC or MIBI experiment is, because every later chapter works towards it. At the level of raw data, the output is a set of images, one per metal channel, each pixel holding a count of ions detected. An IMC acquisition at one micrometre per pixel over a region of one square millimetre produces a million pixels per channel; forty channels make forty million numbers. MIBI acquisitions at finer resolution produce proportionally more pixels per area. These images are typically stored in vendor formats (the MCD format for Hyperion, and multipage TIFF or vendor-specific formats for MIBI) and converted to open formats such as OME-TIFF for analysis. At the level of processed data, the output is a single-cell table: one row per segmented cell, with columns for the cell's position, its area and shape, the mean intensity of each marker within its mask, and a phenotype label. A typical cohort study might produce between several hundred thousand and a few million rows. Alongside it sits a set of masks recording which pixels belong to which cell, and often a set of tissue-compartment masks (tumour, stroma, necrosis, vessel). At the level of results, the output is usually some combination of cell-type densities and proportions per patient or per region; the distribution of functional states within cell types; measures of spatial organisation, such as which cell types sit next to which more often than chance, what recurring multicellular neighbourhoods exist, and how far particular cells are from tumour borders or vessels; and associations between all of these and clinical variables such as survival, treatment response or disease stage. Each of these outputs depends on the steps before it. Cell densities depend on segmentation. Phenotypes depend on marker quality and on normalisation. Spatial statistics depend on phenotypes and on the null model. Clinical associations depend on sampling. The rest of this book follows that chain, one link at a time, starting with the machines that turn stained tissue into ion counts. Chapter 2. The Physics of Reading Metals Both IMC and MIBI end the same way: a time-of-flight mass spectrometer counts metal ions and assigns them to a pixel. They begin very differently. IMC blasts the tissue apart with a laser and turns everything it removes into a plasma. MIBI shaves atoms from the surface with a beam of ions and collects the charged fragments that fly off. These differences determine resolution, speed, which masses can be read, whether the section survives, and what kinds of artefact the analyst will later have to recognise. A practitioner does not need to be able to service either instrument, but she does need to know where each kind of signal and noise comes from. Imaging mass cytometry: ablation, plasma, flight An IMC instrument has three stages joined by a gas line. The first is a laser ablation system. The Hyperion instruments use a pulsed ultraviolet laser at 213 nanometres, the fifth harmonic of a neodymium-YAG laser, focused to a spot about one micrometre across. The stained, dried section sits on an ordinary glass slide inside a small sealed ablation chamber flushed with helium. Each laser pulse vaporises the tissue under the spot down to the glass, producing a tiny plume of particles and vapour. The stage then moves one micrometre, and the laser fires again. A raster of pulses therefore removes the whole region, line by line, and each pulse becomes one pixel of the final image. The second stage is transport and ionisation. The helium stream carries each plume into a flow of argon and on into an inductively coupled plasma, a torch of argon held at several thousand kelvin by a radiofrequency field. In the plasma, the particles are vaporised, all molecules are broken into atoms, and most atoms are ionised to singly charged cations. This is the same ionisation source used for trace-element analysis in environmental chemistry, and its great virtue is that it is almost indifferent to chemical form. A lanthanide atom arrives at the detector as the same ion whether it was bound to an antibody on a membrane or in the nucleus, and the number of ions detected is proportional to the number of atoms ablated. That proportionality is the basis of IMC's linear quantitation. The third stage is mass analysis. Ions pass through a series of apertures and ion optics that strip away the overwhelming argon ions and lighter elements, and are pushed into a flight tube. In a time-of-flight analyser, all ions receive the same kinetic energy, so lighter ions travel faster; the time taken to reach the detector reveals the mass. The CyTOF-derived analyser reads a mass window of roughly 75 to 209 atomic mass units, which covers the lanthanides, several transition and post-transition metals, and the isotopes of iridium and platinum. It pushes a new packet of ions into the flight tube tens of thousands of times per second, and the pulses belonging to one laser shot are summed into one pixel value. Two engineering details matter for image quality. The first is washout. The plume from one pulse spreads as it travels through the gas line; if the next pulse arrives before the previous plume has fully cleared, signal from one pixel bleeds into the next along the scan direction, producing a directional smear. The ablation cells developed after 2014, including low-dispersion designs from the Günther group at ETH Zurich, shortened washout to a few milliseconds and made it possible to fire the laser at hundreds of pulses per second without pixel mixing. The original Hyperion operated at up to 200 pixels per second; at that rate a square millimetre of tissue at one-micrometre pixels, one million pixels, takes about 5,000 seconds, a little under an hour and a half, plus overhead. The Hyperion XTi, released by Standard BioTools in 2023, was engineered for considerably faster acquisition, and the vendor positions it for larger areas and whole-slide preview; the exact throughput depends on settings and should be checked against the current specification rather than taken from marketing summaries. The second detail is ablation completeness. IMC assumes each pulse removes the full thickness of tissue under the spot. Laser energy is tuned per sample type so that tissue is removed completely without excessive energy that would scatter material widely. Incomplete ablation leaves residue that contributes signal to later pixels; over-energetic ablation throws debris. Both show up as noise and as small positional errors, and both are visible to an experienced operator in the first few lines of an acquisition. IMC's nominal resolution is therefore about one micrometre, set by spot size and step size. In practice the effective resolution is a little coarser, because a four-micrometre section is ablated in a single pulse and the signal integrates over the full depth. A membrane running obliquely through the section appears as a band rather than a line. This depth integration also means IMC collects essentially all of the metal in the section, which helps sensitivity, but removes the section completely: after IMC, the ablated region is gone. Unablated parts of the slide can still be used. Multiplexed ion beam imaging: sputtering and secondary ions MIBI grows out of secondary ion mass spectrometry (SIMS), a surface-analysis technique used for decades in semiconductor and geochemical work. A focused beam of primary ions strikes the sample surface. Each impact transfers momentum into the top few nanometres of material, which ejects atoms and molecular fragments, a process called sputtering. A small fraction of the sputtered particles leave as ions, the secondary ions, and these are extracted by an electric field into a mass analyser. Rastering the primary beam across the sample produces an image. The 2014 proof of principle used a commercial NanoSIMS instrument, which reads a handful of masses in parallel with separate detectors. The dedicated MIBI-TOF instrument described by Keren and colleagues in Science Advances in 2019 replaced that with an orthogonal time-of-flight analyser, reading the whole mass range at each pixel, and used an oxygen primary ion source, a duoplasmatron, because oxygen at the surface increases the yield of positive metal ions. The instrument could be operated across a range of resolutions, with the finest reported around 260 nanometres, several times finer than IMC. Ionpath commercialised the design as the MIBIscope, and later development has focused on brighter primary ion sources and faster acquisition. Several practical consequences follow from the physics. First, the sample must be conductive, or charge builds up under the beam and deflects it. MIBI sections are therefore mounted on slides coated with a thin layer of gold (sometimes over tantalum as an adhesion layer), which also provides a convenient signal: gold-197 ions from bare slide areas mark where there is no tissue. Second, the beam removes only a thin surface layer per pass. The stained tissue is therefore sampled at the surface, and the same field can in principle be imaged again, either to accumulate more counts or to acquire the next depth. This is a real advantage over IMC for precious material, although repeated imaging eventually consumes the section. Third, secondary ion yields vary with the chemical environment of the surface, an effect called the matrix effect. In practice, because the reporter metals are sparse and similar in environment across the section, this is less troublesome than in materials SIMS, but it is one reason MIBI quantitation is best treated as relative rather than absolute. Resolution and speed trade against each other directly. The primary beam current can be raised to collect ions faster, but a higher current means a larger spot. Typical cohort studies acquire fields of 400 to 800 micrometres square at a pixel size of several hundred nanometres; the 2018 triple-negative breast cancer study, for example, imaged fields of 800 micrometres square at 2048 by 2048 pixels, roughly 390 nanometres per pixel. Operators choose among preset modes that balance spot size, current and dwell time per pixel, from coarse fast modes for survey imaging to fine slow modes for subcellular detail. A single high-resolution field can take from tens of minutes to a few hours depending on mode. How the two compare The two instruments are more alike than different from the analyst's point of view. Both produce one image per mass channel, both are essentially free of biological background in the lanthanide range, both read the same reagent chemistry, and both share the spillover sources described in Chapter 5. The differences are summarised in Table 1, drawn from the original instrument papers and the published descriptions of current commercial systems. Table 1. Imaging mass cytometry and MIBI compared on the parameters that shape study design. Parameter Imaging mass cytometry MIBI Sampling method UV laser ablation (213 nm) into argon plasma Primary ion beam sputtering, secondary ions Typical pixel size About 1 µm (Giesen 2014; Hyperion) About 0.26–1 µm, selectable (Keren 2019) Section fate Ablated region fully removed Surface layer removed; re-imaging possible Slide substrate Standard glass slides Gold-coated conductive slides Typical area per run Several mm² per day at 1 µm Fields of 0.4–0.8 mm², area scales with mode Mass range read About 75–209 amu (CyTOF analyser) Wide range, including light elements Two items in Table 1 need comment. The mass range difference matters more than it might seem. Because MIBI's analyser reads light masses as well as heavy ones, it records endogenous elements such as sodium, phosphorus and iron alongside the tags. Phosphorus and sodium are useful for outlining nuclei and tissue without any stain. Iron picks out red cells and haemosiderin-laden macrophages. IMC's window starts around mass 75, so it misses these but also avoids their spillover. Second, area per day is the figure that shapes study design. At one micrometre pixels, IMC covers a few square millimetres per day of continuous running. That is enough for a tissue microarray of a hundred one-millimetre cores in a couple of days, but not for whole sections of large resections. MIBI at its finest settings covers less area but resolves structures, such as immune synapses, subcellular granules and individual collagen fibres, that IMC cannot. At coarser MIBI settings the areas are closer. An order-of-magnitude budget It helps to run the numbers once, even roughly, because they explain why some markers look crisp and others look like static. Suppose a lymphocyte carries tens of thousands of copies of a surface antigen such as CD45. A four-micrometre section through a seven-micrometre lymphocyte contains only part of the cell, so perhaps a third to a half of those copies are present. Suppose the staining binds antibody to a fraction of the accessible epitopes, and each antibody carries a polymer bearing on the order of a hundred lanthanide atoms. That puts somewhere around a million metal atoms in the cell's footprint. Of those atoms, only a small fraction survive transport, ionisation, ion optics and detection; for the CyTOF-derived analyser the overall efficiency has been estimated at well under one percent. The result is a few hundred to a few thousand counts spread across the thirty to fifty pixels of the cell's cross-section, which is plenty to see. Now repeat the budget for a transcription factor expressed at a few thousand copies per nucleus, with an antibody that binds less avidly in fixed tissue. Each step removes another order of magnitude, and the result is a handful of counts per nucleus, some pixels zero, and a cell that is positive only when its pixels are summed. None of these figures should be taken as precise; epitope copy numbers, labelling degree and transmission all vary widely. The point of the exercise is that signal strength is multiplicative across antigen abundance, antibody performance, metal load and instrument efficiency, and that a weak channel can be rescued at any of those steps: a better clone, a more concentrated antibody, a brighter isotope, or longer dwell time. Tuning and daily performance Because the chain is multiplicative, instrument sensitivity drifts matter. Both platforms are tuned before acquisition against standards of known composition. For IMC, operators ablate a tuning slide coated with a uniform layer containing several elements across the mass range and adjust gas flows, torch position and detector voltage to maximise signal and minimise oxide formation; the software records the result. For MIBI, operators check beam current, focus and mass calibration against reference samples. A study running over weeks should record these tuning values and, ideally, include a control tissue on every slide or every day, such as a small section of tonsil or a cell-line pellet array, so that drift can be detected and corrected later. Chapter 4 returns to this, because it is the cheapest insurance a study can buy. What the physics implies for signal and noise The detector in both instruments counts ions. Counting is subject to Poisson statistics: if the expected count in a pixel is ten, the observed count will vary around ten with a standard deviation of about three, and some pixels will record zero by chance. For abundant markers such as CD45 or cytokeratin, counts per pixel run into the tens or hundreds, and images look smooth. For low-abundance markers such as FOXP3, PD-1 or phosphorylated signalling proteins, counts are often in the single digits and the raw image looks speckled, with many empty pixels even inside positive cells. This shot noise is not a defect of the instrument; it is a direct consequence of counting a small number of atoms. It can be reduced by summing over larger areas, which segmentation does naturally by averaging over all pixels in a cell, or by collecting more ions per pixel, which costs time. The other characteristic noise sources are also physical. In IMC, occasional very bright single pixels, called hot pixels, arise from debris or from particles that carry many metal atoms at once, such as antibody aggregates. In both instruments, a metal isotope contributes a small signal to neighbouring mass channels (abundance sensitivity), impure isotopes contribute to channels of the contaminating isotope, and metal ions can combine with oxygen in the plasma or at the surface to form oxide ions sixteen mass units heavier. Chapter 5 deals with each of these. Here it is enough to know that they are properties of mass spectrometry, predictable in size and direction, and correctable when measured. The final implication is about dynamic range. Ion counting is linear over several orders of magnitude, with no saturation until the detector itself begins to saturate at very high count rates. Fluorescence, by contrast, suffers from camera saturation at the top and autofluorescence at the bottom, and tyramide amplification is non-linear by design. Linear counting is part of why mass-tag intensities can be compared across markers and across samples, provided the staining and acquisition were consistent. It does not make them absolute measurements of protein copy number, because antibody affinity, epitope accessibility after fixation, and the number of metal atoms per antibody all vary. Those variables sit upstream of the instrument, in the chemistry of the reagents, which is the subject of the next chapter. Choosing between them For a laboratory or core deciding between the two platforms, the physics translates into a small number of practical questions. How large is the tissue area per sample that the study requires? If it is whole sections or many square millimetres per patient, IMC's area throughput and the XTi's speed are an advantage, and cyclic fluorescence may be a better fit still. Does the question depend on structures below a micrometre, such as the polarisation of molecules at a synapse, the distribution of granules, or thin processes of dendritic cells and neurons? If so, MIBI's resolution matters. Is the tissue limited and irreplaceable? MIBI's partial sampling permits re-imaging. Does the study need endogenous elements, such as iron in liver or brain, or light-element signals for tissue morphology? MIBI reads them. Is the local ecosystem of reagents, trained operators and analysis experience stronger for one platform? That often decides in practice. For most questions in tumour immunology, both platforms have delivered comparable biology, and the quality of the panel and analysis has mattered more than the choice of instrument. The same antibodies, conjugated to the same metals, can be run on either. That shared reagent layer is where the next chapter begins. Chapter 3. Antibody Metal-Tagging and Panel Design An IMC or MIBI experiment is only as good as its antibodies, and it is only as good as each of its antibodies individually. A forty-marker panel with four unreliable channels is not a forty-marker panel; it is a thirty-six-marker panel with four sources of false findings. This chapter covers how antibodies are loaded with metal, which metals are available, how to assign antibodies to channels so that crosstalk falls where it does least harm, and how to validate each reagent. Panel design is the single largest investment of time in most new studies, often several months, and it is the step most often shortchanged. Putting metal on an antibody Antibodies do not bind free metal ions, so the metal must be held by a chelator attached to the antibody. The dominant approach, developed during the creation of suspension mass cytometry and sold commercially as the MaxPar reagent kits, uses a linear polymer bearing many chelating groups along its length. Early versions used DTPA-type chelators; the widely used X8 polymer carries DOTA-type groups, which hold lanthanides more tightly. Each polymer chain binds on the order of a few tens of metal ions, and several chains attach to each antibody, so a single antibody carries around a hundred metal atoms of one isotope. This is the multiplication step that makes mass-tag detection sensitive enough to work. The conjugation is a short sequence of chemistry that most laboratories now perform routinely. • The polymer is loaded with a single purified isotope, typically supplied as the chloride salt, by incubation in a buffered solution, and excess free metal is removed by ultrafiltration. • The antibody is partially reduced with a mild reducing agent, usually TCEP, which breaks disulfide bonds in the hinge region to expose free thiol groups while leaving the antigen-binding domains intact. • The polymer carries a maleimide group at one end, which reacts with the free thiols to form a stable bond. After incubation, unreacted polymer is washed away through a filter that retains the antibody. • The conjugate is quantified by absorbance at 280 nanometres and diluted into a stabilising buffer for storage at four degrees Celsius. A typical reaction starts with 100 micrograms of antibody and recovers perhaps 60 to 80 percent of it, enough for many slides at typical staining concentrations. The whole process takes about four hours of hands-on work spread over a day. The chemistry imposes one hard requirement: the antibody must be supplied without carrier proteins. Bovine serum albumin or gelatin added by many vendors as a stabiliser also contain cysteines and lysines, will absorb polymer, and will produce a conjugate in which much of the metal sits on albumin rather than antibody. Sodium azide is tolerated at low concentrations. Glycerol can interfere with filtration. Many suppliers now sell "carrier-free" or "BSA-free" formats for exactly this purpose, and some sell antibodies pre-conjugated to specific metals, which saves time but constrains the channel assignment. Conjugation is not neutral. Partial reduction and polymer attachment can reduce the affinity of some clones, and occasionally destroy it. A clone that works beautifully by chromogenic IHC may perform poorly after conjugation. There is no reliable way to predict this in advance; each conjugate must be tested in tissue. The metals available The core of the palette is the lanthanide series, from lanthanum-139 to lutetium-175 and -176. Lanthanides are chemically almost interchangeable, so the same polymer binds all of them with similar affinity, and many have several stable isotopes that can be purchased enriched to purities above 95 percent. They are rare in biological tissue and absent from standard reagents. Together they provide roughly thirty to thirty-five usable mass channels. Beyond the lanthanides, the palette has been extended in several directions. Cadmium isotopes (masses 106 to 116) can be loaded onto a modified polymer and add up to eight channels, at somewhat lower sensitivity in the IMC analyser. Indium-113 and -115, yttrium-89, bismuth-209 and palladium isotopes have been used. Platinum isotopes can be attached through cisplatin-based chemistry. Silver and gold nanoparticles have been tested but carry many atoms per particle, which gives brightness at the cost of quantitation. For IMC, iridium-191 and -193 bound to an intercalating DNA dye serve as the standard nuclear counterstain; for both platforms, antibodies against double-stranded DNA or histone H3 are also used. Ruthenium-containing counterstains label general tissue morphology across masses 96 to 104, producing something akin to an eosin image that helps segmentation and orientation. Channel sensitivity is not uniform. In the CyTOF-derived analyser, ion transmission is lower at the light end of the range and rises towards the middle and heavy lanthanides, so masses from about 153 to 176 are the most sensitive and the lightest lanthanides and cadmium are the least. The MIBI analyser has its own sensitivity profile. These differences are large enough, often a factor of two or more between the dimmest and brightest channels, that channel assignment should compensate for them. Assigning antibodies to channels Panel design is a constraint problem. Each antibody needs a metal. Each metal has a sensitivity, a set of neighbours into which it spills, and possible oxide products. Each antibody has an expected brightness, determined by antigen abundance and antibody performance, and each has a pattern of co-expression with other markers. The goal is to maximise the signal of weak markers while ensuring that spillover from bright markers never lands on a weak marker in the same cells. Several rules follow, and they are summarised in Table 2. Table 2. Principles for assigning antibodies to metal channels. Rule Reason Typical application Put weak markers on sensitive channels Maximises counts where they are scarce FOXP3, PD-1, transcription factors on 158–176 Put bright markers on less sensitive channels They tolerate lower transmission Cytokeratin, vimentin, CD45 on light lanthanides Avoid bright neighbours for weak co-expressed markers Limits M±1 spillover Keep CD3 away from masses adjacent to FOXP3 Check M+16 oxide positions Oxides add signal 16 amu higher Avoid bright marker at M−16 of a weak one Separate markers from their isotopic impurities Impure isotopes leak into other channels Consult supplier purity certificates The co-expression point deserves emphasis. Spillover only produces false positives in cells where the source marker is expressed. A bright stromal marker spilling into a channel used for an epithelial marker matters little if the two are never in the same cells, because the spillover appears only in stroma, where the analyst does not expect the epithelial marker. A bright T cell marker spilling into the channel for a transcription factor expressed in T cells, however, will create apparent low-level expression in every T cell. Channel assignment should therefore be done with a co-expression matrix in hand: for each pair of markers, how likely are they to appear in the same cell? Several software tools help. The mass cytometry community has developed panel-design utilities, including spreadsheets and web tools supplied by vendors and academic groups, that take a list of antibodies with estimated brightness and suggest assignments that minimise predicted spillover. In practice, most experienced designers work iteratively: draft an assignment by hand using the rules, check it against a spillover matrix measured on their own instrument, and revise. Validating each antibody Validation is where most panel time goes, and where corners are most often cut. A metal-tagged antibody must be shown to bind its intended target, in fixed tissue of the kind being studied, at a concentration that separates positive from negative cells, without being disturbed by the other antibodies in the panel. The standard approach has four parts. First, choose clones with a track record in FFPE immunohistochemistry. Clones used in diagnostic pathology, and those validated in published IMC or MIBI studies, have a head start. Clones validated only for flow cytometry or western blotting often fail on fixed tissue, because formalin cross-linking alters or masks the epitope. Second, stain control tissues where the expected pattern is known. Tonsil is the workhorse: it contains T cell zones, B cell follicles with germinal centres, crypt epithelium, macrophages, plasma cells, endothelium and stroma, and nearly every immune marker has a textbook distribution there. Placenta, spleen, lymph node, colon, and cell-line pellets engineered to express or lack a target complement tonsil. A conjugate should reproduce the known distribution: CD20 on follicle B cells, Ki-67 in germinal-centre dark zones, FOXP3 in scattered T-zone cells, cytokeratin in crypt epithelium and not in lymphocytes. Subcellular localisation should also be right: FOXP3 and Ki-67 nuclear, CD3 and CD45 membranous, granzyme B granular and cytoplasmic. Third, compare against an orthogonal method. The strongest validation is agreement between the metal-tagged antibody and a well-established chromogenic or fluorescent stain for the same target on a serial section or, better, the same section before acquisition. Some laboratories image a fluorescent secondary antibody on the same section before mass imaging. For targets with known genetic loss in particular tumours, such as HLA class I loss or loss of a tumour suppressor protein, tissue with and without the protein offers a biological negative control. Fourth, titrate. Each conjugate should be tested at a range of concentrations, often from about 0.25 to 4 micrograms per millilitre in the final staining cocktail, and the concentration chosen that gives the best separation between positive and negative cells, rather than the brightest image. Over-concentrated antibodies increase non-specific background and spillover into neighbouring channels. Under-concentrated antibodies lose weak positives. Titration is best done in the full panel rather than alone, because antibodies can compete for nearby epitopes or be affected by blocking reagents. The Bodenmiller group, the Angelo group and several core facilities have published detailed validation procedures, and a community effort has pushed for antibody reporting standards in multiplexed imaging so that clone, lot, metal, concentration and validation evidence are recorded in every paper. A reviewer should expect to see, at minimum, a supplementary table listing each marker's clone, supplier, metal, concentration and the tissue used for validation, and images of each channel in a control tissue. Controls built into the panel A panel can carry its own quality controls if a few channels are reserved for the purpose. An empty channel, a mass deliberately left without an antibody but flanked by bright markers, directly measures how much signal leaks into a channel from its neighbours and from oxides in real tissue. A channel for free metal, recorded but not assigned, reveals whether unbound lanthanide is present in the conjugates; if it is, a diffuse haze will appear across the whole section. Many laboratories also record the masses of common contaminants, such as barium (138), lead (204 to 208) and mercury, because these occasionally appear from reagents, glassware or tissue processing and can generate spurious signal in adjacent channels. Biological controls within the tissue are equally valuable. In most solid tissues, cells exist that should be unequivocally negative for each marker: epithelium for CD45, lymphocytes for cytokeratin, stroma for CD20. The signal in those cells gives a practical measure of background for each channel, which is often more informative than any isotype control. Isotype controls, standard in flow cytometry, are less used in tissue imaging because their non-specific binding does not closely mimic that of the specific antibody, but some groups include one or two to monitor Fc-mediated binding in tissues rich in macrophages. Finally, every staining run in a cohort study should include a reference tissue, a section of tonsil, a small tissue microarray of control tissues, or a cell-pellet array, stained from the same cocktail on the same day. This reference, imaged in each batch, is the basis for detecting and correcting batch effects later, as Chapter 5 describes. It costs one slide position per run and is almost always worth it. Batch, lot and storage Metal conjugates are reasonably stable, usually for many months at four degrees in a protein-based stabiliser, but not indefinitely. Signal typically declines over time, and some conjugates lose performance faster than others. Studies that span more than a few months should either make one large batch of each conjugate at the outset or plan bridging experiments that compare old and new batches on the same control tissue. Antibody lot changes are a separate risk. Monoclonal antibodies are in principle identical across lots, but vendor formulation changes, including a switch between carrier-containing and carrier-free buffers, can alter conjugation efficiency. Polyclonal antibodies vary more. For a cohort study, the safest practice is to buy enough of each antibody for the entire study before starting. The best single protection against drift is a master cocktail: all antibodies combined at their final concentrations in one large volume, aliquoted and frozen or stored under conditions validated for stability, and used for every slide in the study. This eliminates pipetting variation between staining runs, which otherwise is a significant source of batch effects. Some groups lyophilise antibody cocktails to make them more stable, an approach well established in suspension mass cytometry. Signal amplification for weak targets For some targets, even the most sensitive channel and the best clone give too few counts. Several strategies raise the signal. The simplest is a two-step stain with an unconjugated primary antibody followed by a metal-tagged secondary antibody, which amplifies because several secondaries bind each primary; this works well for one or two targets but consumes species specificity, since each secondary must recognise a different primary species or isotype. Hapten-based schemes attach a small molecule, such as a fluorophore or biotin, to the primary antibody and detect it with a metal-tagged anti-hapten antibody, which can be combined with the hapten's other uses: a FITC-tagged primary can be imaged by fluorescence before mass imaging and then detected by an anti-FITC metal conjugate. DNA-barcoded amplification methods, in which the primary antibody carries an oligonucleotide that is extended or branched to bind many metal-tagged probes, have been developed for both suspension and imaging mass cytometry and can raise the signal by an order of magnitude or more for low-abundance targets. Each amplification step adds complexity and a new way to fail, and amplification is not linear across the dynamic range, which complicates quantitative comparison. Amplification should be reserved for markers that justify it. A worked panel It is helpful to see how the principles combine. Suppose a laboratory is designing a thirty-eight-marker panel for non-small-cell lung cancer immunology. The markers fall into five groups: structure (pan-cytokeratin, vimentin, alpha-smooth muscle actin, CD31, collagen type I, E-cadherin, a nuclear counterstain, a morphology counterstain); lineage (CD45, CD3, CD4, CD8, FOXP3, CD20, CD68, CD163, CD11c, CD14, CD16, CD15, MPO, tryptase, NK marker CD56 or CD57); tumour state (Ki-67, TTF-1, p40, HLA class I, beta-catenin, CA9); immune state (PD-1, PD-L1, LAG-3, TIM-3, granzyme B, CD45RO, HLA-DR, IDO1, ICOS); and one or two exploratory targets. The designer begins by estimating brightness. Cytokeratin, vimentin, CD45, collagen, alpha-smooth muscle actin, HLA class I and HLA-DR are bright; FOXP3, PD-1, LAG-3, TIM-3, IDO1, ICOS and TTF-1 are dim or variable. The dim markers go to channels in the 158 to 176 range. The bright markers go to the lighter lanthanides and, where needed, to cadmium. Nuclear stains go to iridium. Then co-expression: CD3 is bright and present in every T cell, and FOXP3, PD-1, LAG-3, TIM-3 and ICOS are all expressed in subsets of T cells. CD3 should therefore not sit one mass unit below or above any of them, nor sixteen mass units below. The same logic applies to CD68 relative to PD-L1 and IDO1 in macrophages, and to cytokeratin relative to PD-L1, HLA class I and Ki-67 in tumour cells. A first draft usually violates a few constraints; the designer swaps metals until the predicted spillover into each weak channel, from bright markers co-expressed in the same cells, is below a tolerable level, often chosen as one or two percent of the weak marker's expected positive signal. The panel is then conjugated, titrated in tonsil and lung tissue, and adjusted. Two or three clones will probably fail and need replacing. The whole process takes three to six months for a new panel, less if the laboratory has an established core panel and is only adding markers. That core-panel strategy has become common. Many groups maintain a validated backbone of fifteen to twenty-five structural and lineage markers, reused across projects, and add a project-specific module of ten to twenty targets. This approach, formalised by several consortia and vendors, cuts validation time and makes data from different projects more comparable. The next chapter picks up the conjugated, validated panel and follows it through the staining of a tissue section and the acquisition of the images. Hashtags: #SpatialProteomics #MultiplexedIonBeamImaging #MIBI #ImagingMassCytometry #IMC #MassTagImaging #MetalTaggedAntibodies #LanthanideConjugation #MultiplexedProteinImaging #FFPETissueImaging #TissueMicroenvironment #CellSegmentation #SingleCellPhenotyping #SpatialCellInteractions #CellularNeighborhoods #NeighborhoodEnrichment #SpatialStatistics #TumorImmuneMicroenvironment #AntibodyPanelDesign #ChannelAssignment #MassSpectrometryImaging #SpilloverCompensation #BatchCorrection #SpatialStudyDesign #FutureOfSpatialProteomics

Download the Book (PDF): Introduction A tissue section is a map that has already been drawn. Every cell in it sits where development, migration, injury, and repair put it, and its neighbours are not incidental company but the principal determinants of what it is doing. A hepatocyte three cells from the central vein runs a different metabolic program from one three cells from the portal triad, and the difference is not noise around a hepatocyte mean — it is the organ working. Dissociate that section into a suspension and the map is destroyed. You retain the cells and lose the geography, and the geography was most of the biology. Spatial transcriptomics exists to keep both. The premise is simple enough to state in a sentence: measure RNA while recording where in the tissue each measurement came from. The execution is where the difficulty lives, and the difficulty is greater than most newcomers expect, because the coordinate is not free. It is a measurement in its own right, produced by a chain of physical operations — how the tissue was frozen, how thick the section was cut, how long the permeabilization ran, how the image was registered to the barcode array — and it inherits error from every link in that chain. A transcript assigned to the wrong cell is not a smaller error than a transcript miscounted. It is usually a larger one, because it changes the biological claim rather than its confidence interval. This is the argument the booklet develops: in spatial transcriptomics, the coordinate is the experiment. Counting RNA is the easy half, inherited more or less intact from a decade of single-cell work. The hard half is establishing, defensibly, that a count belongs where the software says it belongs, and the discipline that makes spatial data trustworthy is therefore mostly a discipline of tissue handling, optics, registration, and honest accounting for the ways cells and their transcripts get mixed up with each other. Treat spatial data as single-cell data with two extra columns and you will produce figures that look beautiful and claims that do not survive a careful reviewer. The field has matured enough that this can now be said plainly. When Nature Methods named spatially resolved transcriptomics its Method of the Year for 2020, the technology was still largely in the hands of the laboratories that invented it. Since then it has become a service-core offering: several commercial platforms, standardized kits, published protocols, and a computational ecosystem of several hundred tools. The bottleneck has moved. It is no longer whether you can generate the data — you can, often within a few weeks and for a price a mid-sized grant can absorb — but whether the data you generated means what your analysis assumes. Two families of technology dominate, and the distinction between them organizes almost everything that follows. Capture-based methods lay a spatially barcoded surface underneath a tissue section, lyse the tissue, and let RNA fall down onto barcodes that record position. They are unbiased with respect to the transcriptome — you get whatever the tissue was expressing, not a preselected panel — but they measure regions rather than cells, at a resolution set by the barcode array, and they recover a fraction of the RNA present. Imaging-based methods leave the RNA in place and read it optically, cycling fluorescent probes across the tissue and decoding the resulting sequence of colours into gene identities. They deliver individual transcripts at subcellular resolution with high detection efficiency, but only for the genes you chose to put on the panel, and they hand you the segmentation problem: the instrument reports points in space, not cells, and turning points into cells is an inference with its own error rate. Neither family is better. They fail differently, and a serious experimental design starts by asking which failure mode is tolerable for the question at hand. A project mapping unknown heterogeneity in a poorly characterized tumour needs the unbiased transcriptome and can live with 50-micrometre regions. A project quantifying how many T cells contact a tumour cell directly needs single-cell resolution and can live with a 500-gene panel. Choosing wrong at this stage cannot be fixed downstream by any amount of computation, and a great deal of published spatial analysis consists of computational heroics applied to data that was never going to answer the question asked of it. What follows is a working guide rather than a survey. It moves in the order the work actually happens. The first chapter establishes what the measurement is on each platform family and what its numbers physically mean, because a surprising amount of downstream confusion comes from analysts who do not know whether a "spot" contains one cell or thirty. The next three chapters are the wet bench: tissue provenance and preservation, the slide itself and the permeabilization step that governs whether any of it works, and the barcoding and capture chemistry that turns localized RNA into a sequencing library. The fifth chapter covers imaging-based counting on its own terms — probe design, combinatorial codes, optical crowding, and the error floor that blank barcodes reveal. The sixth chapter is the cartography proper: registration. It is the least glamorous chapter in any spatial methods paper and the one that most often determines whether the results are real. Then the analysis: raw files to a quality-controlled matrix; segmentation and deconvolution, the two routes by which a measurement becomes attributable to a cell type; and the spatial statistics that turn a coordinate-annotated matrix into claims about domains, gradients, niches, and interaction. The final chapter deals with design, replication, orthogonal validation, and what a reproducible spatial dataset should look like when it leaves your hands. Throughout, the tone is deliberately sceptical about the most attractive outputs. Spatial data produces images, and images persuade. A colour-coded map of inferred cell types over an H&E section is a visually compelling object that can be generated from data with a sixfold difference in sensitivity between its two halves, a 40-micrometre registration offset, and a deconvolution reference that did not contain half the cell types actually present. None of those defects announces itself in the picture. They announce themselves in quality-control metrics that most pipelines compute and most analysts do not look at, which is why a considerable part of this book is about looking at them. One matter of scope. This is a book about transcriptomics — RNA measured in situ. Spatial proteomics, spatial epigenomics, and spatial metabolomics are real, growing, and in several places converging with the methods described here, but they have their own chemistry and their own failure modes, and treating them properly would take a different book. They appear only where they bear directly on transcriptomic work, chiefly as orthogonal validation and as the immunofluorescence channels that make segmentation possible. Likewise, the book names commercial platforms where naming them is the clearest way to be concrete, without endorsing any of them; platforms change faster than books do, and the principles are what transfer. The reader I have in mind is a scientist about to commit real tissue and real money to a spatial experiment, or one holding a dataset they did not generate and need to evaluate. Both need the same thing: a clear account of where the measurement can go wrong, and what to do about it. The technology is genuinely remarkable. It is also unforgiving of the assumption that it works the way it looks like it works. A word on what this book assumes. It assumes familiarity with the basics of RNA sequencing and single-cell transcriptomics — what a count matrix is, what a UMI does, why normalization is contested — and no prior experience with spatial methods specifically. It assumes the reader may be a bench scientist who will run the protocol, a computational scientist who will analyse the output, or the person responsible for both, and it deliberately refuses to separate those roles, because the errors that matter most are the ones that originate at the bench and surface only in the analysis. An analyst who does not know what permeabilization does cannot diagnose the data; a bench scientist who does not know what deconvolution assumes cannot generate data that supports it. It also assumes that the reader wants to be told where things go wrong. There is an alternative genre of methods writing that presents each technique at its best and leaves the failure modes to be discovered by the reader in their own laboratory, at their own expense. That genre is pleasant to read and expensive to follow. The approach here is the opposite: each chapter states what the step is for, then what breaks, then how to tell whether it broke. The result is more sceptical in tone than the field's own literature, which is deliberate, because a booklet that sends its reader back to the microscope to check something is worth more than one that sends them to the figure-generating script with confidence they have not earned. Chapter 1: What the Instrument Actually Measures Ask an analyst holding a spatial dataset what a single number in the matrix represents and you will learn a great deal about how much you can trust the analysis. The correct answer differs by platform and is rarely "the expression of gene g in cell c." It is more often "the number of unique molecules of gene g whose poly-A tail happened to reach a barcode within a 55-micrometre disc that overlies an unknown number of cells, after a permeabilization step of unknown efficiency," or "the number of times a decoding algorithm assigned a barcode to gene g within a polygon that a segmentation algorithm guessed was a cell." These are different measurements. They support different claims, degrade in different ways, and require different statistics. This chapter establishes what each major platform family measures, in physical terms, and derives from that the constraint that governs the whole field: you cannot simultaneously maximize spatial resolution, transcriptome breadth, and detection sensitivity. Every platform is a position on that surface, and every experimental design is a decision about which axis to sacrifice. Two families, two physics Capture-based methods — sometimes called sequencing-based, NGS-based, or array-based — invert the usual single-cell logic. Instead of moving cells to barcodes in droplets, they move RNA to barcodes fixed in space. A solid surface carries oligonucleotides whose sequence encodes position: every oligo at location (x, y) shares a spatial barcode unique to that location, and each also carries a unique molecular identifier and a poly-dT capture sequence. A tissue section is placed on the surface, imaged, permeabilized so that the cell membranes become porous, and the released mRNA diffuses the short distance downward and hybridizes to the nearest available oligo. Reverse transcription in situ copies the message, covalently joining the transcript's sequence to the barcode that records where it landed. From that point the material is an ordinary sequencing library, and the spatial information has been converted into sequence. The lineage runs from Ståhl and colleagues' 2016 Science paper, which used a printed array of 100-micrometre spots, through Slide-seq and Slide-seqV2, which replaced the printed array with a monolayer of randomly deposited 10-micrometre barcoded beads whose positions were determined by in situ sequencing, to Stereo-seq, which patterned barcodes onto a DNA nanoball array with spot diameters around 220 nanometres, and to commercial high-definition arrays that tile a continuous barcoded lawn at 2-micrometre pitch. The trend is clear: capture resolution has improved by more than two orders of magnitude in under a decade. Resolution improvement does not make the measurement single-cell, and this is the most consequential misunderstanding in the field. A 2-micrometre bin is smaller than a cell, so a single cell now spans many bins — but a bin at the boundary between two cells still collects RNA from both, and the physical spread of a transcript as it diffuses from its origin to the surface sets a floor on effective resolution that is independent of barcode pitch. Sub-cellular barcode pitch buys you the ability to aggregate bins into cell-shaped regions after the fact, guided by a stained image; it does not by itself tell you which cell a molecule came from. Aggregation is a form of segmentation, with the same difficulties discussed in Chapter 8. Imaging-based methods — in situ hybridization or in situ sequencing — never release the RNA. They detect it where it sits. The ancestor is single-molecule FISH: tile a target transcript with dozens of short fluorescent oligonucleotide probes so that a single mRNA molecule becomes a diffraction-limited spot bright enough to see, then count spots. Classical smFISH is quantitative and beautiful and limited to a handful of genes at a time, because the number of distinguishable fluorophores is small. Multiplexing breaks that limit by encoding gene identity across imaging rounds rather than within a single image. In MERFISH, developed by Chen, Boettiger, Moffitt, Wang, and Zhuang and published in Science in 2015, each gene is assigned a binary barcode — on or off in each of N rounds — and probes are designed so that a transcript fluoresces in exactly the rounds its barcode specifies. With sixteen rounds, the code space is large, and if the codebook is restricted to barcodes separated by a Hamming distance of four, a single-round error can be detected and corrected. seqFISH and seqFISH+ use a related strategy with pseudocolours, reaching panels of ten thousand genes. In situ sequencing approaches, including padlock-probe and rolling-circle-amplification chemistries used by commercial single-cell platforms, generate a rolony — a clonal ball of concatemerized DNA — at the site of each detected molecule, and read a short barcode out of it base by base. What an imaging platform hands you is a table of transcripts: gene identity, x, y, often z, and a quality score. That table is the primary datum. There is no cell in it. Cells appear only when a segmentation step draws boundaries, usually from a nuclear stain and a membrane or cytoplasmic stain acquired alongside the barcode rounds, and assigns each point to a boundary or to nothing. Perhaps ten to thirty per cent of transcripts routinely fail to land inside any cell, and the fraction that land inside the wrong cell is harder to estimate and generally larger than researchers assume. The trilemma Put the families side by side and a constraint appears that no current technology escapes. Resolution is how finely position is recorded. Imaging methods win outright: individual molecules, localized to well under a micrometre in x and y. Capture methods range from 100 micrometres down to sub-micrometre pitch, but with the caveat above about diffusion. Breadth is how much of the transcriptome you see. Capture methods win outright: poly-dT capture is agnostic to gene identity, so you measure everything polyadenylated, including transcripts nobody thought to look for. Probe-based capture chemistries designed for formalin-fixed material use a panel of paired probes tiling the annotated transcriptome, which is broad but not unbiased and will miss unannotated or highly variant sequences. Imaging methods are restricted to their panel: typically a few hundred to a few thousand genes, chosen before the experiment and unchangeable afterwards. Sensitivity is what fraction of the molecules present you actually count. Here imaging wins, and by a wide margin. Well-run MERFISH or in situ sequencing recovers a large share of the transcripts a gold-standard smFISH measurement would find for the same gene — on the order of half or better, in favourable tissue. Capture-based sensitivity is much lower: a substantial body of benchmarking finds capture efficiencies in the low single-digit percentages for array-based methods, meaning most of the RNA in the section is never counted. It is not lost at random, either: capture efficiency varies with transcript length, secondary structure, distance from the surface within the section, and the local permeability of the tissue. The practical consequence is that a per-gene count from a capture platform is a heavily downsampled, non-uniformly downsampled observation, and a per-gene count from an imaging platform is a nearly complete observation of a small, preselected gene set. These call for different analytical instincts. Low-expressed genes on a capture platform may be absent from a spot simply because three molecules were present and none was captured; on an imaging platform, a zero is much closer to a real zero. Table 1 summarizes the families on the criteria that matter for design. Table 1. Platform families compared on the properties that determine experimental design. Property Array capture (spot-scale) Array capture (sub-cellular pitch) Imaging: combinatorial FISH Imaging: in situ sequencing Spatial unit 55–100 µm spot 0.2–2 µm bin Single transcript Single transcript Cells per unit ~1–30 Fraction of a cell n/a (segmentation required) n/a (segmentation required) Gene coverage Whole transcriptome Whole transcriptome Panel, 100–10,000 Panel, 100–5,000 Detection efficiency Low (single-digit %) Low High High Tissue area per run Large (cm scale) Large Moderate Moderate to large Primary failure mode Spot mixing, permeabilization Diffusion, sparse bins Optical crowding, decoding Segmentation, panel gaps FFPE compatible With probe chemistry With probe chemistry Yes Yes The table deliberately omits cost and turnaround, which change too fast to print, and instrument names, which change faster still. What "resolution" means, precisely Three quantities get called resolution and confusing them causes real errors. The first is barcode pitch or pixel size: the spacing of the spatial index. This is the number vendors advertise. It is an upper bound on precision and nothing more. The second is effective resolution: the spatial scale over which the measurement is actually independent. On a capture platform this is set by lateral diffusion of RNA during permeabilization and reverse transcription. If a transcript released from a cell wanders ten micrometres before it binds, then bins two micrometres apart are not independent observations, and a map at 2-micrometre pitch is oversampled relative to its true information content. Measuring lateral spread directly is difficult; the usual proxy is to examine a sharp anatomical boundary — the edge of a lymphoid follicle, the epithelium–stroma interface — and see how many bins the transition takes. A transition that should be one cell wide and instead spans thirty micrometres is telling you the effective resolution, regardless of the pitch. The third is attribution accuracy: whether a molecule is assigned to the correct cell. This is the quantity that matters for any claim about cell types, and it depends on segmentation quality more than on pitch. A platform with 200-nanometre localization and poor segmentation can produce worse cell-level data than a platform with coarser localization and excellent nuclei. Analysts routinely report the first and reason as if they had the third. Reading a spot as a mixture For spot-scale capture data, the correct mental model is a mixture. A 55-micrometre spot over cortex contains perhaps ten to twenty cells of several types; the observed profile is approximately a weighted sum of their expression profiles, weighted by cell abundance and by each cell's RNA content, further distorted by capture efficiency. Two things follow. First, clustering spots does not yield cell types. It yields tissue states — recurring mixtures — which are often biologically meaningful (a "germinal centre" spot cluster, a "tumour border" cluster) but should never be labelled with cell type names. A cluster whose marker genes are dominated by a rare, transcriptionally distinctive cell type will be named after it, and the resulting figure will imply that the region is made of that cell type when it may be five per cent of it. Second, differential expression between spot clusters conflates changes in composition with changes in per-cell expression. If tumour-border spots express more CXCL9 than tumour-core spots, this may mean the macrophages there are more activated, or it may mean there are simply more macrophages. Distinguishing these requires deconvolution and then composition-aware testing, which Chapters 8 and 9 take up. A great many published spatial differential-expression results do not make this distinction, and are therefore statements about composition dressed as statements about regulation. Reading a transcript table as a point process Imaging data invites the opposite error: treating the transcript table as if it were already cells. Before segmentation, a transcript table is a marked spatial point process — points in the plane, each carrying a gene label. That framing is useful, because it makes clear which questions can be answered without segmentation at all. Whether two genes co-localize at a ten-micrometre scale, whether a gene's density has a gradient across a structure, whether transcript density falls off with distance from a vessel: all of these are point-process questions, answerable with cross-type spatial statistics and immune to segmentation error. Questions that require cells — how many cells of type A exist, what fraction of B cells express a marker, whether A and B are in direct contact — require segmentation and inherit its errors. It is worth asking, of any analysis plan built on imaging data, whether the segmentation step is actually necessary. Quite often the underlying question is a point-process question that has been reflexively translated into cell language. The negative controls that tell you the error floor Every serious platform provides a way to measure its own false positive rate, and this is the single most underused feature of spatial data. Imaging platforms include blank or negative barcodes: codewords that are valid in the codebook's error-correcting structure but assigned to no gene. Any decoded spot carrying a blank barcode is, by construction, a false detection. The rate of blank calls per barcode, compared with the rate of real gene calls per barcode, gives a direct estimate of the decoding error floor. If a gene in your panel is detected at a rate comparable to the blanks, it is not detected at all, and any spatial pattern you find in it is a pattern in noise. Platform pipelines usually report this; analysts usually ignore it, then run differential expression over the full panel including genes sitting at the noise floor. Imaging panels also commonly include negative control probes targeting sequences absent from the organism, which quantify non-specific probe binding rather than decoding error — a different failure mode with a different fix (stringency, washing) and worth tracking separately. Capture platforms have a weaker but still useful equivalent: barcodes on the array outside the tissue footprint. RNA detected under an empty region of array is either ambient contamination, lateral diffusion from the tissue edge, or index hopping. A high off-tissue signal is a red flag for diffusion and therefore for effective resolution. Some workflows also include spike-ins, which calibrate capture efficiency directly, though these are less common in commercial kits than they should be. Build the habit of computing these numbers first, before any clustering. They determine how much of the rest of the analysis is real. What this implies for choosing a platform The design question is not "which platform is best" but "which of the three axes can this question afford to lose." If the question is discovery — what programs exist in this tissue, what is unexpectedly expressed at this interface — breadth is non-negotiable and capture-based methods are the answer, accepting that conclusions will be at region scale and that validation at cell scale is a separate experiment. If the question is quantitative and cellular — how many, how close, what fraction — resolution and sensitivity are non-negotiable and imaging is the answer, accepting that the panel must be designed from prior knowledge and that anything not on it is invisible. Panel design then becomes the most important scientific decision in the project, and it is usually made in an afternoon. If the question is both, the honest answer is two experiments: a capture-based survey to find the programs, an imaging panel built from what the survey found to quantify them. This costs more and is the design most likely to survive review. A considerable fraction of the strongest spatial papers of the last three years follow exactly this structure, and their authors rarely present it as a concession. The chapters that follow assume the choice has been made and turn to making the chosen measurement correctly. That begins where every spatial experiment begins and where most of them are quietly ruined: with the tissue itself. Two design decisions, worked through Abstract trade-offs become clearer against concrete cases. Case one: an unexplained fibrotic band in a kidney biopsy cohort. The question is what transcriptional programs distinguish the fibrotic region from adjacent preserved parenchyma, and nobody knows in advance which programs those are. Discovery is the aim, the tissue is archival FFPE, and the biopsies are needle cores a few millimetres long. Breadth is essential — a panel chosen from current guesses would find current guesses. Resolution requirements are moderate, because the fibrotic band is hundreds of micrometres wide and the comparison is regional. Sensitivity matters less than breadth, because the regions being compared aggregate many spots and pooling recovers statistical power that individual spots lack. The answer is probe-based capture on the archival material, with several cores per slide so that the cohort can be built at reasonable cost. The known limitation, stated up front, is that any conclusion will be about regions rather than cells, and that a follow-up experiment will be needed to say which cells carry the program. Case two: whether cytotoxic T cells make direct contact with tumour cells in treated versus untreated lesions. Here the claim is explicitly about cell-to-cell adjacency, and the measurement unit must therefore be the cell. A 55-micrometre spot containing a T cell and a tumour cell establishes nothing about contact, because it would contain both whether they touched or not. Resolution is non-negotiable; breadth is not, because the cell types involved are well characterized and a panel of a few hundred genes distinguishes them comfortably. The answer is an imaging platform with a boundary stain, a panel built from existing single-cell data of the same tumour type, and an analysis that reports contact rates with an explicit account of segmentation uncertainty. The known limitation is that any unexpected cell state will be invisible, which is acceptable because the question is confirmatory rather than exploratory. The instructive feature of both cases is that the platform decision falls out of the question almost mechanically once the question is stated precisely. Difficulty arises when the question is stated loosely — "characterize the tumour microenvironment" — because a loose question is compatible with every platform and therefore selects none. Forcing the question into a form that names the measurement unit, the comparison, and the claim is the useful first step, and it takes an afternoon rather than a grant cycle. Chapter 2: Tissue as Reagent The most expensive failures in spatial transcriptomics happen before any kit is opened. A block that sat in formalin over a long weekend, a surgical specimen that spent ninety minutes on a bench before freezing, a decalcified bone sample, an archival slide cut three years ago — each of these produces data that looks superficially normal and is quantitatively worthless. The chemistry downstream is robust enough to generate a library from almost anything, which is precisely the danger. You will get a result. It will not be a measurement. This chapter treats tissue as what it is in this workflow: a reagent, with a specification, a shelf life, and acceptance criteria. Laboratories that adopt that stance, and that refuse samples failing incoming quality control, produce far better spatial data than laboratories that treat whatever the clinic sends as a given. The clock starts at devascularization RNA degradation begins the moment blood supply stops. Within minutes, hypoxia triggers stress-response transcription; within tens of minutes, ribonucleases released from lysosomes and from the sample's own microbiome begin cutting message. Both processes matter and they matter differently. Degradation reduces the amount of intact RNA available for capture, which shows up as low counts. Ischemic transcription changes the answer: immediate-early genes — FOS, JUN, EGR1, the heat-shock family — rise sharply, and they rise unevenly across the tissue, faster in regions further from residual perfusion. That produces a spatial pattern that is entirely artefactual and entirely plausible-looking, and it is the single most common source of spurious spatial structure in clinical material. Warm ischemic time is therefore a variable to record, control, and report. In experimental animal work it can be kept under a few minutes with practice: anaesthetize, perfuse or excise rapidly, freeze immediately. In human surgical material it is rarely under twenty minutes and often much longer, determined by operating-theatre logistics that no research protocol controls. The realistic response is threefold. Record the time from clamp to fixation or freezing for every specimen, treat it as a covariate in analysis, and check the immediate-early gene module explicitly in the finished data — if its spatial distribution correlates with distance from the block's surface or with the specimen's handling geometry, be suspicious of everything downstream. Post-mortem tissue is a special case with a large and sometimes surprising literature. Brain in particular tolerates long post-mortem intervals better than intuition suggests, because the cranial vault buffers temperature and the tissue is relatively ribonuclease-poor; usable spatial data has been generated from brains with post-mortem intervals of many hours. Gut, pancreas, and other ribonuclease-rich or microbially colonized tissues degrade far faster. The rule is organ-specific, not general. Preservation formats and what each permits Four preservation routes dominate, and they are not interchangeable. Fresh-frozen tissue — snap-frozen in isopentane chilled over dry ice or liquid nitrogen, then embedded in cryo-embedding medium and stored at −80 °C — is the reference format for capture-based whole-transcriptome work. RNA is preserved essentially as it was at the moment of freezing, poly-A tails are intact, and poly-dT capture works. The costs are morphological: ice crystal artefacts if freezing was slow, softer histology than paraffin, and cryosectioning that demands genuine skill. Fresh-frozen material also cannot be stored in a hospital archive, so it exists only where someone planned for it prospectively. Formalin-fixed, paraffin-embedded material is the format the world's tissue actually exists in. Formalin cross-links protein to protein and protein to nucleic acid; paraffin processing dehydrates and heats. RNA in FFPE is fragmented, typically to a few hundred nucleotides, and chemically modified with mono-methylol adducts on bases. Poly-dT capture largely fails, because fragments no longer carry their poly-A tails. The solution, now standard, is probe-based capture: a pair of probes is designed against each target transcript, hybridized in situ, ligated when both halves bind adjacently, and the ligated product — which carries a poly-A sequence by design — is captured on the array. This restores FFPE to the workflow at the cost of a defined target panel rather than true transcriptome-wide capture, and with a sensitivity that depends on how many of a transcript's probe sites survive fragmentation. Imaging platforms based on hybridization handle FFPE natively, since they too use short probes and do not depend on poly-A. Fixed-frozen — brief formalin or paraformaldehyde fixation, cryoprotection in sucrose, then freezing — is a middle path used heavily in neuroscience. It preserves morphology better than fresh-frozen, avoids the harshness of paraffin processing, and retains enough RNA integrity for several workflows. It is less well supported by commercial protocols and usually requires local optimization. Methanol- or acetone-fixed sections, fixed after cryosectioning rather than before freezing, are used in some imaging protocols and in research-grade capture workflows. Alcohol fixation precipitates protein without cross-linking, which keeps RNA more accessible but preserves morphology poorly and leaves the section fragile. Table 2 sets out what each format permits. Table 2. Preservation formats and the workflows they support. Format RNA state Capture chemistry Morphology Archive availability Fresh-frozen Intact, poly-A present Poly-dT, whole transcriptome Fair; ice artefact risk Prospective only FFPE Fragmented, cross-linked Probe-based panel; hybridization imaging Excellent Vast retrospective archives Fixed-frozen Near-intact, lightly cross-linked Probe-based; some poly-dT Good Prospective only Alcohol-fixed section Intact, accessible Poly-dT or probe Poor Prospective only The decision is usually made for you by what tissue exists. Where it is not, fresh-frozen remains preferable for discovery work and FFPE for anything requiring cohort scale, because FFPE cohorts with clinical annotation and outcome data are the only source of statistical power for translational questions. Fixation done properly Where you control fixation, the variables are formalin concentration, duration, temperature, penetration distance, and buffering. Ten per cent neutral buffered formalin is the standard. Unbuffered formalin oxidizes to formic acid and hydrolyses nucleic acid; use fresh, buffered stock. Fixation is diffusion-limited, penetrating roughly a millimetre per hour in dense tissue, so a thick block fixes from outside in and its core may still be unfixed and autolysing while its rim is over-fixed. Trim blocks to a few millimetres thickness before immersion. Volume should be at least ten times the tissue volume. Duration is the variable most often abused. For spatial work, twelve to twenty-four hours at room temperature is the target. Under-fixation leaves regions unpreserved; over-fixation, meaning multi-day immersion, increases cross-linking to the point where probe hybridization fails and no amount of antigen retrieval recovers it. The clinical pathology workflow that produces most archival blocks does not optimize for this, which is why FFPE block performance is so variable and why incoming quality control matters. Decalcification deserves a paragraph of its own because it destroys samples silently. Strong acid decalcifiers — hydrochloric, nitric, formic acid — hydrolyse RNA severely, and bone or teeth processed this way are usually unusable. EDTA-based chelating decalcification at neutral pH, though far slower (weeks rather than days), preserves RNA adequately. If your project involves bone, marrow, or calcified plaque, the decalcification protocol is the most important methodological decision in the study, and it must be specified before collection begins. Measuring what you have Two metrics dominate incoming quality control, and they apply to different formats. RIN — the RNA integrity number, derived from capillary electrophoresis of ribosomal RNA peaks — applies to fresh-frozen and fixed-frozen material. It runs 1 to 10. Most capture-based fresh-frozen protocols specify RIN ≥ 7 as an acceptance threshold, and in practice performance falls off noticeably below 6. RIN is computed from 18S and 28S peak structure and is meaningful only when those peaks exist, which is why it is useless for FFPE. DV200 — the percentage of RNA fragments longer than 200 nucleotides — is the FFPE metric. It is a blunt instrument but a genuinely predictive one. Above 50 per cent is generally good; 30 to 50 per cent is workable with probe-based chemistry; below 30 per cent the sample should be rejected rather than run, because it will consume a capture area and yield a library dominated by noise. Running DV200 on a scroll from each candidate block, before committing it to the experiment, is the highest-return quality-control step in the entire FFPE workflow and takes a day. Block age correlates with DV200 but does not determine it. Well-processed blocks a decade old sometimes outperform poorly processed blocks from last year. Test, do not assume. Storage conditions matter — paraffin blocks kept cool and dry, ideally under 25 °C and away from humidity, degrade far more slowly than blocks kept in a warm archive — and oxidation of exposed block faces is real, so re-facing a block and discarding the first several sections before collecting is standard practice. For imaging platforms, an additional pre-check is worth running: a quick RNAscope or smFISH assay against a housekeeping transcript on a test section. If a highly expressed control gene produces few detectable spots, the block will not perform on a multiplexed panel either, and you have learned this for the cost of one slide. Cryosectioning as a skill Cryosectioning for spatial work is more demanding than for routine histology, because the section must be flat, complete, correctly thick, and placed precisely on a small capture area. Thickness is a real variable. Ten micrometres is the common default for capture-based work: thick enough for adequate RNA content, thin enough that most cells are transected and their contents can reach the surface. Thicker sections increase total RNA but worsen effective resolution, because transcripts from the top of the section must travel further and may bind to barcodes lateral to their origin, and because more cells overlap in projection. Thinner sections reduce signal and increase the risk of tearing. For imaging platforms, similar logic applies with an additional optical constraint: thick sections degrade point-spread function and increase optical crowding, so five to ten micrometres is typical. Chamber and block temperature should be tuned to the tissue. Fatty tissue — breast, adipose, some brain regions — sections better cold, around −20 °C or lower; fibrous or muscular tissue often prefers warmer, nearer −14 °C. Sections should be collected without the brush-flattening that routine histology tolerates, because dragging a brush across a section for a spatial array introduces folds and displaces material. Three artefacts cause most of the trouble. Folds create regions of doubled tissue thickness, which register as high-count outliers and are easy to mistake for biology — a fold through cortex produces a band of apparently high total expression that follows no anatomical structure. Tears and holes produce spurious low-count regions. Ice crystal damage, from slow freezing, produces a characteristic vacuolated morphology and heterogeneous RNA recovery. All three are visible in the H&E image if you look, which is a strong argument for always acquiring and always inspecting that image, a theme Chapter 6 returns to. Sections must be mounted on the capture area within the marked fiducial frame and adhered by brief warming — placing the section on a room-temperature or slightly warmed slide surface so that it melts onto it — then dried. Drying time and temperature affect adherence and RNA quality and are specified by each protocol; deviating from them is a common source of section loss during downstream washes, and a section that detaches mid-protocol is an experiment lost with no data at all. Serial sections and what they are good for A single section is a two-dimensional sample of a three-dimensional object, and almost every spatial project eventually wants more than one. Serial sections serve three distinct purposes that are worth keeping separate. Technical replication: adjacent sections from the same block, run on the same platform, to estimate measurement variability. This is legitimate and underused, but it must not be reported as biological replication — adjacent sections share a specimen, a preservation history, and most of their cells. Multi-modal registration: one section for spatial transcriptomics, an adjacent one for immunohistochemistry or a different assay, registered afterwards. Because adjacent 10-micrometre sections are not identical planes, registration between them is approximate, and cell-level correspondence is not achievable — structures correspond, individual cells do not. Claims of the form "the cell expressing X is the cell staining for Y" cannot be made across sections. Three-dimensional reconstruction: a stack of sections registered into a volume. This works for structures larger than the section spacing and fails for anything finer. It is expensive, and the registration problem is substantially harder than for a single pair, since errors accumulate along the stack and produce the characteristic "banana" distortion of naive sequential alignment. Chapter 6 discusses the mitigations. Cut serial sections in one sitting, keep them in order, and record the order. Retrospectively determining which section came from where in a block is nearly impossible, and a stack whose order is uncertain cannot be reconstructed. An incoming specification worth enforcing A short written specification, applied before any sample enters the workflow, prevents most of the failures in this chapter. A workable version: record and report ischemic time; fix in buffered formalin for 12–24 hours or freeze within minutes; never acid-decalcify; store blocks cool and dry; measure RIN or DV200 on a scroll from every block and reject below threshold; re-face and discard surface sections; cut at the thickness the platform specifies and log any deviation; inspect every section image for folds, tears, and ice damage before proceeding; and keep serial sections in recorded order. None of this is novel and none of it is difficult. It is simply the part of the workflow that has no vendor, no kit, and no publication attached to it, which is why it is the part most often skipped. The tissue is the only irreplaceable component in the experiment. Everything else can be repeated. Awkward specimen types Several tissue categories cause disproportionate trouble and deserve specific handling notes. Needle core biopsies are small, precious, and often the only material available for human disease. A core is typically one millimetre wide, which means a section presents a long thin strip, and several cores can be arrayed on one capture area. The dominant problem is that cores are frequently exhausted by diagnostic use before research gets them, and that the residual block face may be the least representative part. Coordinate with pathology at the collection stage rather than requesting leftovers later. Adipose tissue floats, tears, does not adhere, and stains faintly enough that automatic tissue detection frequently classifies it as background. It also contains little RNA per unit area, so counts are genuinely low and are easily mistaken for a technical failure. Section colder than usual, confirm the tissue mask manually, and set quality-control expectations from adipose-specific data rather than from whole-organ norms. Brain is comparatively forgiving of post-mortem interval and permeabilizes quickly, but it is soft, and white matter and grey matter differ enough in density and RNA content that a single permeabilization time is a compromise. Neurons also present the segmentation problem in its most extreme form, since a neuron's transcripts can sit hundreds of micrometres from its soma along a process, which no segmentation algorithm will attribute correctly. Muscle and heart are dense, fibrous, and slow to permeabilize; expect times at the long end of any published range. Cardiomyocytes are large, multinucleated in some species, and have very high mitochondrial transcript fractions that will trip any inherited single-cell quality-control threshold. Bone and marrow require the decalcification caution above and are worth planning around entirely if possible: a marrow aspirate or a soft-tissue surrogate may answer the question with far less risk. Organoids and cultured constructs are attractive because they are experimentally controllable, and they bring their own problem: they are small, so a section may contain only a few hundred cells, and the capture area is mostly empty. Embedding many organoids in a single block, cut together, uses the area efficiently and gives replication within a section. Tissue microarrays deserve a specific mention because they are so tempting for cohort work. A TMA places dozens of 1-millimetre cores on one slide, which appears to solve the sample-size problem at a stroke. The limitations are real: a 1-millimetre core samples a tiny fraction of a heterogeneous tumour, cores are often taken from regions selected for diagnostic rather than research reasons, and the physical construction of a TMA involves re-embedding that can degrade RNA. Where the question is about prevalence across a cohort and the tissue is homogeneous enough that a core is representative, TMAs work well. Where the question is about spatial architecture at scales larger than a core, they cannot answer it. Chapter 3: The Slide and the Permeabilization Step Every capture-based spatial experiment turns on one number that nobody can look up: how long to permeabilize this particular tissue. Permeabilize too briefly and the cell membranes never open enough for RNA to escape; the library is thin, counts are low, and the map is sparse. Permeabilize too long and RNA escapes and keeps going, spreading laterally across the array before it binds; counts look excellent and the map is a blur. The two failures look completely different in the quality-control metrics and completely identical in the finished figure, which is a good summary of why this step deserves a chapter. The surface Capture slides are glass carrying one or more capture areas, each a dense lawn of oligonucleotides. Every oligo has the same architecture: a surface linker, a partial sequencing primer, a spatial barcode identifying the position, a unique molecular identifier, and a capture domain — poly-dT for direct mRNA capture, or a defined sequence complementary to the ligated probe product for FFPE chemistries. For printed or patterned arrays the barcode-to-position map is known by construction. For bead-based arrays it is not: beads are deposited randomly and their positions must be determined empirically, historically by in situ sequencing of the bead barcodes on the slide before the tissue is applied. This is invisible to the user of a commercial kit but matters when reading the primary literature, because bead position error propagates directly into spatial error. Around the capture area sits a fiducial frame: a printed or etched pattern of marks, usually a border of dots or a distinctive asymmetric arrangement, whose geometry is known exactly. The frame exists so that the microscope image and the barcode coordinate system can be brought into correspondence. It is the physical basis of registration, and Chapter 6 is largely about what happens to it. For now, the operational point is simple: the fiducials must be clean, in focus, and fully visible in the acquired image. Tissue overhanging the frame, mounting medium obscuring a corner, or a section placed off-centre all compromise registration, and the resulting error applies to the entire dataset uniformly — a systematic shift, not random noise. Capture areas are small. Typical commercial areas are 6.5 millimetres square, with larger formats available; sub-cellular-pitch arrays often come at 6.5 by 6.5 millimetres as well. That is a meaningful constraint on experimental design. A whole mouse brain coronal section fits; a human brain section does not, and a human tumour resection must be sampled rather than surveyed. Choosing the region to place on the capture area is a scientific decision that determines what the experiment can find, and it should be made by someone who can read the histology — a pathologist for clinical material, not the person operating the cryostat. Slides must be handled as the reagent they are. The oligonucleotide lawn is degradable; slides are stored at −20 °C, equilibrated before use, kept free of ribonuclease, and used within their specified shelf life. Ribonuclease control on the bench — dedicated tools, filtered tips, decontamination solution, gloves changed often — is not ceremonial here. A single careless touch to a capture area with a bare finger can ruin it. Section placement and drying The section is picked up from the cryostat onto the slide by bringing the slide near enough that the section melts onto it, then allowed to adhere and dry. Three details matter more than they appear to. Position. The section must lie wholly inside the capture area and inside the fiducial frame. Tissue outside the capture area contributes no data but does contribute RNA that can diffuse inward, and tissue over the fiducials breaks registration. Practise placement on blank slides before committing a precious block. Flatness. Air bubbles trapped between the section and the glass produce regions where the tissue never contacts the barcodes; they appear in the data as sharply bounded low-count patches with no anatomical correlate. Folds do the opposite. Both are visible under the cryostat's own optics if you look before the section dries, and a section with a bad fold is worth discarding immediately rather than running. Drying. Protocols specify a drying step — typically some minutes at 37 °C — and then, for fresh-frozen workflows, fixation in methanol, staining, and imaging. Drying too little leaves the section liable to detach; drying too long begins degrading RNA. For FFPE sections the sequence is different: deparaffinization, rehydration, staining, imaging, and then decrosslinking, but the same principle applies that each timed step is timed for a reason. Staining and imaging before chemistry Before any permeabilization, the section is stained and imaged. This is not decoration. The image is the only record of where the tissue actually was, and everything spatial downstream is anchored to it. Haematoxylin and eosin is the default because it is universal, cheap, and interpretable by pathologists. For capture workflows on fresh-frozen tissue, methanol fixation precedes H&E; for FFPE, the standard histological sequence applies. Immunofluorescence is the alternative where specific structures must be identified — a marker for tumour epithelium, a vascular marker, a neuronal subtype label — and is essential where the downstream analysis depends on cell boundaries, since H&E provides poor boundary information. Image acquisition specifications are worth taking seriously. Use brightfield at a magnification giving at least sub-micrometre pixels for H&E — 20× objectives on modern slide scanners are the practical standard, with 40× where nuclear detail will feed segmentation. Ensure the entire fiducial frame is within the field. Check focus across the whole area, not just the centre; slide scanners can produce focus drift at the periphery that ruins nuclear detail exactly where the tissue edge is. Save the image at full resolution and in a lossless format, and record the pixel size in physical units. Analysts receiving a JPEG of unknown scale will be unable to register it properly and will not always tell you. Photobleaching and stain quality matter for any workflow that will use the same image twice. If the plan is H&E followed by immunofluorescence on the same section, know in advance whether the H&E can be de-stained without damaging the RNA, because in most capture protocols it cannot be, and the choice between H&E and IF is made once. The permeabilization problem Now the central step. Permeabilization uses an enzyme — most commonly pepsin, sometimes collagenase or proteinase K depending on protocol and tissue — applied at defined temperature and time, to digest protein and open the cells so mRNA can diffuse to the capture surface beneath. The correct time is tissue-specific, and it varies over roughly an order of magnitude. Loose, cell-sparse tissue such as brain often permeabilizes in a few minutes. Dense, collagen-rich tissue — muscle, kidney, fibrotic liver, many tumours — may need three or four times longer. The same tissue from a different species, a different preservation history, or a different disease state can differ substantially. Published times are starting points, not answers. The standard way to find the right time is a tissue optimization experiment. A dedicated slide carries several identical capture areas whose oligos end in a fluorophore-compatible design. Serial sections of the target tissue are placed on each area, permeabilized for different durations, and reverse transcription is performed with fluorescently labelled nucleotides. The resulting fluorescent cDNA footprint is imaged. What you are looking for is the time at which fluorescence is brightest and still confined within the tissue outline. A short time gives a dim, patchy footprint. A long time gives a bright footprint that has spread beyond the tissue edge, with a visible halo — the signature of lateral diffusion. That halo is the whole point of the assay, and it is routinely misread. Users pick the brightest condition, because brightness feels like signal. Brightness past the point of confinement is signal in the wrong place. The rule is: take the longest time that produces no visible spread beyond the tissue boundary, and if two adjacent times both look confined, take the shorter. Under-permeabilization costs sensitivity, which is recoverable by sequencing deeper and interpreting cautiously. Over-permeabilization costs resolution, which is not recoverable at all. Tissue optimization consumes precious sections and a slide, and there is a persistent temptation to skip it and use a literature value. For a tissue your laboratory has run before, with the same preservation route, that is defensible. For a new tissue, a new disease state, or a new fixation protocol, it is a gamble against the most expensive part of the experiment. Probe-based FFPE workflows change this picture considerably. Because the probes hybridize in situ and are ligated before release, and because the released product is a defined short oligo rather than a full-length mRNA, the permeabilization step is gentler and much less tissue-dependent. This is an underappreciated practical advantage of probe chemistries: they remove the single most variable step in the protocol. It is one reason FFPE spatial workflows often produce more consistent data across tissue types than fresh-frozen ones, despite the inferior starting RNA. What the failure modes look like in data Diagnosing a permeabilization problem after the fact is possible, and worth knowing how to do, because you will often be handed data rather than generate it. Under-permeabilization presents as globally low counts per spot — median unique molecules per spot far below what the platform and tissue typically yield — combined with a normal-looking tissue image and, importantly, a sharp tissue boundary in the data: counts fall to near zero immediately outside the tissue outline. Gene complexity per spot is low. Deeper sequencing does not help much, because the library itself is low-complexity; you are re-reading the same few molecules. Over-permeabilization presents as good or high counts, a blurred tissue boundary with substantial signal in off-tissue barcodes, and, diagnostically, loss of expected anatomical sharpness. The test to run is to find a structure whose boundary is known to be sharp — a blood vessel lumen, the edge of a lymphoid follicle, the boundary between cortical layers — and profile a marker gene across it. If a marker that should be confined to one side has an exponential tail extending twenty or thirty micrometres into the other, transcripts have moved. Regional permeabilization failure — common in heterogeneous tissue, where dense fibrotic regions permeabilize more slowly than adjacent loose regions — presents as count variation that correlates with tissue density in the H&E. This is insidious, because it creates a spatial pattern in total counts that mimics a biological difference in transcriptional activity, and because normalizing counts per spot partially hides it while leaving composition biases in place. Always plot total counts on the tissue coordinates and compare it to the histology. If the count map looks like a picture of tissue density rather than a picture of biology, permeabilization is non-uniform and regional comparisons are compromised. Section detachment presents as a region of the array with essentially zero counts that corresponds to tissue in the pre-permeabilization image. The image was taken before the tissue left. This is why keeping a post-protocol image, where the workflow allows it, is useful. Bench discipline that actually matters A short list of practices separates laboratories whose spatial data is reproducible from those whose is not. Run a positive control tissue alongside new samples. A section of a tissue your laboratory knows well — mouse brain is the usual choice, because its anatomy is so well characterized that a layer-specific marker either shows layers or does not — tells you whether a bad result is the sample or the run. Without a control, every failure is ambiguous. Keep timing rigorous. Permeabilization at nine minutes instead of twelve is a twenty-five per cent change in a step with a steep response. Use a timer, one section at a time, and do not batch when the protocol says not to. Record everything. Lot numbers, incubation times actually achieved rather than nominal, room temperature, operator. Spatial protocols have enough steps that reconstructing a failure six weeks later is impossible without notes, and the questions that arise are always about the step nobody thought to record. Do not reuse reagents or slides across days without confirming stability. Enzyme activity drifts, and a pepsin stock that gave twelve-minute optimum last month may not this month. Finally, look at the tissue with your own eyes at every stage where it is visible. The dominant mode of failure in spatial work is a defect that was plainly visible on the slide and that nobody examined, because the workflow is long and the temptation to trust the machine is strong. The slide is the experiment. Look at it. The FFPE slide workflow Probe-based workflows on fixed material follow a different sequence on the slide, and the differences are worth setting out because laboratories moving from fresh-frozen to FFPE often carry over habits that no longer apply. Sections are cut on a microtome at five micrometres rather than ten, floated on a water bath, and mounted. The water bath temperature and float time matter: prolonged floating leaches RNA, and a bath much above 40 °C accelerates it. Sections are dried and then baked briefly to improve adhesion — a step that is standard in histology and that, done too hot or too long, damages RNA. Deparaffinization with xylene or a substitute and graded rehydration follow, then staining and imaging, then decrosslinking: a heated incubation, usually in a citrate or Tris-EDTA buffer at elevated temperature, that reverses formaldehyde adducts and makes the RNA accessible to probes. Decrosslinking is the FFPE analogue of permeabilization in the sense that it is the step most sensitive to tissue and most likely to be the cause of a poor run, but it is far less variable across tissues, which is the practical advantage noted earlier. Overheating or extending it damages morphology and fragments RNA further; under-doing it leaves probes unable to bind. Probe hybridization is then performed overnight — typically sixteen to twenty hours at around 50 °C in a humidified chamber, because evaporation over a long incubation concentrates the hybridization buffer and raises stringency unpredictably. A dried-out slide is a lost sample, and humidity control is the most common cause of FFPE run failure that has nothing to do with the tissue. After hybridization come stringency washes, ligation, and release of the ligated products onto the capture surface. Some commercial workflows separate the stained-and-hybridized slide from the capture slide entirely, using an instrument to transfer the released probe products from a standard glass slide onto the barcoded array. This decoupling is a genuine practical advance: it means the section can be mounted on an ordinary slide, stained and imaged with routine histology equipment, reviewed by a pathologist, and only then committed to a capture area. It also introduces a new registration problem, since the image was acquired on one slide and the capture happened on another, and the transfer geometry must be recorded and accounted for. Manual work versus instrumentation Much of this protocol is manual pipetting under timed conditions, and the variation between operators is not negligible. Two practices reduce it substantially. First, one person should run all sections of a comparative experiment, or operators should be balanced across conditions — an operator effect confounded with treatment is indistinguishable from treatment. Second, where an automated stainer or liquid handler is available for the hybridization and wash steps, use it; the gain is not speed but consistency of incubation times and reagent volumes across a batch. Where manual work is unavoidable, small ergonomic choices matter. Work on one slide at a time through timed steps. Pre-label everything. Lay out reagents in the order they will be used. Keep a printed protocol with checkboxes at the bench rather than relying on memory for a twelve-step sequence with three different incubation temperatures. These sound trivial; the failure they prevent — a step performed out of order or twice — destroys a sample completely and is invisible afterwards. Hashtags: #SpatialTranscriptomics #CellularCartography #SpatialGeneExpression #SpatialRNASequencing #CaptureBasedSpatialTranscriptomics #ImagingBasedSpatialTranscriptomics #SpatialBarcoding #TranscriptLocalization #TissueCartography #SingleCellSpatialAnalysis #SpatialResolution #TranscriptomeBreadth #DetectionSensitivity #TissuePreservation #FreshFrozenTissue #FFPESpatialTranscriptomics #PermeabilizationOptimization #SpatialRegistration #CellSegmentation #SpatialDeconvolution #SpatialStatistics #CellularNiches #TranscriptDiffusion #SpatialQualityControl #FutureOfSpatialTranscriptomics Pasted markdown

Download the Book (PDF): Introduction In 2006, Kazutoshi Takahashi and Shinya Yamanaka reported that four transcription factors, delivered by retrovirus into mouse fibroblasts, were enough to turn a skin cell into something that behaved like an embryonic stem cell. A year later, two groups did the same with human cells: the Kyoto group with OCT4, SOX2, KLF4 and c-MYC, and Junying Yu, James Thomson and colleagues in Wisconsin with OCT4, SOX2, NANOG and LIN28. The phrase "induced pluripotent stem cell" entered the vocabulary of biology, and within a few years a result that had looked like a conjuring trick became a routine laboratory service. A competent technician with a commercial kit can now take a tube of blood from a patient on Monday and, three or four weeks later, be looking at colonies with the tight borders, high nuclear-to-cytoplasmic ratio and prominent nucleoli that everyone in the field recognises on sight. That accessibility has quietly shifted where the difficulty lies. Making iPSCs is no longer the hard part. The hard part is knowing what you have made, proving it to somebody who was not standing at the hood, and keeping it true for the two or three years the line will spend in culture before the experiment that matters gets done. This is a practical guide to that problem. It is organised around a single claim: an iPSC line is not a thing you generate, it is a claim you maintain. The colonies that appear on day 21 are a hypothesis. Every subsequent step — the clone you pick, the passage at which you first freeze, the markers you stain for, the karyotype you order, the way you lift cells off the plate on a Friday afternoon — either strengthens that hypothesis or quietly erodes it. Lines do not fail catastrophically. They drift. A culture acquires a subclone with an extra copy of a small region of chromosome 20, that subclone grows a little faster than its neighbours, and eight passages later it is the culture. Nothing looks different down the microscope. The line still stains beautifully for OCT4 and TRA-1-60. It simply no longer differentiates the way it did, or it does, but with a survival advantage its neighbours lacked, and the phenotype you attribute to your patient's mutation belongs instead to an event that happened in a flask. Three concerns run through the chapters that follow, and they correspond to the three things a laboratory actually has to get right. The first is delivery. Reprogramming requires forcing the expression of factors the cell has switched off, and the mechanism used to do that leaves a mark. Integrating retroviral and lentiviral vectors, which made the field possible, insert DNA semi-randomly into the genome, where it can disrupt genes, reactivate during differentiation, or persist as a low-level source of exogenous factor expression that confounds every downstream assay. Non-integrating methods removed that problem, and the Sendai virus vector — a negative-sense RNA virus that replicates entirely in the cytoplasm, never makes a DNA intermediate, and can be engineered to self-eliminate — has become the workhorse for patient-derived lines. It is efficient enough to work on a millilitre of blood, tolerant enough to work in the hands of a new student, and clean enough that its residue can be demonstrated to be gone. It is not, however, free of consequences, and using it well means understanding its biology rather than following its kit insert. The second is characterization. A line is called pluripotent on the strength of evidence, and the evidence available now is far richer than it was when the field standardised on a photograph of an alkaline-phosphatase-positive colony and a teratoma section. The core pluripotency factors OCT4, SOX2 and NANOG remain the anchors, but each of them is easier to misinterpret than the field's habits suggest: OCT4 antibodies that detect isoforms with no relevance to pluripotency, qPCR primers that cannot distinguish a residual vector transcript from the cell's own transcription, flow cytometry gated to produce the answer everyone expects. Functional assays — embryoid bodies, directed differentiation into the three germ layers, transcriptome-based scoring, and the teratoma assay itself — sit in a hierarchy of cost, rigour and ethical weight, and the honest position is that most laboratories no longer need the most expensive one at the top of it. Knowing which assay answers which question, and which combination is proportionate to what you intend to do with the line, is a large part of competent practice. The third is genomic stability, and it is the concern that has grown most in the last decade. Human pluripotent stem cells are not passive passengers in culture. They have an unusual stress response, a short G1 phase, a low apoptotic threshold, and they sit under constant selection for variants that survive passaging better than their neighbours. The consequence is a catalogue of recurrent abnormalities — gains of 20q11.21, 12p, 17q, 1q, and loss of one X chromosome — that appear again and again across laboratories, because they are not random accidents but adaptations. Karyotyping detects the large ones. It misses the common small one entirely, because a 0.5 megabase gain on 20q is below the resolution of any G-banded spread. Beyond copy number lies a further layer of point mutations in cancer-associated genes, most famously TP53 and BCOR, that no cytogenetic method will see at all. A modern quality-control programme has to be built around what each method can and cannot detect, on a schedule that catches drift before it reaches the experiment. The book is written for the person doing the work: the postdoc setting up derivation in a laboratory that has never done it, the core facility manager writing a service specification, the principal investigator deciding what to demand from a collaborator's line before building three years of work on it. It assumes competence in mammalian cell culture and molecular biology, and no prior experience of pluripotent cells. It is deliberately concrete about the parts that go wrong, because the published protocols are uniformly optimistic and the failure modes are where the expertise lives. Two boundaries are worth stating at the outset. This is a book about making and validating undifferentiated lines, not about differentiating them; the vast literature on directed differentiation into neurons, cardiomyocytes, hepatocytes and organoids appears only where it bears on characterization. And it is a research-laboratory book. The requirements for clinical-grade manufacture — donor eligibility determinations, fully qualified reagents, a manufacturing licence, a regulatory dossier — are discussed in the final chapter because they increasingly shape what reviewers expect even of basic research, but a laboratory intending to put cells into a person needs a quality management system, not a guide. What follows is arranged as the work is done. The first chapter explains what reprogramming actually does to a cell, because almost every practical decision downstream — how many clones to pick, when to pick them, why some fail late — follows from the mechanism. The second concerns the starting material and its provenance. The third and fourth cover Sendai vector delivery and the derivation run itself. The fifth deals with establishing, expanding and banking the line, which is where most avoidable losses occur. The sixth and seventh treat characterization: markers first, then function, including a frank assessment of the teratoma assay. The eighth and ninth address genomic stability — how to detect variants, and how culture practice itself determines how many you get. The tenth asks the question that ought to be asked first: how much of all this any given project actually needs. A closing word about standards. In 2023 the International Society for Stem Cell Research published a set of standards for the use of human stem cells in basic research, the first serious community attempt to say what minimum characterization a published line should have behind it. Journals have begun to reference it. It is short, free, and worth reading alongside this book, because the argument here is essentially the argument it makes: the credibility of work done with these cells rests on evidence that most laboratories could generate and many do not. Chapter 1: What Reprogramming Actually Does A reprogramming experiment is one of the few procedures in cell biology where the operator's mental model of the mechanism directly determines the quality of the product. Almost every decision that separates a good derivation from a mediocre one — how long to wait before picking, how many clones to take, which colonies to reject on sight, why a line that looked perfect at passage 5 fails a differentiation assay at passage 25 — follows from what is happening inside the cells during those three weeks. So it is worth spending a chapter on the biology before touching a pipette. The problem the cell has to solve A somatic cell's identity is not stored in its genome, which is essentially the same in every cell of the body, but in the configuration of that genome: which enhancers are open, which promoters carry repressive marks, which transcription factors are present in sufficient concentration to occupy their sites, and which higher-order chromatin structures hold the whole arrangement in place. A dermal fibroblast maintains itself because the network of factors it expresses reinforces its own expression and represses alternatives. This is a stable attractor state, robust to ordinary perturbation, which is the point: tissues would not work if cells wandered between identities. Reprogramming asks the cell to leave that attractor and enter another one — the pluripotent state characteristic of the epiblast, in which the genome is broadly permissive, most developmental genes sit in a poised configuration, and the cell can generate derivatives of all three embryonic germ layers. Nothing in the fibroblast's programme is designed to permit this. The factors that are introduced have to act against chromatin that is closed at the sites they need, against a transcriptional network that is actively repressing the pluripotency programme, and against cell-intrinsic barriers — senescence, apoptosis, the p53 pathway — that treat the attempt as damage. That is why the process is so inefficient. In the original human experiments, the yield was in the region of one colony per ten thousand starting cells. Modern methods have improved on that by one to two orders of magnitude, but the fundamental picture remains: the great majority of transduced cells do not become iPSCs. They die, they stall in an intermediate state, or they carry on being fibroblasts with some ectopic transcription factor expression. The ones that succeed are not typical cells that received a typical dose. Understanding why matters, because the rare cell that completes the journey is the cell you will be culturing for the next three years. The four factors and what each contributes The classic combination — OCT4, SOX2, KLF4 and c-MYC, conventionally abbreviated OSKM — was found by elimination from a panel of twenty-four candidate genes. It is not a unique solution. Human cells can be reprogrammed with OCT4, SOX2, NANOG and LIN28; c-MYC can be dropped, at a cost in efficiency but with a gain in the quality of the resulting lines, as Nakagawa and colleagues showed in 2008; L-MYC or the more stable c-MYC variants can be substituted; and a purely chemical cocktail with no exogenous transcription factors at all has now been shown to reprogram human somatic cells, reported by Guan and colleagues in 2022. But OSKM remains the practical standard, and the division of labour within it is instructive. OCT4 (encoded by POU5F1) is the one factor that has proved essentially irreplaceable in standard protocols. It is a POU-domain factor that, in partnership with SOX2, binds a composite motif found in the regulatory regions of the pluripotency network's own genes, including NANOG and POU5F1 itself. Its dose matters in both directions: too little and pluripotency is not established or maintained, too much and cells differentiate towards primitive endoderm and mesoderm. SOX2 co-binds with OCT4 at those composite sites and has a second role in suppressing alternative lineage programmes. In reprogramming it also contributes to the reactivation of endogenous SOX2, which is required once the exogenous factors disappear. KLF4 is best understood as a chromatin opener and a mesenchymal suppressor. Together with OCT4 and SOX2 it behaves as a pioneer-like factor, engaging target sites in nucleosomal DNA that are inaccessible to most transcription factors, and initiating the opening of enhancers that the somatic cell had closed. It also drives elements of the epithelial programme that the starting fibroblast lacks. c-MYC does not bind the pluripotency network in the same way. Its contribution is largely to proliferation and metabolism: it accelerates the cell cycle, promotes the glycolytic shift the pluripotent state requires, and amplifies transcription at already-active promoters. It raises efficiency several-fold and it raises risk in proportion — MYC reactivation from integrated vectors was the cause of tumours in early mouse chimaera work, and it is one reason non-integrating delivery matters. Two phases, and the roadblock between them Careful time-course studies in mouse cells, notably by Polo and colleagues in 2012, established that reprogramming proceeds in phases with distinguishable molecular signatures, and human cells follow a broadly similar course on a longer timescale. The early phase begins within a day or two of factor expression. Cells that will go on to reprogram divide faster, shrink, and lose their fibroblastic morphology. The most consistent early event in fibroblast reprogramming is a mesenchymal-to-epithelial transition: downregulation of SNAIL, SLUG and TGF-beta signalling, upregulation of E-cadherin and epithelial cell adhesion molecule. Somatic genes are switched off, and this happens efficiently and in most cells. Histone modifications begin to change at thousands of loci. The late phase is the establishment of the pluripotency network itself, and it is where almost everything fails. Endogenous POU5F1, SOX2, NANOG, and the surface antigens TRA-1-60 and SSEA-4 come on. DNA methylation is erased at the promoters and distal enhancers of pluripotency genes — a slow, largely passive process requiring repeated division. In female cells the inactive X chromosome reactivates, at least partially. Telomerase is upregulated and telomeres lengthen. Only cells that complete all of this become genuinely self-sustaining. Tanabe, Takahashi and colleagues made the important point for human cells in 2013: the rate-limiting step is not initiation but maturation. Many human fibroblasts enter the process — measured by the appearance of intermediate surface-marker profiles — and comparatively few complete it. Cells stall in a partially reprogrammed state that can persist for weeks, dividing, forming colonies that a novice will pick, and expressing some but not all of the network. This has two direct practical consequences. First, colony morphology alone is not a sufficient selection criterion, because partially reprogrammed colonies can look convincingly like the real thing at low magnification. Live-cell staining for TRA-1-60, introduced for this purpose by Chan and colleagues in 2009, distinguishes them far better than morphology does, and remains the single most useful cheap addition to a picking protocol. Second, patience pays: picking too early enriches for intermediates, because fully reprogrammed colonies take longer to appear than partial ones in many protocols. Why the successful cells are unusual If a defined dose of factors produced a defined outcome, reprogramming would be efficient. It is not, and two broad explanations have been argued over for years. The elite model holds that a rare subpopulation in the starting culture is uniquely competent. The stochastic model holds that most cells are competent in principle but each must pass through a series of low-probability events, so that success is a matter of chance and time. The weight of evidence — particularly from clonal tracking in mouse systems, where nearly all daughter cells of an expanded clone will eventually yield iPSCs given enough time — favours the stochastic account, with the important qualification that the probability per cell is not uniform: proliferation rate, cell cycle length, and the specific somatic cell type all shift it. For the person at the bench the lesson is that the variables which raise efficiency are mostly the ones that raise the number of divisions a transduced cell completes in a permissive environment. Fresh, low-passage starting material with plenty of proliferative capacity left in it. Adequate but not toxic factor expression. Culture conditions that reduce stress: physiological oxygen tension, around 5 per cent, which Yoshida and colleagues showed improves efficiency; ascorbate, which Esteban and colleagues showed acts in part by supporting the dioxygenase enzymes that remove repressive histone and DNA methylation marks; and avoidance of anything that provokes the p53–p21 response, which acts as a brake on reprogramming, as Hong and colleagues demonstrated in 2009. That last point deserves a caution rather than a recommendation. Suppressing p53 dramatically increases reprogramming efficiency, and a transient knockdown delivered on a self-eliminating episomal vector is a standard component of one widely used plasmid method. It also, for as long as it lasts, removes the surveillance mechanism that eliminates cells with damaged genomes. Transient suppression that disappears with the vector is defensible; stable or prolonged suppression, by integrated short hairpin RNA or by any means that persists into the established line, is not, and lines made that way should be assumed to carry more mutations than their unsuppressed counterparts. What the finished cell retains A fully reprogrammed human iPSC line is remarkably similar to a human embryonic stem cell line by every global measure applied so far: transcriptome, methylome, differentiation capacity, growth requirements. The differences that were reported with some fanfare in 2010 and 2011 — distinct gene expression signatures, aberrant methylation at specific loci, a characteristic profile of copy number change — have largely resolved, on larger sample sizes, into differences between lines rather than between classes of line. The variation among independent iPSC lines from different donors is greater than the average difference between iPSCs and embryonic stem cells, and donor genetic background accounts for a substantial share of it, as the HipSci consortium demonstrated in 2017 by profiling hundreds of lines from dozens of donors. Two residual phenomena still matter practically. The first is epigenetic memory: early-passage iPSCs retain DNA methylation patterns characteristic of their tissue of origin, which biases their differentiation towards related lineages. Kim and colleagues showed this in 2010 for mouse cells, where blood-derived iPSCs differentiated more readily to blood; Polo and colleagues showed the same year that the bias diminishes with continued passage. In human cells the effect is real but modest, and largely resolves by passage 15 to 20. It is a reason to characterise and to use lines at comparable, and not extremely early, passage numbers when comparing across donors. The second is that reprogramming does not clean the genome. Whatever mutations the starting cell carried — and a fibroblast from a sun-exposed forearm of a sixty-year-old carries thousands of somatic point mutations — are captured in the clone, along with any that arise during the process itself. Reprogramming is a cloning event, and cloning fixes what was previously diluted in a population. Chapter 8 returns to this at length. It is the single most underappreciated fact about the technique: the line is one cell's genome, not the donor's. Primed and naive states One further piece of context matters for anyone reading the current literature. Conventional human iPSC and embryonic stem cell lines are not equivalent to mouse embryonic stem cells. They correspond to a later developmental stage — the post-implantation epiblast rather than the pre-implantation inner cell mass — and are described as being in a primed state. Mouse embryonic stem cells sit in an earlier, naive state. The two differ in almost every practical respect: naive cells grow as domed colonies and depend on leukaemia inhibitory factor and inhibitors of two kinase pathways, while primed cells grow as flat colonies and depend on fibroblast growth factor and transforming growth factor beta signalling. Naive cells tolerate single-cell dissociation far better. In female lines, naive cells carry two active X chromosomes, while primed cells carry an inactivated X that is prone to further epigenetic change in culture. Protocols now exist to convert primed human cells to a naive-like state, and naive human lines have properties that are attractive for some applications: better clonogenicity, a more open epigenome, and greater competence for certain early lineages, including extraembryonic ones. They also come with their own problems, notably a tendency to lose genomic imprints, and they are not interchangeable with primed lines in differentiation protocols developed for the conventional state. For the practical purposes of this book, everything that follows concerns primed human cells, because those are what a standard reprogramming protocol produces and what every established differentiation protocol assumes. The distinction is worth holding in mind mainly to avoid a specific confusion: results and protocols from the mouse field, including claims about dissociation tolerance, clonal efficiency and culture stability, do not transfer to human primed cells, and the differences between the two states account for much of the divergence between what the mouse literature promises and what a human culture delivers. The practical upshot If reprogramming is a low-probability, multi-step exit from a stable attractor, then a derivation run is a screen, not a synthesis. You are not manufacturing iPSCs; you are creating conditions in which a handful of cells out of a hundred thousand will find their way to a new stable state, and then selecting among the survivors. That framing makes the rest of the workflow obvious. Start with healthy, proliferative, well-documented material. Deliver the factors in a way that is strong enough to work and clean enough to leave no trace. Wait longer than feels comfortable. Select on evidence rather than appearance, and take more clones than you think you need, because some of them will be partial, some will be abnormal, and some will simply be bad at differentiating for reasons nobody will ever determine. Then prove what you have. Chapter 2: Choosing and Collecting the Starting Material The quality of an iPSC line is bounded by the quality of the tissue it came from, and by the quality of the paperwork that came with it. Both are easier to get right before collection than to repair afterwards, and both are routinely neglected by laboratories eager to get to the interesting part. This chapter covers the choice of somatic source, the practicalities of collecting and preparing it, and the provenance record that has to travel with every line for as long as it exists. The main sources Almost any proliferating human somatic cell can be reprogrammed, and at one time or another keratinocytes, hepatocytes, dental pulp cells, amniotic cells and cord blood have all been used. In practice, patient-derived work has converged on four sources, which differ in how invasive the collection is, how much preparation they need, how efficiently they reprogram, and what genomic baggage they carry. Dermal fibroblasts were the original human source and remain the reference point. A 3 to 4 millimetre punch biopsy, usually from the inner upper arm to minimise sun exposure, is taken under local anaesthetic, cut into fragments, and placed under a coverslip or in a small volume of medium to allow outgrowth. Fibroblasts migrate out over one to three weeks and are expanded for several more before there are enough to freeze a bank and reprogram. They are robust, easy to culture, and reprogram reliably with every major method. Their drawbacks are the invasiveness of the biopsy, the four to six weeks of culture before reprogramming can begin, and the fact that culture itself exerts selection on the starting population before a single factor is delivered. Peripheral blood mononuclear cells have become the default for large cohort work. A 5 to 10 millilitre venepuncture yields more than enough material; the cells are separated on a density gradient and either reprogrammed after a short expansion or frozen. Within the mononuclear fraction, two populations dominate the reprogramming outcome. Activated T cells reprogram readily and were among the first blood cells converted using Sendai vectors, by Seki and colleagues in 2010, but they carry rearranged T-cell receptor loci, which are permanent and which mark every cell of the resulting line. Erythroblasts, expanded over about a week in a cytokine cocktail from the same mononuclear fraction, avoid that rearrangement, reprogram efficiently, and have become the preferred blood route for laboratories that care about a germline-configuration genome. CD34-positive progenitors from mobilised blood or cord blood reprogram exceptionally well but require either a leukapheresis product or banked cord units. Urine-derived renal epithelial cells are the least invasive source available. Cells shed from the urinary tract in a clean-catch sample can be expanded and reprogrammed, a route described by Zhou and colleagues in 2011. Collection requires no clinician, no needle and no ethical discomfort about taking tissue from children. The trade-offs are practical: yields vary enormously between donors and between samples from the same donor, contamination is a constant risk, and a proportion of samples simply fail to produce outgrowth. For paediatric studies and for cohorts recruited remotely, the convenience often outweighs the failure rate. Keratinocytes, cultured from plucked hair follicles, sit in a similar niche — non-invasive collection, higher reprogramming efficiency than fibroblasts, but demanding culture requirements and a heavy mutational burden in donors with significant sun exposure. Table 1 sets out the comparison that matters when a project is being designed. Table 1. Somatic sources for patient-derived reprogramming. Source Collection Time to readiness Key advantage Key limitation Dermal fibroblast Punch biopsy, clinician 4-6 weeks outgrowth and expansion Robust, reference behaviour Invasive; UV-associated mutations Peripheral blood T cell 5-10 mL venepuncture 3-5 days activation Simple, high efficiency Permanent TCR rearrangement Peripheral blood erythroblast 5-10 mL venepuncture 7-10 days expansion Germline-configuration genome Cytokine cost; expansion step Urine renal epithelial Clean-catch sample 2-3 weeks outgrowth Wholly non-invasive Variable yield; contamination risk Keratinocyte (plucked hair) Hair pluck 2-3 weeks outgrowth Non-invasive, efficient Demanding culture; UV mutations Age, tissue and the mutations you inherit Every somatic cell carries a private history of mutation. A skin fibroblast from an elderly donor may carry several thousand single-nucleotide variants not present in the germline, heavily enriched for the ultraviolet signature of cytosine-to-thymine changes at dipyrimidine sites. Blood cells accumulate mutations too, at a lower rate and with a different spectrum, and haematopoietic clones carrying driver mutations in genes such as DNMT3A and TET2 become common in later life. Reprogramming clones a single cell, so whatever that cell carried is present in every cell of the line, at a fixed and usually heterozygous state rather than diluted across a population. This is the origin of much of the apparent mutational burden attributed to reprogramming itself. When Gore and colleagues and Hussein and colleagues reported in 2011 that iPSC lines carried protein-coding point mutations and copy number variants absent from the donor, the natural reading was that the process is mutagenic. Subsequent work complicated it: Kwon and colleagues showed in 2017 that fibroblast subclones from the same starting population — never exposed to reprogramming factors — contain comparable numbers of sequence variants, and Sugiura and colleagues showed in 2014 that most of the variants detectable in iPSC lines are pre-existing in the donor tissue rather than generated during conversion. Some mutations do arise during reprogramming and early expansion, but the dominant term is inheritance from the founder cell. The practical implications are unglamorous and important. Prefer younger donors where the design allows. Prefer minimally sun-exposed skin, or blood over skin, when mutational burden matters. Reprogram at the lowest feasible passage of the starting culture. And where a variant of interest is being studied, confirm it in the parental tissue as well as in the line, because a line is a single cell's genome and single cells are not representative. Disease cohorts and the control problem Most patient-derived work compares lines from affected individuals with lines from controls, and the comparison is much weaker than it looks. Donor-to-donor genetic variation produces large differences in differentiation propensity, growth rate and gene expression — differences that will swamp the effect of most disease alleles. The HipSci study quantified this directly: a substantial fraction of the variance in iPSC molecular phenotypes tracks with donor genotype rather than anything about the line's derivation. Three designs mitigate it. The strongest is isogenic comparison, in which the variant is corrected, or introduced, by genome editing in a single line, so that the only difference between the compared cells is the base or bases in question. The second is a family-based design using unaffected relatives, which controls part of the genetic background. The third, applicable when neither is possible, is to use enough independent donors on each side that the effect is tested against real between-donor variance. Multiple clones from one donor do not substitute; they measure clone-to-clone variation, which is a different and smaller source of noise. Both should be built into the recruitment plan, because the number of donors is decided when the cohort is collected, not when the data are analysed. Consent, provenance and the ethical architecture An iPSC line is immortal, genetically identifiable, potentially distributable to laboratories the donor will never hear of, and capable in principle of being differentiated into almost any tissue, including gametes and embryo models. Consent forms written for tissue collection do not cover this, and retrofitting consent to an established line is often impossible if the donor cannot be recontacted. Consent taken for the derivation of pluripotent lines should address, in language the donor can act on, the derivation and indefinite propagation of the line; genome-wide sequencing and the deposition of genotype data in controlled-access databases; distribution to other researchers, including commercially, and the fact that the donor will have no claim on resulting products; the possibility of incidental findings and whether they will be returned; the practical limits on withdrawal once lines have been distributed; and any specific uses the institution wishes to exclude, such as transplantation into animals, gamete derivation or embryo-model research. The International Society for Stem Cell Research guidelines, revised in 2021, set the framework most institutions follow, and national requirements vary enough that an institutional review or ethics committee must approve the specific form. Provenance is the other half. Each line needs a unique, stable identifier, and the community standard is registration with the human pluripotent stem cell registry hPSCreg, which assigns names in a controlled format and is now required by many journals and funders. Registration links the line to its donor consent status, derivation method and characterization data, and prevents the recurring problem of two laboratories using different names for the same cells or the same name for different cells. Donor identity must be verifiable independently of paperwork. Short tandem repeat profiling of the starting material, banked alongside the sample, provides the reference against which the derived line — and every subsequent vial of it — can be authenticated. Mixed-up and cross-contaminated lines are not rare; they are a documented and recurring problem across cell biology, and the only defence is a genotype record made at the beginning. Handling the sample Three practical points cause most of the avoidable losses. Blood must be processed quickly. Mononuclear cell recovery and viability fall measurably after about 24 hours in a collection tube at room temperature, and 8 to 12 hours is a much safer target. For multi-site collections, this usually means either shipping the same day on a courier with a hard deadline, or processing locally and shipping frozen mononuclear cells in liquid nitrogen vapour phase — the latter being more reliable and, over a large cohort, cheaper than repeated failed shipments. Skin biopsies tolerate overnight transport in medium at 4 degrees. They do not tolerate drying, and they should not be frozen. Outgrowth is improved by cutting the tissue into small pieces and ensuring good contact with the plastic. Everything must be tested for mycoplasma before it enters the pluripotent stem cell culture area, and again on the established line. Mycoplasma contamination is invisible, changes metabolism and differentiation behaviour, and spreads through shared incubators and media bottles. A single contaminated primary culture can cost a laboratory months. Testing at receipt, at the point of freezing the primary bank, and quarterly on cultures in use, with a strict quarantine for incoming material, is the minimum defensible practice. Cohorts, sites and the logistics that decide success Once a project moves beyond a handful of donors, the limiting factor stops being biology and becomes logistics. Three arrangements determine whether a multi-site collection yields usable lines. Who collects, and with what training. A clinician taking a skin biopsy for histology will place it in formalin unless told otherwise, and a phlebotomist will use whichever tube is nearest. Collection kits should be assembled centrally, pre-labelled with the study's coded identifiers, and supplied with a one-page instruction sheet and the correct tubes — heparin or citrate rather than EDTA for mononuclear cell isolation, since EDTA impairs recovery in some protocols — along with a pre-paid courier label and a telephone number. Every element left to the collecting site's discretion is an element that will vary. When collection happens. Samples taken on a Friday afternoon arrive on Monday. Restricting collection to Monday through Wednesday, with a stated cut-off time, removes the largest single cause of failed arrivals, and costs nothing but coordination. What happens on arrival. A sample that arrives while the person who processes it is on holiday is a lost sample. Receipt, processing, cryopreservation and the logging of an identifier should be a defined workflow with a named deputy, and the processing capacity should be sized to the recruitment rate rather than to the best week. Two donor populations deserve specific mention. Paediatric collection is where urine-derived and hair-follicle routes earn their place, because the consent conversation for a non-invasive sample is entirely different from that for a biopsy, and assent from a child who has watched a needle approach is not reliably obtained. Rare disease cohorts, where donors may be geographically scattered and few in number, benefit disproportionately from the same routes, since a donor can be recruited and sampled without travelling to a clinic — and in a cohort of eight patients worldwide, a sample that fails is not replaceable. The record that travels with the line By the time reprogramming begins, a file should exist that can be handed to a collaborator, a regulator or a journal five years later. It should contain the approved protocol and consent form version under which the sample was taken; the donor's age at collection, sex, reported ancestry and relevant clinical or genetic information, recorded against a coded identifier rather than a name; the tissue type and collection date; the passage number and culture history of the starting material; the mycoplasma results; the STR profile; and the reagent lots used. None of this is difficult. All of it is nearly impossible to reconstruct afterwards, and its absence is the commonest reason a perfectly good line cannot be deposited in a public repository or used in work intended for translation. Chapter 3: Sendai Virus Vectors and the Non-Integrating Turn For the first two years of the field, every human iPSC line was made with a vector that inserted itself into the genome. Retroviral and lentiviral delivery worked, and it was the only thing that did, but it made the product permanently suspect. Integration sites are semi-random and multiple; a line might carry ten or twenty proviral copies scattered through its genome, any of which could disrupt a gene, alter the regulation of a neighbouring one, or — the most insidious problem — fail to silence completely, leaving a trickle of exogenous OCT4 or c-MYC expression that colours everything the line subsequently does. Silenced proviruses can also reactivate during differentiation, and in mouse chimaera experiments c-MYC reactivation produced tumours. Anything intended for therapeutic use was out of the question, and even for research the ambiguity was corrosive: a phenotype in a line with an integration in the wrong place is not a phenotype of the donor's genotype. The field's response was a decade of work on delivery methods that leave nothing behind. Four survive in general use: Sendai virus vectors, episomal plasmids, synthetic modified mRNA, and — newest and least established — small-molecule cocktails. Sendai vectors are the most widely used for patient-derived lines, and understanding why requires knowing something about the virus. What Sendai virus is Sendai virus, also called murine parainfluenza virus type 1, is a member of the Paramyxoviridae. Its genome is a single molecule of negative-sense, single-stranded RNA of about 15,400 nucleotides, encapsidated along its whole length by nucleoprotein and carried into the cell together with the viral RNA-dependent RNA polymerase. Three features of this biology make it an unusually good reprogramming vector. First, the entire replication cycle takes place in the cytoplasm. Paramyxoviruses have no nuclear phase, no DNA intermediate, and no integrase. There is no mechanism by which sequence from a Sendai vector can enter the host genome. This is not a matter of low probability, as it is for plasmid or transposon systems, where integration is rare but real; it is a structural property of the virus. A line made with Sendai vectors can be certified free of vector sequence by demonstrating clearance of the RNA, without any need to exclude integration events. Second, the virus replicates its genome to high copy number and drives very strong transcription from the inserted genes. Reprogramming needs sustained, high-level factor expression over one to two weeks — longer than a transient plasmid transfection provides, and without the daily re-dosing that mRNA requires. Sendai vectors deliver exactly that from a single application. Third, Sendai virus infects a broad range of human cell types, including cells that are notoriously hard to transfect. It enters through sialic-acid-containing receptors present on essentially all of them. Blood cells, which resist plasmid electroporation and tolerate it badly, are efficiently transduced. This is the property that made single-tube blood reprogramming routine. The virus itself is a mouse respiratory pathogen and does not cause human disease. Vectors used for reprogramming are additionally crippled: the fusion protein gene is deleted, so that particles produced by transduced cells cannot spread to new cells, and the particles must be manufactured in a packaging line that supplies the missing protein. From virus to reprogramming kit Fusaki, Ban, Hasegawa and colleagues published the first Sendai-based reprogramming vectors in 2009, and the commercial product derived from that work has dominated ever since. The important development came in 2011, when Ban and colleagues reported vectors carrying temperature-sensitive mutations in the polymerase-associated genes. These replicate at 37 degrees but are progressively lost when cultures are shifted to 38 or 39 degrees, which turns vector clearance from a waiting game into something the operator can drive. The current generation of the commercial kit supplies three vectors: a polycistronic construct encoding KLF4, OCT4 and SOX2 in a single transcript, a separate c-MYC vector, and a separate KLF4 vector, with the ratio between them set to a stoichiometry that favours reprogramming. They are supplied frozen at defined titres and applied at a combined multiplicity of infection typically in the range of 3 to 10 infectious units per cell, with the exact optimum depending on cell type. Two properties of the system matter at the bench. The vectors are diluted out by cell division rather than actively destroyed, so clearance depends on how fast the culture grows, and the c-MYC vector is usually lost first while the polycistronic construct persists longest. And the transduction itself is a stress: at high multiplicity, cells detach, die, or arrest, and yields fall. Overdosing is a more common error than underdosing. The alternatives, honestly assessed Sendai vectors are not the only defensible choice, and for some applications they are not the best one. Table 2 compares the four non-integrating approaches on the criteria that decide between them. Table 2. Non-integrating reprogramming methods compared. Method Typical efficiency (fibroblast) Residual material to clear Hands-on burden Best suited to Sendai virus vector 0.1-1% Cytoplasmic RNA, 8-15 passages Single application Blood, small samples, routine derivation Episomal plasmid (oriP/EBNA1) 0.001-0.1% Extrachromosomal DNA, tested by PCR One or two nucleofections Low-cost, large cohorts, GMP routes Synthetic modified mRNA 1-4% None Daily transfection, 10-16 days Footprint-free requirement, fibroblasts Small-molecule chemical Low, protocol-dependent None Long, multi-stage protocol Research into mechanism; not yet routine Episomal plasmids use the Epstein-Barr virus oriP element and the EBNA1 protein to replicate once per cell cycle without integrating, delivered by nucleofection. Okita and colleagues refined a widely used combination in 2011 that includes short hairpin RNA against TP53 to relieve the p53 brake, along with L-MYC and LIN28. Plasmids are cheap, easy to store, and readily made to clinical-grade standards, which is why several manufacturing routes use them. Efficiency is lower than Sendai, nucleofection is hard on primary blood cells, and the vectors must be shown to be absent by PCR because low-frequency integration does occur. Synthetic modified mRNA, described by Warren and colleagues in 2010, delivers the factors as mRNA modified with pseudouridine and 5-methylcytidine to blunt the innate immune response, transfected daily for two weeks. It is the only method that leaves absolutely nothing to clear, and its efficiency in fibroblasts is the highest of any approach. It is also the most laborious: daily transfections, interferon suppression, and a protocol that is unforgiving of interruption. It works poorly in blood cells. For a laboratory making a handful of fibroblast lines where footprint-free status must be unimpeachable, it is excellent; for a cohort of two hundred blood samples it is impractical. Chemical reprogramming replaces the transcription factors entirely with defined small molecules. Guan and colleagues reported a route for human somatic cells in 2022, driving the cells through a staged protocol that passes via a plastic intermediate state before pluripotency is established. It is a significant piece of biology and a plausible manufacturing route in the long run. It is not yet a routine method: the protocols are long, the efficiency modest, and independent replication is still accumulating. The most useful head-to-head comparison remains that of Schlaeger and colleagues in 2015, who ran Sendai, episomal, mRNA and lentiviral methods in parallel in one laboratory. Sendai and episomal vectors were the most reliable across cell types and operators; mRNA gave the highest efficiency in fibroblasts but failed frequently and was very sensitive to operator technique. Little has happened since to overturn that summary. Biosafety and handling Replication-deficient Sendai vectors are handled in most jurisdictions at biosafety level 2, in a class II cabinet, with the precautions applied to any viral vector. Institutional biosafety committees vary in their view, and the classification should be confirmed locally before the first vial is opened rather than after. Transduced cultures should be treated as vector-containing until clearance has been demonstrated, and kept physically separate from established vector-free lines. The vector stocks themselves are sensitive to freeze-thaw cycles; they arrive as single-use aliquots at a stated titre and should be thawed rapidly, used immediately, and never refrozen. Titre is quoted in infectious units per millilitre on the certificate of analysis for the specific lot, and it varies between lots by enough that recalculating the volume for each new lot is not optional. The multiplicity of infection is the one number the operator sets, and it is the commonest thing to get wrong. The calculation is straightforward — volume of vector equals the desired multiplicity multiplied by the cell number, divided by the titre — but the cell number in it must be the number of cells actually present at transduction, not the number seeded two days earlier. Fibroblasts seeded at 100,000 per well and transduced 48 hours later may be 250,000 cells. Using the seeding number delivers less than half the intended dose. Counting a representative well on the day is worth the ten minutes it takes. A fibroblast derivation, day by day The following is the shape of a standard run rather than a protocol to follow verbatim; the kit insert and the published protocols give exact volumes, and local adaptation is normal. Day minus 2. Seed fibroblasts from a low-passage, mycoplasma-negative, actively growing culture into two or three wells of a 6-well plate, at a density that will reach roughly 50 to 70 per cent confluence at transduction. Setting up more than one well at different densities is cheap insurance, since density at transduction is the variable that most often explains why a run fails. Day 0. Count a spare well. Thaw the vectors, calculate volumes, add them to fresh medium and apply. Leave the cultures undisturbed overnight. Day 1. Replace the medium to remove the vector. Cells often look stressed; some death is expected and acceptable. Days 2 to 6. Feed with fibroblast medium every other day. The culture will typically become dense and morphologically heterogeneous. Nothing that looks like a colony should be expected yet. Day 7. Harvest the whole culture and replate onto the matrix and medium the line will live in — vitronectin or laminin-511 fragment coating with a defined medium such as E8, or a comparable commercial equivalent. Replating at a defined density, usually in the tens of thousands of cells per well of a 6-well plate, is what determines whether the emerging colonies are well separated and pickable. Too dense and the colonies merge, and clonality is lost before it is established. Days 8 to 20. Feed daily with pluripotent stem cell medium. Small compact colonies appear from around day 12, and grow over the following week. Mixed colonies — transformed-looking, granular, loosely bordered — will also appear, and outnumber the good ones. Days 21 to 28. Pick. Colonies should be compact, with a sharp border, tightly packed cells, high nuclear-to-cytoplasmic ratio and visible nucleoli, and ideally should have been confirmed as TRA-1-60-positive by live staining. Pick more than you need: twelve to twenty-four colonies for a line that will eventually be represented by three clones is a normal ratio, because attrition over the next month is heavy. For blood-derived reprogramming the shape differs mainly at the front. Mononuclear cells are expanded for four to ten days in a cytokine medium — the erythroblast route uses stem cell factor, interleukin-3, erythropoietin, insulin-like growth factor 1 and dexamethasone — then transduced in suspension, and plated onto matrix a day or two later. Colonies typically appear from around day 14 to 21. Beers and colleagues published a well-tested chemically defined version of this workflow in 2015 that many laboratories have adopted more or less unchanged. Clearance: proving the vector has gone A Sendai-derived line is not finished until the vector is undetectable. Clearance is normally achieved by passage alone: the replicating RNA is diluted between daughter cells, and by passage 8 to 12 most clones are clean. Some are not, and a minority of clones retain vector for many passages — occasionally because the cells grow slowly, occasionally for reasons that are not understood. Three tools are available. Passage and wait. The default. Cheap, requires only patience, and works for the large majority of clones. Temperature shift. With temperature-sensitive vectors, culturing at 38 to 39 degrees for five to seven days accelerates loss substantially. Cells tolerate this poorly and some clones are lost, so it is best held in reserve for clones that are otherwise good but stubbornly positive. Selection at the outset. Picking later, and preferring colonies that arose later, tends to yield clones with lower vector burden. Testing is by reverse-transcription PCR on total RNA, using primers against the Sendai genomic backbone — the standard target is a region of the viral genome common to all three vectors — with separate primers against KLF4, OCT4-SOX2 and c-MYC transgene sequences if a per-vector answer is wanted. Positive controls matter: a transduced culture at day 7 as a positive, a known-clean line as a negative, and a housekeeping amplicon to confirm RNA integrity. A clearance call made without a positive control on the same plate is worthless, because a failed reaction and a clean line look identical. Two practical cautions. First, test at the passage you intend to bank, and retest the thawed bank, because a result at passage 8 does not certify a vial frozen at passage 12 that was expanded separately. Second, do not accept a faint band as negative. Either it is clean or it needs more passages. When a run fails Failure is common enough that a diagnostic habit is worth having. If nothing at all appears by day 25, the usual causes in order of frequency are starting material that was too old, too confluent or too slow-growing; a miscalculated or degraded vector dose; a transduction density far from optimum; and a medium or matrix problem that would also affect an established line. Running a known-good fibroblast strain in parallel with any new donor sample separates the sample from the system, and is the single most informative control in the whole workflow. If colonies appear but none survive picking, the problem is almost always handling: picking too small, dissociating too harshly, omitting a Rho-associated kinase inhibitor at the moment of transfer, or plating single cells onto a matrix that was not properly coated. If colonies appear, expand, and then differentiate spontaneously or collapse at passage 3 to 5, they were probably partially reprogrammed. That is not a technique failure; it is the expected fate of a fraction of picked colonies, and the reason to pick generously. Hashtags: #StemCellReprogramming #InducedPluripotentStemCells #IPSCGeneration #CellularReprogramming #OSKMFactors #SendaiVirusVectors #NonIntegratingReprogramming #SomaticCellSources #PeripheralBloodReprogramming #FibroblastReprogramming #PluripotencyMarkers #PluripotencyCharacterization #FunctionalPluripotency #EmbryoidBodies #ThreeGermLayers #GenomicStability #CopyNumberVariants #RecurrentGenomicAbnormalities #TP53Mutations #CellLineAuthentication #STRProfiling #MycoplasmaTesting #EpigeneticMemory #StemCellQualityControl #FutureOfIPSCResearch

Download the Book (PDF): Introduction In the autumn of 1936 the Literary Digest, then one of the most widely read magazines in the United States, mailed roughly ten million straw-poll ballots to Americans whose names it had gathered from its own subscriber lists, telephone directories, and automobile registrations. Something over two million came back. On the strength of that enormous return the magazine predicted that Alf Landon would defeat Franklin Roosevelt comfortably. Roosevelt won forty-six of the forty-eight states and about sixty-one percent of the popular vote. The Digest never recovered its reputation and ceased publication within two years. The story is usually told as a lesson about sampling frames: in the depths of the Depression, people who owned telephones and cars were richer than the electorate as a whole, and richer voters leaned Republican. That explanation is part of the truth. But when the political scientist Peverill Squire re-examined the episode using a Gallup survey conducted in 1937, he found that the frame alone would not have produced so large an error. The larger problem was who chose to send the ballot back. Landon supporters, motivated by opposition to the incumbent, returned their ballots at higher rates than Roosevelt supporters on the same lists. The Digest suffered at least two distinct failures at once — a frame that did not cover the population and a response process that selected on the very thing being measured — and more than two million returned ballots could not compensate for either. That same year a young market researcher named George Gallup predicted Roosevelt's victory with a sample that was a small fraction of the size of the Digest's. His method, quota sampling, was not a probability design, and it would fail in its turn in 1948 when every major poll called the presidential race for Thomas Dewey. The pattern that runs through these episodes — large numbers failing where smaller, better-designed efforts succeed, and methods that work for a while and then break without warning — is the subject of this book. The argument The controlling idea of what follows can be put in one sentence. A survey estimate is the end of a long chain of decisions, from defining the population to adjusting the final weights, and its accuracy is governed by the sum of the errors introduced at every link, not by the size of the sample or the sophistication of any single step. The discipline that organises this idea is called Total Survey Error, and it is the frame for everything that follows. Three consequences follow from taking that idea seriously, and together they form the spine of the book. The first is that errors come in two families that must be managed together. Some errors concern who is measured: whether the list from which people are drawn includes everyone it should, whether chance in the selection process produces an unlucky sample, whether the people who respond differ from those who do not, and whether the adjustments made afterwards correct or compound those differences. Others concern what is measured: whether a question captures the concept the researcher had in mind, whether respondents understand it, recall the relevant facts, and report them honestly, and whether the answers are recorded and coded without distortion. A survey can have a flawless sample and useless questions, or perfect questions asked of the wrong people. Neither half compensates for the other. The second is that probability sampling remains the anchor of the field, not out of tradition but because it is the only design in which the relationship between the sample and the population is established by the researcher rather than assumed. When every member of the population has a known, non-zero chance of selection, the uncertainty in the resulting estimates can be calculated from the design itself. Every other approach — quota samples, opt-in online panels, river samples, social media data — must replace that design-based guarantee with a model of how the people who ended up in the data relate to those who did not. Such models can work well. They can also fail silently, and the failure is invisible from inside the data. Knowing which situation one is in is a matter of methodology, not statistics alone. The third is that the tools used to repair a survey after the fact, above all weighting, are only as good as the assumptions they rest on. Post-stratification, raking, and calibration can remove bias that is explained by the variables used in the adjustment. They cannot remove bias that is not, and they always cost precision. In an era of single-digit response rates, almost every published survey estimate is a heavily weighted one, which makes an understanding of what weighting does and does not do essential for anyone who produces or relies on survey data. What the book covers and what it leaves out The chapters move roughly in the order in which a survey is designed and carried out, though the argument doubles back where it must. Chapter 1 sets out the Total Survey Error framework and the vocabulary of bias, variance, and mean squared error that the rest of the book uses. Chapter 2 concerns populations and sampling frames: what it means to define the group one wants to describe, and how the lists and maps used to reach that group systematically fall short. Chapter 3 explains probability sampling — stratification, clustering, unequal probabilities, and the design effect — at the level needed to read a methods report critically and to plan a sample sensibly. Chapter 4 turns to non-probability sampling, the reasons for its rapid growth, the evidence on its accuracy, and the conditions under which its inferences can and cannot be trusted. The next three chapters move from representation to measurement. Chapter 5 describes what psychologists have learned about how respondents actually answer questions: the stages of comprehension, retrieval, judgement, and reporting, and the shortcuts people take when a questionnaire asks more of them than they are willing to give. Chapter 6 applies that understanding to the writing of questions and response scales. Chapter 7 covers pretesting, with particular attention to cognitive interviewing, the technique that transformed questionnaire design from a craft practised on intuition into one that can be tested. The last two chapters return to representation after the data have been collected. Chapter 8 deals with nonresponse — why response rates have collapsed, why low response rates do not automatically mean biased estimates, and what the evidence says about when they do. Chapter 9 explains weighting in detail, from base weights through nonresponse adjustments to post-stratification, raking, and calibration, and it is honest about the limits of each. The conclusion draws these threads together into a way of thinking about survey quality as a budget that must be spent deliberately across all sources of error rather than concentrated on the most visible one. The book concentrates on surveys of households and individuals intended to describe a defined population: government statistical surveys, social and health surveys, and the better class of opinion polls. It says less about establishment surveys of businesses and institutions, which share the same logic but face distinctive problems of their own, and it does not attempt to teach the full mathematics of complex sample variance estimation, for which excellent textbooks exist. Nor does it pretend to settle the arguments over non-probability data that are still very much alive; it tries instead to give the reader the means to judge a particular claim on its merits. Who this is for The intended reader is someone who needs to design, commission, evaluate, or use survey data and wants to understand why the field's practices are what they are. That includes researchers in the social and health sciences, analysts in government and industry who inherit survey data from others, journalists who report polls, and students who have learned the formulas of sampling theory without seeing how they connect to the practical decisions of fieldwork. The mathematics is kept to the level of simple algebra and is always explained in words. Where a formula appears, it is because it makes a practical point more clearly than prose could, and the point is always stated in plain language alongside it. A survey is, at bottom, a promise: that the numbers it produces say something true about people who were never asked. The rest of this book is about the conditions under which that promise can be kept. Chapter 1: The Total Survey Error Framework Every survey report contains a number that purports to describe its uncertainty. It usually appears as a margin of error — "plus or minus three percentage points" — and it is usually the only statement of quality the reader receives. That number is almost always the smallest part of the truth. It describes one source of error, the variability that arises because a random sample was drawn rather than the whole population, and it assumes that everything else in the survey went perfectly. In practice nothing else goes perfectly. The frame misses people, many of those sampled never respond, questions are misunderstood, answers are shaded toward what seems acceptable, and the weights applied at the end fix some problems while introducing others. The Total Survey Error framework exists to make all of that visible. It is less a single theory than an organising discipline: a way of listing every mechanism by which a survey estimate can depart from the true value it is meant to capture, and of thinking about how those mechanisms trade off against one another and against cost. This chapter sets out the framework and the handful of statistical ideas it rests on. A short history of an idea The recognition that sampling error is only part of the story is almost as old as modern sampling itself. In 1944 W. Edwards Deming, then working at the US Bureau of the Census, published a paper in the American Sociological Review titled "On Errors in Surveys." It listed thirteen factors affecting the usefulness of a survey, among them variability in response, bias arising from the interviewer, differences between the survey's definitions and the concept the user actually cared about, errors in processing, and the bias of the auxiliary data used in estimation. Sampling error was one item on the list. Over the following decades the statisticians who built the great government surveys — Morris Hansen, William Hurwitz, and their colleagues at the Census Bureau, and Leslie Kish at the University of Michigan — developed formal models for some of these errors, particularly for the variability introduced by interviewers and by respondents who would give different answers on different occasions. Kish's 1965 textbook Survey Sampling, still in print and still cited, distinguished carefully between variable errors and biases and between errors of observation and errors of non-observation. The phrase "total survey error" and its modern shape owe most to Robert Groves, whose 1989 book Survey Errors and Survey Costs brought the statistical tradition of the samplers together with the psychological and sociological traditions of the question designers, and argued that every design decision is a trade between error and cost. The version most widely taught today appears in the textbook Survey Methodology by Groves and five co-authors, first published in 2004 and revised in 2009. In 2010 a special issue of Public Opinion Quarterly marked the framework's maturity, with a historical review by Groves and Lars Lyberg and an account of its practical application by Paul Biemer. Two families of error The framework's central device is a diagram of the survey lifecycle, usually drawn as two parallel columns that converge on a single estimate. This book describes it in words. One column follows the path from a construct — the abstract thing the researcher wishes to know about, such as household food insecurity, trust in government, or the frequency of doctor visits — to a measurement, the specific question or set of questions used to capture it; then to a response, the answer a particular person gives; then to an edited response, the value that survives coding, cleaning, and consistency checks. At each step something can be lost. The gap between construct and measurement is an error of validity: the questions measure something, but not quite the thing intended. The gap between measurement and response is measurement error: the respondent misunderstands, forgets, estimates badly, or misreports. The gap between response and edited response is processing error: a keying mistake, a miscoded occupation, an editing rule that overrides a true but unusual answer. The other column follows the path from the target population — the people the researcher wishes to describe — to the sampling frame, the list or procedure through which they can be reached; then to the sample actually drawn from that frame; then to the respondents, the subset of the sample who provide data; and finally to the post-survey adjustments, the weights and imputations that attempt to repair the differences that have crept in. The gap between target population and frame is coverage error. The gap between frame and sample is sampling error. The gap between sample and respondents is nonresponse error. And the adjustments themselves can introduce adjustment error if they rest on the wrong assumptions. The first column is about measurement; the second is about representation. The survey statistic is produced where they meet: edited responses from the set of adjusted respondents are combined into a mean, a proportion, a total, or a regression coefficient. Table 1 summarises the seven components and the questions each raises. Table 1. Components of Total Survey Error. Component Family Gap it describes Typical question Validity Measurement Construct to question Does the question measure the concept intended? Measurement error Measurement Question to answer Do respondents understand, recall, and report accurately? Processing error Measurement Answer to data Are answers coded, keyed, and edited correctly? Coverage error Representation Population to frame Who cannot be reached through the frame at all? Sampling error Representation Frame to sample How much could results vary across possible samples? Nonresponse error Representation Sample to respondents Do those who respond differ from those who do not? Adjustment error Representation Respondents to weighted estimate Do weights correct the differences or add new ones? Two features of the list deserve emphasis. First, it is ordered in time, and errors propagate forward: a coverage gap cannot be fixed by drawing a larger sample from the same deficient frame, and a badly worded question cannot be rescued by excellent response rates. Second, the components interact. Nonresponse is often concentrated among the same groups who are poorly covered by the frame. Mode of data collection — face to face, telephone, web, paper — affects both who responds and how they answer. Interviewers who work hard to persuade reluctant respondents may also, through their manner, influence the answers they get. A design decision made to reduce one component almost always affects another. Bias and variance The framework uses a vocabulary borrowed from statistical estimation, and it is worth being precise about it. Imagine that a survey could be repeated many times under identical essential conditions: the same design, the same frame, the same questions, the same field procedures, but a new random sample each time, new draws of which interviewer is assigned to which case, and new realisations of each respondent's momentary state of mind. Each repetition would produce a slightly different estimate. The spread of those estimates around their own average is the variance of the survey procedure. The distance between that average and the true population value is its bias. Sampling error is the textbook example of variance: different random samples give different answers, but on average they are right. Interviewer effects are another source of variance: if one interviewer tends to elicit more reports of symptoms than another, and interviewers are assigned at random, the estimate will wobble depending on which interviewers happened to handle which cases. Response variability — the fact that a person asked the same question twice may give two different answers — is a third. Bias, by contrast, does not average away. If the frame systematically excludes people without fixed addresses, and those people are more likely to be food insecure, every repetition of the survey will underestimate food insecurity by roughly the same amount. If respondents systematically under-report alcohol consumption, a larger sample simply produces a more precise estimate of the wrong number. If people who agree to take part in a survey about civic life are more civically engaged than those who refuse, estimates of volunteering will be too high no matter how the sample is drawn. The two are combined in a single measure of overall accuracy, the mean squared error, which is the variance plus the square of the bias. The squared term matters: it means that bias grows in importance relative to variance as samples get larger, because variance shrinks with sample size while bias does not. With a sample of a few hundred, sampling variance may swamp a modest bias. With a sample of tens of thousands, the same bias dominates everything. This is the arithmetic behind the Literary Digest disaster and behind many subsequent failures of very large but poorly designed data collections. Why the published margin of error understates uncertainty The margin of error reported with a poll is conventionally about twice the standard error of the estimate, calculated as though the sample were a simple random sample from a perfect frame with full response. For a proportion near fifty percent and a sample of 1,000, this gives the familiar figure of about three percentage points. The calculation is correct for what it measures. It says nothing about bias, and in most modern surveys it also understates the variance, because the complex sample designs and heavy weighting discussed in later chapters inflate variance beyond the simple-random-sample benchmark. There is direct evidence of the gap. In a 2018 paper in the Journal of the American Statistical Association, Houshmand Shirani-Mehr, David Rothschild, Sharad Goel, and Andrew Gelman compared thousands of US state-level election polls with the eventual results. They found that the average absolute difference between poll and outcome was roughly twice what the reported margins of error implied, and that a substantial share of the excess came from what they called election-level bias — errors shared by all the polls in a given contest, such as a common misjudgement of who would turn out. The reported margin of error described a real source of uncertainty, but a minority of the total. None of this means margins of error should be abandoned. It means they should be read as a floor, not an estimate, of the uncertainty surrounding a survey number, and that a serious assessment of survey quality requires thinking about every other component in Table 1. Fitness for use A survey is not accurate or inaccurate in the abstract; it is accurate enough, or not, for a particular purpose. Statistical agencies have increasingly framed quality in these terms. The European Statistical System, Statistics Canada, and the US Federal Committee on Statistical Methodology all publish quality frameworks that treat accuracy as one dimension alongside relevance, timeliness, accessibility, interpretability, and coherence with other sources. A labour-force estimate that is extremely accurate but published eighteen months late may be less useful for monetary policy than a slightly noisier one published next week. The same survey can be fit for one use and not for another. A health survey whose small nonresponse bias shifts the national prevalence of smoking by half a percentage point may be perfectly adequate for tracking the national trend — if the bias is stable, it largely cancels out of year-to-year comparisons — while being quite inadequate for estimating smoking among young adults, a group whose response rates may be low and whose bias may be larger and less stable. Trend estimates, subgroup comparisons, and levels are all affected differently by the same error sources. Part of the discipline of Total Survey Error is asking which of these the user actually needs. Error and cost The final element of the framework is the one Groves placed in his book's title: every reduction in error costs something, and the budget is always finite. A face-to-face survey with a high response rate, carefully trained interviewers, and extensive pretesting may cost hundreds of dollars per completed interview; a web survey of an opt-in panel may cost a few dollars. The question is never whether the expensive design is better in some absolute sense, but whether the reduction in total error it buys is worth its cost for the purpose at hand, and whether that money would reduce total error more if spent elsewhere. This framing has practical consequences. It explains why a survey organisation might rationally accept a lower response rate in exchange for a larger sample, or a cheaper mode in exchange for more pretesting. It warns against optimising the most visible quality indicator — historically, the response rate — at the expense of less visible ones. A survey that spends heavily on refusal conversion to push its response rate from sixty to sixty-five percent may achieve little reduction in bias if the converted refusers resemble those who responded readily, while the same money spent on cognitive testing of a key question might have removed a measurement bias many times larger. The framework does not supply formulas for these trade-offs in most real situations, because the magnitudes of many error components are unknown for any particular survey. What it supplies is a checklist of the places to look and a vocabulary for arguing about priorities. The chapters that follow take each component in turn, with the aim of making clear how large it tends to be, how it can be detected, and what can be done about it. Measurability and the limits of the framework A frequent criticism of Total Survey Error is that it is easier to draw than to use. Of the seven components in Table 1, only sampling variance is routinely estimated from the survey data themselves. Coverage bias requires an external benchmark or a frame evaluation study. Nonresponse bias requires information on non-respondents, which by definition is scarce. Measurement bias requires a validation source — administrative records, biomarkers, a gold-standard interview — that is often unavailable. The framework can therefore become a list of worries rather than a quantitative tool. The criticism is fair, and the field has responded in several ways. One is the development of error models for specific components: interviewer variance can be estimated if interviewers are assigned to random subsamples of cases; response variance can be estimated from reinterviews; nonresponse bias can be bounded using frame variables, paradata about the fieldwork process, or follow-up studies of non-respondents. Another is the quality profile, a document that assembles everything known about the error properties of a major survey, as the US Census Bureau and others have done for surveys such as the Current Population Survey and the American Community Survey. A third is Biemer's proposal for regular, structured evaluation of each error source in continuing surveys, so that knowledge accumulates across rounds even when it cannot be complete in any single one. The more fundamental response is that a framework can be valuable even when it cannot be fully quantified. The alternative — attending only to the error that can be computed, and treating the margin of error as though it were the whole of the uncertainty — has repeatedly led survey producers and users into overconfidence. The best reason to think in terms of total error is that it forces the question every survey user ought to ask of every estimate: what else could have gone wrong, and how would I know? What this means for the rest of the book The chapters that follow are organised around the two columns of the lifecycle. Chapters 2 through 4 and 8 through 9 concern representation: frames, probability samples, non-probability samples, nonresponse, and weighting. Chapters 5 through 7 concern measurement: how respondents answer, how to write questions, and how to test them. The order is roughly that of survey design, but the argument of the framework runs through every chapter. No component can be judged in isolation, because the practical question is always which errors are large enough to matter for the intended use, and which of the available remedies reduces total error most for the money and effort they require. Chapter 2: Populations and Sampling Frames A survey begins with a decision that is often made too quickly: whom, exactly, it is meant to describe. The answer seems obvious until it has to be written down. "Adults in the United Kingdom" invites a string of questions. Does it include people living in care homes, prisons, military barracks, and student halls of residence? People who are temporarily abroad? Recent arrivals who have not yet registered anywhere? People who sleep rough? Residents of the Channel Islands, which are Crown Dependencies rather than parts of the United Kingdom? Each answer changes the population, and each has consequences for the estimates, because the excluded groups are rarely a random slice of everyone else. This chapter is about the distance between the population a survey wishes to describe and the population it can actually reach. That distance is coverage error, and it is the first place where representation can fail. Target population and survey population Survey methodologists distinguish several populations. The target population is the set of units — usually people, sometimes households, businesses, schools, or hospital episodes — about which the researcher wants to draw conclusions. It must be defined in terms of content (who counts), units (persons or households), geography, and time (on what date, or during what period, membership is determined). A precise definition might read: all persons aged sixteen and over who were usually resident in private households in Great Britain on the survey reference date. Almost every survey then quietly narrows the target to a survey population that is practical to reach. Large government household surveys typically exclude people living in institutions, sometimes those in remote or sparsely populated areas where fieldwork costs are prohibitive, and sometimes those who cannot be interviewed in any of the languages in which the survey is fielded. These exclusions are generally documented in the technical report and rarely mentioned in the headlines. They matter most when the excluded groups differ sharply on the survey's topic. A survey of disability that omits residents of care homes, or a survey of drug use that omits prisoners, is describing a population systematically healthier or more law-abiding than the one its title implies. What a sampling frame is To draw a probability sample, the researcher needs some way of giving every member of the survey population a known chance of selection. The device that makes this possible is the sampling frame. The simplest frame is a list: a population register, a list of patients registered with a health system, a membership roster. But frames need not be lists of people. An area frame is a map of the country divided into small geographic units that together cover the whole territory; the sample selects areas, then dwellings within areas, then people within dwellings. A random-digit-dial telephone frame is not a list of anyone in particular but a set of rules for generating telephone numbers in which working residential numbers are known to be concentrated. What these have in common is a mechanism by which each unit in the population is linked to a known, selectable element of the frame. Kish's classic treatment identified four ways in which a frame can depart from the ideal of a one-to-one correspondence with the target population. The first is undercoverage or missing elements: people in the population who have no corresponding entry in the frame. The second is overcoverage or foreign elements: frame entries that correspond to no member of the population, such as business telephone numbers in a residential telephone frame or demolished dwellings on an address list. The third is duplication: population members linked to more than one frame element, such as a person with both a landline and a mobile phone, or with two residential addresses. The fourth is clustering: frame elements linked to more than one population member, such as a household address behind which several adults live. Overcoverage, duplication, and clustering are nuisances that can be managed if the survey collects the right information. Foreign elements can be screened out at first contact. Duplicates can be handled by asking respondents how many ways they could have been selected and adjusting their weights accordingly — a person reachable through two telephone numbers had twice the chance of selection and receives half the weight. Clustering is handled by selecting one or more persons within the cluster with known probability, again with a corresponding weight. Undercoverage is different. Units that are not on the frame cannot be selected, cannot be screened, and cannot answer questions about how they might have been selected. Nothing in the survey data reveals their absence. The arithmetic of coverage bias A simple formula captures when undercoverage matters. Suppose a fraction of the target population is missing from the frame. The bias in a sample mean that is otherwise unbiased for the covered population equals that missing fraction multiplied by the difference between the covered and non-covered groups' means on the variable being measured. The formula has two factors, and both must be large for bias to be large. A frame that misses ten percent of the population produces little bias for a variable on which the missing ten percent resemble everyone else; a frame that misses two percent can produce meaningful bias for a variable on which the missing two percent are extreme. It follows that coverage error is not a property of a frame but of a frame in relation to a particular estimate. The same telephone frame may be adequate for estimating television viewing habits and seriously deficient for estimating residential instability or the prevalence of poverty. It also follows that the growth of any coverage gap is dangerous only insofar as the uncovered group is distinctive. When landline telephones first spread through the United States, those without them were disproportionately poor and rural, and early telephone surveys were justly suspected of bias. By the 1970s, household telephone coverage in the United States exceeded ninety percent and the remaining non-covered group, though still distinctive, was small enough that telephone surveying became respectable. The history of survey frames since then has been a series of such cycles, as new technologies and social changes open new gaps. The principal household frames For surveys of the general household population, four families of frame dominate. Each has a characteristic pattern of coverage strengths and weaknesses, set out in Table 2. Table 2. Principal frames for general population household surveys. Frame How units are reached Main coverage strengths Main coverage weaknesses Population register Named individuals from an official register Near-complete coverage of legal residents; auxiliary data on every unit Exists in few countries; misses unregistered and recently moved people Area probability Maps and field listing of dwellings in sampled areas Can in principle reach every dwelling Costly listing; misses hidden or irregular dwellings; requires in-person work Address-based Postal delivery address files High coverage of residential addresses; cheap to sample Weaker in rural areas and for non-standard addresses; no named persons Telephone (RDD) Randomly generated landline and mobile numbers Fast, cheap to sample, national reach Very low response; complex overlaps between landline and mobile users Population registers In the Nordic countries, the Netherlands, and a number of other European states, a continuously updated population register records every legal resident with a personal identification number, a date of birth, a sex, and an address. Sampling individuals directly from such a register is close to the textbook ideal. Every person has a known probability of selection, the frame supplies auxiliary information about non-respondents as well as respondents, and linkage to other administrative registers can supply data that the survey need not collect at all. Statistics Norway, Statistics Sweden, and Statistics Denmark have built much of their social statistics on this foundation. Registers are not perfect. They lag behind moves and emigration, they may omit undocumented residents entirely, and their address information can be out of date for young adults and others who change residence often. But in the countries that have them, they have made coverage error a secondary concern and freed methodologists to concentrate on nonresponse and measurement. Area probability frames Where no register exists, the traditional solution is to build a frame from geography. The country is divided into primary sampling units — counties, groups of counties, or census enumeration areas — which are sampled with probabilities proportional to their population. Within each sampled unit, smaller areas are selected. Field staff then walk the selected areas and list every dwelling they find, and a sample of dwellings is drawn from these listings. Finally, the interviewer enumerates the residents of each sampled dwelling and selects one or more of them. Area probability sampling has long been the gold standard for face-to-face surveys in the United States and elsewhere; the General Social Survey, the National Health Interview Survey, and the Current Population Survey have all relied on it. Its coverage is in principle complete, since every dwelling occupies some piece of ground. In practice, listers miss dwellings: basement flats, units above shops, informal structures, and multiple households concealed behind a single front door. Coverage of persons within dwellings is a further problem, because household rosters tend to omit people with a loose attachment to the household — often young men — who may be the very people the survey most needs. Coverage studies comparing survey totals with demographic benchmarks have long found that household surveys reach smaller shares of young adult men than of other groups, even before nonresponse is considered. Address-based sampling In the 2000s, survey researchers in the United States discovered that commercially available versions of the US Postal Service's Computerized Delivery Sequence file could serve as a frame of residential addresses with coverage approaching that of field listing in many areas, at a tiny fraction of the cost. Address-based sampling, as it came to be called, has since become the dominant frame for high-quality general population surveys in the United States, often combined with mail invitations to complete a questionnaire online or on paper. The Royal Mail's Postcode Address File plays a similar role in the United Kingdom and has long been the standard frame for major British surveys. Address frames have characteristic weaknesses. Coverage is poorer in rural areas where mail is delivered to post office boxes or rural routes, in areas of new construction, and for dwellings without a standard postal address. And an address frame identifies a place, not a person, so the survey must still select a respondent within the household, usually by asking whoever opens the envelope to hand the questionnaire to the adult with the next birthday or by some similar rule. Such self-administered within-household selection is imperfectly followed, which introduces its own errors. Telephone frames For roughly three decades from the 1970s, random-digit dialling was the workhorse of opinion polling and much academic survey research in the United States. Because telephone numbers were assigned in blocks, and residential numbers clustered within certain blocks, a sample of randomly generated numbers within active blocks gave every household with a landline a known probability of selection, including households with unlisted numbers. Two developments eroded the method. The first was the spread of mobile telephones and the consequent abandonment of landlines. The National Center for Health Statistics has tracked this since 2003 through the National Health Interview Survey, which asks respondents about the telephones in their household; the share of adults living in households with only mobile phones rose from a few percent in the early 2000s to a majority by the late 2010s and continued to rise into the 2020s. The wireless-only population is younger, more likely to rent, and more likely to be Hispanic than the landline population, so landline-only surveys developed serious coverage bias. Survey organisations responded with dual-frame designs that sample both landline and mobile numbers and combine the two samples with weights that account for people reachable through both. The second development, discussed in Chapter 8, was the collapse of telephone response rates, which by the late 2010s had fallen to single digits for many polls. Coverage of special and hidden populations Some target populations have no frame at all. There is no list of people who inject drugs, undocumented migrants, sex workers, or people with a rare disease. For such groups survey researchers use a range of workarounds. Screening draws a large general-population sample and asks eligibility questions, retaining only those who qualify; it preserves probability sampling but becomes prohibitively expensive when the group is rare. Disproportionate stratification concentrates sampling effort in areas where the group is known to cluster, at the cost of unequal weights. Multiple-frame designs combine a general frame with a partial but efficient list, such as a membership roster, and weight to account for overlap. When none of these is feasible, researchers turn to network-based methods. Respondent-driven sampling, developed by the sociologist Douglas Heckathorn in the 1990s, begins with a set of seed respondents who recruit peers, who recruit further peers, through successive waves, with estimators that attempt to correct for the unequal probability that different people are recruited. It has been widely used in HIV surveillance. Its statistical assumptions — that recruitment is random within each person's network, that people report their network size accurately, and that the chain runs long enough to forget its starting point — are rarely fully met, and methodological evaluations have found that its estimates can be highly variable. It is best regarded as a disciplined non-probability design rather than a probability sample. Selecting people within households Most household frames select dwellings, not people, and so every such survey must decide how to choose among the eligible residents it finds. The choice looks like an administrative detail and is in fact a coverage decision. The most rigorous approach, introduced by Kish in 1949, has the interviewer list every eligible adult in the household by sex and age and then use a pre-assigned selection table to pick one. It produces a known probability of selection for every adult, but it requires the person answering the door to disclose the composition of the household to a stranger before the interview has begun, and that request itself provokes refusals. Cheaper alternatives ask for the adult with the most recent or next birthday, on the reasoning that birthdays are close to randomly distributed. These methods are less intrusive and widely used, particularly in telephone and mail surveys. Their weakness is that they depend on the household to apply them honestly and correctly, and studies that have checked the selected respondent against a full household roster have repeatedly found that a substantial minority of households select the wrong person — usually the one who happens to be available, interested, or accustomed to dealing with official correspondence. Such errors are not random. They tend to over-represent women, older adults, and the more educated members of the household, which are precisely the groups that are already over-represented through nonresponse. Whatever method is used, a person selected from a household of four adults had one quarter of the chance of selection of a person living alone, and must carry four times the weight. Forgetting this step, as some analyses of secondary data do, biases estimates toward the characteristics of people in larger households — who are, among other things, more likely to be married and to have children. The web has no frame The rise of online data collection has produced an asymmetry that is easy to overlook. Collecting data over the internet is cheap and fast, but there is no general frame of internet users from which to draw a probability sample. Email addresses are not listed in any comprehensive directory, are not tied to one person each, and cannot be generated at random the way telephone numbers can. A survey that wishes to collect data online from a probability sample must therefore make first contact through some other frame — usually addresses or telephone numbers — and then invite the sampled people to go online. This is the design of the probability-based online panels that emerged from the late 1990s onward: panels such as the Dutch LISS panel, the German Internet Panel, the Pew Research Center's American Trends Panel, and NORC's AmeriSpeak. Each recruits members through a probability frame, typically addresses, and in some cases supplies internet access or devices to people who lack them so that the offline population is not excluded. Once recruited, panel members can be surveyed repeatedly online at low cost. The coverage properties of such panels are inherited from the recruitment frame; their weaknesses lie elsewhere, in the cumulative nonresponse that occurs at recruitment, at joining, and in each subsequent wave, and in the possibility that long-serving members come to answer differently from fresh respondents. Surveys that recruit online without any probability frame — through advertisements, website banners, email lists of volunteers, or commercial panels of people who have signed up to take surveys for rewards — are in a different position altogether. They have not merely a coverage problem but no defined selection probabilities at all. That is the subject of Chapter 4. Frames change, and so must surveys The main lesson of the history of sampling frames is that no frame stays good forever. Telephone frames went from inadequate to excellent to inadequate again within two generations. Address frames rose to prominence in a decade. Registers are threatened by migration and by public reluctance to share data. Each change alters not only the coverage of the frame but the mode of contact it implies — an address invites a letter, a telephone number invites a call, a register invites whichever mode the agency chooses — and therefore the pattern of nonresponse and measurement error that follows. The frame decision is where the two columns of the Total Survey Error lifecycle first meet. For the survey user, the practical questions are three. What was the frame, and whom does it exclude? How large is the excluded group relative to the population of interest? And is there reason to think that group differs on the variables being estimated? A technical report that answers these clearly is a sign of a survey whose producers understand what they are doing. A report that says only that the sample is "nationally representative" answers none of them. Chapter 3: Probability Sampling and Design In 1934 the Polish statistician Jerzy Neyman read a paper to the Royal Statistical Society in London that settled a long-running dispute. The question was how to choose a part of a population so that it could stand for the whole. One school, influential in official statistics, favoured purposive selection: choosing districts or units deliberately so that the sample matched the population on known characteristics. The other favoured random selection. Neyman showed, using an Italian census study that had chosen districts purposively to match national averages and had nonetheless produced poor estimates of other characteristics, that purposive selection offered no general protection against error and no way of measuring the error it produced. Random selection, particularly when combined with stratification, did both. The paper, "On the Two Different Aspects of the Representative Method," is generally regarded as the foundation of modern survey sampling. This chapter explains the logic Neyman established and the designs that grew from it, at the level needed to plan a sample, read a methods report, and understand why the precision of a real survey is almost never what a simple formula would suggest. What makes a sample a probability sample A probability sample is one in which every unit in the frame has a known, non-zero probability of being selected, and in which selection is carried out by a random mechanism under the researcher's control. The probabilities need not be equal. They need only be known. This is the whole of the definition, and each part does work. The requirement that probabilities be known is what allows the sample to be linked back to the population. If a person had a one-in-a-thousand chance of selection, then in a sense that person stands for a thousand people, and weighting each observation by the inverse of its selection probability produces unbiased estimates of population totals. This result, formalised by Daniel Horvitz and Donovan Thompson in 1952, is the basis of design-based inference: the randomness that justifies the estimate is the randomness the researcher introduced, not an assumption about how the population behaves. The requirement that probabilities be non-zero is what rules out coverage exclusion within the frame. A unit with zero chance of selection can never be represented, and no weighting can bring it in. The requirement that selection be random is what distinguishes probability sampling from haphazard or convenience selection. An interviewer instructed to "choose a typical household on each street" is not sampling randomly, however conscientious, because the interviewer's judgement about typicality enters the selection and introduces biases that cannot be measured. The payoff from meeting these requirements is that the sampling distribution of an estimate — the distribution of values it would take across all possible samples that could have been drawn under the design — can be derived from the design itself. That is what allows a probability survey to state its sampling error without assuming anything about the population beyond what the frame contains. Simple random sampling as a benchmark The simplest probability design is the simple random sample, in which every possible subset of a given size has the same chance of selection. Few real surveys use it, because it is usually inefficient or impractical, but it serves as the benchmark against which other designs are compared. Under simple random sampling, the variance of a sample mean equals the population variance of the variable divided by the sample size, multiplied by a finite population correction equal to one minus the sampling fraction. When the sample is a small part of the population, as in most national surveys, the correction is close to one and can be ignored. This has a counterintuitive but important consequence: the precision of an estimate depends on the absolute size of the sample, not on the fraction of the population sampled. A simple random sample of 1,000 people gives about the same precision whether it is drawn from a city of 100,000 or a nation of 300 million. Sample sizes for national polls are not small because pollsters are careless; they are adequate because population size barely matters. For a proportion, the population variance is the proportion multiplied by its complement, which is largest at fifty percent. This is why the standard margin of error for a sample of 1,000 is about plus or minus three percentage points, and why quadrupling the sample to 4,000 only halves it to about one and a half. Precision improves with the square root of the sample size, so each additional increment of accuracy costs more than the last. Stratification Stratification divides the population into mutually exclusive groups, or strata, and draws a separate probability sample within each. Typical strata in household surveys are regions, urban and rural areas, or small areas grouped by socioeconomic indicators. In list samples, strata may be formed from any variable on the frame: age groups on a population register, size classes on a business register. Stratification serves two purposes. The first is precision. Because each stratum is sampled separately, the variation between strata contributes nothing to the sampling variance; only variation within strata does. If strata are formed so that units within each are similar on the survey variables, the gain can be substantial. With proportionate allocation, in which each stratum's share of the sample equals its share of the population, stratification can never do worse than simple random sampling of the same size, and usually does somewhat better. The second purpose is control over subgroup sample sizes. A survey that needs reliable estimates for each of several regions, including small ones, can sample the small regions at higher rates than the large ones. This disproportionate allocation guarantees enough cases in each region for separate analysis, at the cost of unequal weights in national estimates, which generally reduces national precision. Neyman's 1934 paper derived the allocation that minimises the variance of an overall estimate for a fixed sample size: sample each stratum in proportion to the product of its population size and its within-stratum standard deviation. Strata that are larger or more variable receive more of the sample. When costs per interview differ between strata, the optimal allocation also takes account of cost, sampling more heavily where interviews are cheap. In practice, optimal allocation for one variable is rarely optimal for others, and surveys that measure hundreds of variables typically settle for a compromise: roughly proportionate allocation with oversampling of subgroups that are analytically important. Clustering If stratification is the design feature that usually improves precision, clustering is the one that usually worsens it, and it is used anyway because it cuts costs dramatically. A face-to-face survey that selected 3,000 households at random across a large country would send interviewers to 3,000 widely scattered locations, many of them hours apart. The travel alone would consume most of the budget. Cluster sampling solves this by selecting geographic units first — say, 150 small areas — and then selecting about twenty households within each. Interviewers can then work efficiently in a limited number of places. Area frames, described in Chapter 2, are almost always used in this multistage clustered form. The cost of clustering is statistical. People who live near one another tend to resemble one another: in income, ethnicity, housing, political views, exposure to local health risks. Twenty households drawn from one neighbourhood therefore carry less independent information than twenty households drawn from twenty neighbourhoods. The degree of resemblance is measured by the intraclass correlation, usually written with the Greek letter rho, which is zero if people within clusters are no more alike than people in general and one if they are identical. The effect of clustering on variance is summarised by a formula that every survey designer should know. The design effect due to clustering is approximately one plus the product of the intraclass correlation and one less than the average number of interviews per cluster. The design effect is the ratio of the actual variance of an estimate to the variance a simple random sample of the same size would have produced. The formula shows why even small intraclass correlations matter. Suppose rho is 0.05, a typical value for many socioeconomic variables, and each cluster contributes twenty interviews. The design effect is one plus 0.05 times nineteen, or 1.95. The variance is nearly double that of a simple random sample, and the effective sample size — the size of a simple random sample that would have given the same precision — is the actual sample divided by the design effect. A clustered sample of 3,000 behaves like a simple random sample of about 1,540. For variables with higher intraclass correlations, such as access to piped water in a developing country or ethnicity in a segregated city, rho may exceed 0.2 and the design effect may be five or more. The design lesson is that the number of clusters matters more than the number of interviews per cluster. Taking fewer interviews in more clusters reduces the design effect, at the price of more travel. The optimal cluster size balances the cost of reaching a new cluster against the cost of an additional interview within one, and the answer depends on rho; for variables with high intraclass correlation, small clusters are worth paying for. Unequal probabilities and multistage selection Real household surveys usually select areas with probability proportional to size — that is, a larger area has a proportionally larger chance of selection. Then, within each selected area, a fixed number of dwellings is chosen. The two stages cancel: a dwelling in a large area had a high chance of its area being chosen and a low chance of being chosen within it, and a dwelling in a small area the reverse. If the size measures are accurate, every dwelling ends up with the same overall probability of selection, a so-called self-weighting design, while every interviewer has the same workload. When the size measures are out of date — because an area has seen new construction since the last census, for example — probabilities become unequal and weights must compensate. Other sources of unequal probability are deliberate: oversampling of strata, selection of one adult from households of different sizes, and dual-frame designs in which some people can be reached through two routes. All of them require weights, and all weights, as Chapter 9 explains, carry a price in variance. Kish proposed a simple approximation for this price: when weights vary for reasons unrelated to the survey variables, the design effect due to weighting is about one plus the square of the coefficient of variation of the weights. A set of weights whose standard deviation equals half their mean produces a design effect of about 1.25, a loss of a fifth of the effective sample. The clustering and weighting effects compound, so a survey with both can easily have an overall design effect of two or three. Systematic sampling A common practical method of selecting units from a list is systematic sampling: choose a random starting point, then take every kth unit thereafter, where k is the population size divided by the desired sample size. It is simple to carry out, especially in the field or from printed lists, and if the list is sorted by a variable related to the survey topic — for example, addresses sorted by postcode, which groups them geographically — systematic selection produces a sample that is implicitly stratified by that variable and usually gains precision as a result. The risk is periodicity. If the list has a regular pattern that coincides with the sampling interval — a housing estate in which every tenth dwelling is a corner unit, or a payroll list in which every twentieth entry is a supervisor — systematic selection can produce a badly unrepresentative sample. Such patterns are rare in practice but should be checked for. Estimating variance from complex samples Because complex designs change the variance of estimates, the software that analyses the data must know about the design. Analysing a clustered, stratified, weighted sample as though it were a simple random sample almost always understates standard errors, sometimes grossly, and leads to confidence intervals that are too narrow and significance tests that are too liberal. This remains one of the most common errors in published secondary analysis of survey data. Two families of method are used to estimate variance correctly. Taylor series linearisation approximates nonlinear estimators such as ratios and regression coefficients by linear functions and applies the standard formulas for stratified cluster samples to the linearised values. It requires the data set to identify each case's stratum and primary sampling unit. Replication methods — the jackknife, balanced repeated replication, and the bootstrap — form many subsamples or reweighted versions of the full sample, compute the estimate on each, and use the variation among them to estimate the variance. Replication is convenient because it can be packaged as a set of replicate weights that accompany the public data, allowing users to compute correct standard errors without seeing confidential design information. The US Census Bureau distributes the American Community Survey with eighty replicate weights for this reason. Major statistical packages, including the survey package in R and the survey commands in Stata and SAS, implement both approaches. A worked example of design planning Suppose a health agency wishes to estimate the prevalence of a condition believed to affect about twenty percent of adults, with a margin of error of plus or minus two percentage points at ninety-five percent confidence, using a clustered face-to-face design. For a simple random sample, the required size is found by setting 1.96 times the standard error equal to 0.02. The standard error of a proportion of 0.2 is the square root of 0.2 times 0.8 divided by the sample size. Solving gives a sample of about 1,540. Now suppose previous surveys suggest an intraclass correlation of 0.03 for this condition, and the agency plans twenty-five interviews per cluster. The design effect for clustering is one plus 0.03 times twenty-four, or 1.72. Suppose further that the planned oversampling of rural areas and within-household selection will produce weights with a coefficient of variation of about 0.4, adding a weighting design effect of about 1.16. The overall design effect is roughly the product, 2.0. The required number of completed interviews doubles to about 3,080. Finally, the agency expects a response rate of about sixty percent and an eligibility rate of ninety percent among sampled addresses. It must therefore select about 3,080 divided by 0.54, or roughly 5,700 addresses, in about 125 clusters. Every step of this calculation rests on an assumption that could be wrong, and a careful planner would test how sensitive the answer is to each. But the exercise shows why a survey that would need 1,540 interviews on the simple textbook formula may need to issue nearly four times as many addresses in practice. What probability sampling does and does not guarantee The strength of probability sampling is that it converts the question of representativeness from a matter of judgement into a matter of design. Given a complete frame and full response, the estimates are unbiased and their variance can be calculated. No other method offers that guarantee. But the guarantee is conditional. It assumes the frame covers the population, and Chapter 2 showed that frames rarely do. It assumes that everyone selected responds, and Chapter 8 will show that in contemporary surveys most do not. When coverage and response are incomplete, the realised sample is no longer a probability sample of the target population in the strict sense; it is a probability sample of a frame, filtered through a response process whose probabilities are unknown. The estimates then depend, like those of any non-probability sample, on assumptions about the people who are missing. This has led some commentators to argue that the distinction between probability and non-probability surveys has become meaningless when response rates are low. That conclusion goes too far. A probability sample with a low response rate still begins from a known selection mechanism, still offers information about the non-respondents from the frame and the fieldwork, and still allows the effects of nonresponse to be studied and bounded. A sample assembled from volunteers begins with none of those things. The difference is a matter of degree rather than kind, but the degree is large. The next chapter examines what happens when that starting point is abandoned altogether. Hashtags: #SurveyMethodology #TotalSurveyError #SamplingFrames #CoverageError #ProbabilitySampling #ComplexSurveyDesign #StratifiedSampling #ClusterSampling #DesignEffect #SamplingError #NonresponseError #MeasurementError #ProcessingError #AdjustmentError #QuestionDesign #SurveyQuestionnaireDesign #CognitiveInterviewing #RespondentComprehension #ResponseProcess #NonProbabilitySampling #SurveyWeighting #PostStratification #Raking #CalibrationWeighting #FutureOfSurveyMethodology

Download the Book (PDF): Introduction Every analyst who has opened a large public survey file has met the same small crisis. The file arrives with thousands of respondents, hundreds of questions, and a handful of columns whose purpose is not obvious: a final weight, a stratum code, a primary sampling unit code, and perhaps eighty or a hundred and sixty further columns labelled as replicate weights. The documentation says these must be used. The deadline says otherwise. So the analyst computes an ordinary mean, fits an ordinary regression, reports an ordinary standard error, and moves on. The mean is probably wrong. The standard error is almost certainly wrong. And the error is not random noise that washes out in a large file; it is systematic, and it runs in a predictable direction. Unweighted estimates reproduce whatever imbalance the sample design and the pattern of nonresponse built into the data. Standard errors computed as if the respondents were independent draws are typically too small, sometimes by a factor of two or more, which makes confidence intervals too narrow and significance tests too eager. A result that looks decisive at the one percent level may, once the design is respected, be indistinguishable from nothing. This booklet is about those extra columns: where they come from, what they encode, and how to use them correctly. It is written for readers who are comfortable with basic statistics, including means, variances, regression and the idea of a sampling distribution, and who now need to analyse data that did not come from a simple random sample. That describes nearly every serious survey in existence. National health examinations, labour force surveys, household expenditure studies, crime victimisation surveys, education assessments, election studies and most commercial opinion polls all use some combination of stratification, clustering, unequal selection probabilities and post-collection weight adjustment. None of them can be analysed properly with textbook formulas that assume independent and identically distributed observations. The argument of this book The controlling idea is simple to state and surprisingly easy to lose sight of: a survey estimate has two halves, and they answer to different parts of the design. The point estimate answers to the weights. The measure of its uncertainty answers to the structure that generated those weights, meaning the strata, the clusters, and every adjustment made along the way. Getting one half right does not rescue the other. This division explains most of the mistakes seen in practice. Analysts who apply the weight but ignore strata and clusters get sensible point estimates with standard errors that are too small. Analysts who build careful weights through nonresponse adjustment and raking, then compute variances as if those weights had been fixed in advance, understate uncertainty in a subtler way. Analysts who subset a file to a subgroup before declaring the design throw away information the variance formula needs and can end up with strata that contain a single cluster, at which point the software either fails or quietly produces nonsense. Each of these is a case of treating the two halves as if they were one. The two families of variance method that dominate modern practice, Taylor series linearization and replication, are best understood as two different routes to the same destination. Linearization approximates a complicated estimator by a linear one and then applies the variance formula for a stratified cluster sample to that linear approximation. Replication re-runs the whole estimation many times on systematically perturbed versions of the sample and measures how much the answer moves. When both are applied correctly to a well-behaved statistic, they agree closely, and this booklet works through a small example in which they agree to three decimal places. When they disagree, the disagreement is itself informative: it usually signals a non-smooth statistic, a very small number of clusters, or a weighting step that one method captured and the other did not. What the chapters do Chapter 1 establishes why weights exist at all. It introduces selection probabilities, the Horvitz–Thompson estimator, and the design-based framework in which the population values are fixed and the randomness comes entirely from which units the sampler happened to draw. This framework is unfamiliar to many analysts trained on model-based statistics, and much confusion about weighting comes from not having made the switch. Chapter 2 dissects the structural features of complex samples: stratification, which usually reduces variance; clustering, which usually increases it; and multistage selection, which is how clustering arises in practice. It develops the design effect and the intraclass correlation as tools for reasoning about how much information a sample actually contains. Chapter 3 follows the life of a weight from its origin as an inverse selection probability through the adjustments that survey organisations apply: for eligibility, for nonresponse, and for extreme values. It explains why variable weights carry a variance cost of their own and gives Kish's well-known approximation for that cost. Chapters 4 and 5 treat the adjustments that align a sample with known population totals. Chapter 4 covers post-stratification and the general theory of calibration, including the generalised regression estimator. Chapter 5 is devoted to raking, the iterative procedure that most organisations actually use when full cross-classified population counts are unavailable, and works through a complete example by hand. Chapters 6, 7 and 8 are the technical core on variance estimation. Chapter 6 develops Taylor series linearization, the ultimate cluster approximation, and the estimating-equation approach that extends linearization to regression and other models. Chapter 7 covers jackknife replication in its main variants. Chapter 8 covers balanced repeated replication, Fay's modification, and the survey bootstrap, and compares all the major methods side by side. Chapter 9 turns to analysis in practice: subpopulation estimation, regression with survey data, the long argument over whether weights belong in models at all, degrees of freedom, and the handling of awkward designs. The conclusion draws out what follows from the preceding chapters for anyone who produces or consumes survey estimates. What this book does not cover A handbook of this length has to choose its ground, and several important neighbouring subjects are left out or touched only lightly. Sample design as an optimisation problem, such as how to allocate a fixed budget across strata or how many households to interview per cluster, is treated only insofar as it shapes the analysis. Imputation for item nonresponse, which interacts with variance estimation in ways that have generated a literature of their own, is mentioned but not developed. Small area estimation, which borrows strength across domains through explicit models, lies outside the design-based framework that organises this book. Nonprobability samples, including opt-in online panels, raise questions about weighting that differ in kind from those considered here, because there are no selection probabilities to invert; the calibration machinery of Chapters 4 and 5 is often applied to them, but the justification is model-based rather than design-based, and the guarantees are correspondingly weaker. Throughout, mathematics is written in plain notation. A unit is indexed by i, a stratum by h, and a primary sampling unit within a stratum by a letter or number; sums are written with Σ and square roots with √. Weights are written wᵢ, selection probabilities πᵢ, and the population and sample sizes N and n. Where multiple indices are needed, they are written in parentheses, so that y(h,a) means the weighted total of y in cluster a of stratum h. The notation is deliberately light. The ideas are what matter, and every formula in the book is accompanied by an account in words of what it does and why. A note on software Every major statistical environment now supports complex survey analysis. The survey package for R, the svy prefix in Stata, the SURVEY procedures in SAS, the Complex Samples module in SPSS, and specialised programs such as SUDAAN and WesVar all implement linearization and at least some replication methods. This booklet is not a software manual, and it does not give code. It aims instead to make the reader able to specify a design correctly in any of these tools, to understand what the output means, and to recognise when the output is wrong. Software faithfully computes whatever design it is told about. The judgement about what to tell it remains with the analyst. Chapter 1: Why Weights Exist A sample survey is a device for learning about a finite population by looking at part of it. The population might be the adults living in private households in a country on a particular date, the hospitals in a region, the pupils enrolled in a school system, or the businesses registered for a tax. Whatever it is, it has a definite size N and, for any question the survey asks, a definite list of N true answers. The survey does not see those answers. It sees n of them, chosen by a procedure, and from those n it must say something about all N. Everything in this booklet follows from taking that procedure seriously. The procedure is not an incidental detail of data collection. It is the source of the randomness on which all inference rests, and it determines both how the sample should be combined into an estimate and how uncertain that estimate is. The design-based view Most statistical training begins with a model. The data are treated as draws from a probability distribution with unknown parameters, and inference is about those parameters. A regression coefficient estimates a feature of the process that generated the outcomes; its standard error describes how the estimate would vary if the process were run again. Survey sampling theory, as it developed from the 1930s onward in the work of Jerzy Neyman, Morris Hansen, William Hurwitz, Leslie Kish, William Cochran and others, took a different path. In the design-based view the population values are fixed numbers. There is nothing random about them. The average household income in a region on a given date is a single, definite quantity. What is random is the sample: which households happened to be selected. Probability enters the analysis only through the selection mechanism, which the survey designer controls and therefore knows exactly. This has a liberating consequence. Design-based inference does not require that the outcome follow a normal distribution, that relationships be linear, or that errors be independent. It requires only that every unit in the population had a known, non-zero chance of selection. Given that, one can construct estimators that are unbiased over repeated application of the same design, and compute their variances, without assuming anything about how the population values arose. The guarantee is about the procedure: if the survey were repeated many times under the same design, the estimates would centre on the true population value. The price is that the guarantee is only as good as the knowledge of the selection probabilities. When nonresponse intervenes, as it always does, the probabilities of ending up in the responding sample are no longer known and must be estimated, and some modelling assumptions creep back in. Chapter 3 returns to this. For now, it is worth fixing the pure case clearly, because it defines what the weights are trying to achieve. Inclusion probabilities Under any probability sampling design, each unit i in the population has an inclusion probability πᵢ: the probability, over all possible samples the design could produce, that unit i appears in the sample. In a simple random sample of n from N, every unit has πᵢ = n/N. In most real surveys the probabilities differ, sometimes deliberately and sometimes as a by-product of the selection method. Deliberate differences arise from oversampling. A health survey that wants reliable estimates for a minority ethnic group making up six percent of the population may select members of that group at three times the rate of everyone else. A business survey may take every large firm with certainty, because a handful of large firms account for most of the turnover, while sampling small firms at one in a hundred. A national survey that wants separate estimates for each of its provinces may allocate equal sample sizes to provinces of very different populations, so that residents of small provinces are selected at far higher rates than residents of large ones. Incidental differences arise from the mechanics of multistage selection. A common household design first samples geographic areas with probability proportional to their estimated population, then samples a fixed number of dwellings within each selected area, then selects one adult at random from each sampled dwelling. The first two stages are usually arranged to give each dwelling roughly the same overall chance. The third stage does not: an adult living alone is certain to be chosen once the dwelling is selected, while an adult in a dwelling with four adults has a one-in-four chance. Unless this is corrected, people in large households are underrepresented, and anything correlated with household size, such as age, marital status or income, will be estimated with bias. Whatever the reason, the survey designer knows each respondent's πᵢ, or at least can compute it from the probabilities at each stage multiplied together. That product is the starting point for weighting. The Horvitz–Thompson estimator In 1952 Daniel Horvitz and Donovan Thompson published a general method for estimating a population total from a sample drawn with unequal probabilities. The idea is almost disarmingly simple. Let yᵢ be the value of the variable of interest for unit i, and let Y = Σ yᵢ be the population total, summed over all N units. The Horvitz–Thompson estimator is Ŷ = Σ yᵢ / πᵢ, where the sum now runs only over the n sampled units. Dividing by πᵢ is the same as multiplying by wᵢ = 1/πᵢ, the base weight or design weight. The weight has a direct interpretation: a unit selected with probability one in two hundred stands in for two hundred units of the population, itself included. Adding up weighted values reconstructs the population total. The estimator is unbiased under the design, and the argument takes one line. Write the estimator as a sum over the whole population, Ŷ = Σ Iᵢ yᵢ / πᵢ, where Iᵢ is an indicator equal to 1 if unit i is sampled and 0 otherwise. The yᵢ and πᵢ are fixed numbers; only the Iᵢ are random. The expected value of Iᵢ is exactly πᵢ, because that is what an inclusion probability means. So the expected value of each term is πᵢ yᵢ / πᵢ = yᵢ, and the expected value of the sum is Y. No assumption about the distribution of y is needed. The only requirement is that every πᵢ be strictly positive, since a unit that cannot be selected can never be divided by anything. That requirement deserves emphasis. Weighting can correct for units that were selected with low probability. It cannot correct for units that had no probability of selection at all. A telephone survey conducted only on landlines cannot be weighted into representing people without landlines, however carefully its weights are constructed, because those people had πᵢ = 0. Coverage failure of this kind is a design problem, not a weighting problem, and no amount of analytic care downstream repairs it. From totals to means Most analyses target means and proportions rather than totals. The natural estimator of the population mean Ȳ = Y/N divides the Horvitz–Thompson total by N, and if N is known exactly this is unbiased. In practice N is often not known for the population of interest, and even when it is, a better estimator divides by the estimated population size instead: ȳ(w) = Σ wᵢ yᵢ / Σ wᵢ. This is the familiar weighted mean, often called the Hájek estimator after Jaroslav Hájek, who studied it in the 1960s and 1970s. It is a ratio of two random quantities and is therefore not exactly unbiased, but its bias is of order 1/n and negligible in samples of any reasonable size. It has two practical advantages over dividing by a known N. First, it is invariant to rescaling of the weights: multiply every weight by a constant and the estimate is unchanged, which matters because many public-use files distribute weights normalised to sum to the sample size rather than to the population. Second, it is usually more stable. When the weighted count of the sample happens to be larger than N, the weighted total of y tends to be larger too, and the ratio cancels much of that common fluctuation. A proportion is simply a mean of a variable that takes the values 0 and 1, so the same formula applies. And almost every statistic of practical interest, including a regression coefficient, a correlation, a median, or a ratio of two means, can be expressed as a function of weighted totals. That fact is what makes the variance methods of later chapters possible. A worked illustration Consider a stylised population of 10,000 adults, of whom 9,000 live in the majority population and 1,000 belong to a minority group. Suppose the true prevalence of some condition is 10 percent in the majority and 30 percent in the minority, so the overall prevalence is (900 + 300)/10,000 = 12 percent. A survey wants precise estimates for the minority group and so selects 400 people from each group. The majority are sampled at 400 in 9,000, a rate of about 4.4 percent; the minority at 400 in 1,000, or 40 percent. Suppose the sample happens to reproduce the population rates exactly, finding 40 cases among the majority sample and 120 among the minority. The unweighted prevalence is 160 cases out of 800, or 20 percent. That is badly wrong, and wrong in a predictable direction: the minority group, which has the higher rate, makes up half the sample but only a tenth of the population. The weights put this right. Each majority respondent has weight 9,000/400 = 22.5; each minority respondent has weight 1,000/400 = 2.5. The weighted number of cases is 40 × 22.5 + 120 × 2.5 = 900 + 300 = 1,200. The weighted count of respondents is 400 × 22.5 + 400 × 2.5 = 10,000. The weighted prevalence is 12 percent, exactly the population value. The example is trivially clean, but its structure recurs in every real survey. Where selection probabilities vary and the outcome is related to whatever drove that variation, unweighted estimates are biased, and the bias does not shrink as the sample grows. Doubling the sample to 800 in each group leaves the unweighted estimate at 20 percent. Weighting removes the bias by restoring each group to its population share. When weighting is unnecessary, and when it is harmful If the outcome is unrelated to the selection probabilities, weighting makes no difference to the expected value of the estimate, and it does make the estimate noisier. This is the core trade-off of weighting. Weights protect against bias from the design; they cost precision because a sample with unequal weights carries less information than an equally large sample with equal weights. Chapter 3 quantifies this cost. The point here is that the protection is unconditional while the cost is certain, and that is why design-based practice weights by default. An analyst who drops the weights because the outcome appears unrelated to selection is betting that the appearance is correct, and the bet is invisible in the output. A famous cautionary tale about the Horvitz–Thompson estimator runs the other way. In a 1971 essay on the foundations of survey inference, the statistician Debabrata Basu told of a circus owner who needed to estimate the total weight of his fifty elephants. Knowing from an earlier weighing that a middle-sized elephant called Sambo was typical, he proposed to weigh Sambo and multiply by fifty. The circus statistician insisted on a probability design and assigned Sambo a selection probability of 99/100, with the remaining probability spread over the other elephants, including 1/4,900 for the giant Jumbo. Sambo was duly selected, and the unbiased Horvitz–Thompson estimate of the herd's total weight was Sambo's weight multiplied by 100/99. Had Jumbo been selected, the estimate would have been 4,900 times Jumbo's weight. The statistician lost his job. Basu's point was that unbiasedness over hypothetical repetitions is not the same as a sensible estimate from the sample actually drawn, and that selection probabilities unrelated to the size of the thing being measured can produce estimators of absurd variance. The practical lesson is not that weighting is wrong but that good designs make the selection probabilities roughly proportional to the size of the quantity being measured, so that yᵢ/πᵢ varies little across units. When it does vary wildly, the Horvitz–Thompson estimator is unbiased and useless at the same time. Much of the art of weighting described in later chapters, including calibration, ratio estimation, and weight trimming, consists of trading a small, controlled bias for a large reduction in variance. The variance of a weighted estimator The Horvitz–Thompson paper also gave an exact variance for the estimator. It depends on the joint inclusion probabilities πᵢⱼ, the probability that units i and j are both selected. For designs of fixed sample size, Sen and, independently, Yates and Grundy showed in 1953 that the variance can be written as V(Ŷ) = ½ Σ Σ (πᵢ πⱼ − πᵢⱼ) (yᵢ/πᵢ − yⱼ/πⱼ)², with the double sum running over all distinct pairs of units in the population. This form makes the Basu lesson visible. The variance is small when yᵢ/πᵢ is nearly constant, which is exactly the condition that selection probabilities be proportional to size. The formula is elegant and almost never used directly in large-scale practice. It requires joint inclusion probabilities for every pair of sampled units, which are often intractable to compute for multistage designs and are never released on public data files. The practical methods that replace it, discussed in Chapters 6 to 8, all rest on one simplifying idea: treat the first-stage clusters as if they had been drawn with replacement within each stratum, and compute variance from the variation among cluster totals. That idea, and why it works as well as it does, is the bridge from the elegant theory of this chapter to the working tools used in every survey software package. Weights are not frequency weights One source of persistent error deserves a warning before going further. Many statistical packages accept a weight argument in their ordinary procedures, and the natural temptation is to pass the survey weight there. The result depends on how the package interprets the weight. Some treat it as a frequency weight, meaning that an observation with weight 22.5 represents 22.5 identical observations. Others treat it as an analytic or precision weight, meaning that the observation's variance is inversely proportional to its weight. Neither interpretation matches a survey weight. Under a frequency interpretation, the software believes the sample contains Σ wᵢ observations, perhaps millions, and reports standard errors hundreds of times too small. Under a precision interpretation, the point estimate is correct but the variance formula assumes independence and a particular error structure that the design does not supply. A survey weight, or sampling weight, says something different from both: it says how many population units the observation represents, and nothing about how precisely it was measured or how many copies of it exist. Only procedures written for survey data, which combine the weight with the stratum and cluster identifiers, compute the correct variance. The rest of this booklet builds up the machinery those procedures use. The next chapter turns to the structural features, strata and clusters, that shape variance at least as much as the weights themselves. Chapter 2: The Anatomy of a Complex Design Selection probabilities determine the weights, and the weights determine the point estimate. But two samples with identical weights can have very different precision, because precision depends on how the sample was assembled. A sample of 5,000 adults drawn one at a time from a national register carries far more information than a sample of 5,000 adults found by selecting 100 neighbourhoods and interviewing 50 people in each. Both samples might yield unbiased estimates with exactly the same weights. The second will have a much larger variance. Three structural features account for most of this: stratification, clustering, and the multistage selection through which clustering almost always arises. This chapter treats each in turn, then introduces the design effect, the single number that practitioners use to summarise their combined consequences. Stratification To stratify is to divide the population into non-overlapping groups before sampling and then draw a separate, independent sample within each group. The groups, called strata, are typically geographic regions, urban and rural areas, school types, firm size classes, or some combination. Stratification serves two purposes. The first is administrative and analytic: it guarantees a fixed sample size in each stratum, which may be needed for separate estimates by region or for fieldwork planning. The second is statistical: it removes the variation between strata from the sampling error. If the strata differ in their average values of the outcome, a simple random sample would sometimes, by chance, over-represent a high-value stratum and sometimes a low-value one, and that luck of the draw would add to the variance. A stratified sample fixes each stratum's share in advance and so eliminates that component. The estimator of a population total under stratification is simply the sum of the separate stratum estimates, Ŷ = Σₕ Ŷₕ, and because the stratum samples are independent, its variance is the sum of the stratum variances, V(Ŷ) = Σₕ V(Ŷₕ). This additivity is the most important fact about stratification for the analyst. It means the variance is computed within strata and then added. The differences between stratum means never enter the variance at all. Under proportionate allocation, where each stratum's sample share equals its population share, stratification can never make a mean less precise than simple random sampling of the same size, apart from a negligible term in small samples, and it helps in proportion to how different the stratum means are. The gain is often modest for household surveys, where the strata are geographic and most of the variation in personal characteristics lies within areas rather than between them. It can be large in business and institutional surveys, where size classes differ enormously. Disproportionate allocation is another matter. Jerzy Neyman showed in 1934 that the allocation minimising the variance of an estimated total for a fixed sample size sets the stratum sample size proportional to Nₕ Sₕ, the stratum population size multiplied by the stratum standard deviation. Strata that are large or internally variable receive more sample. When the stratum standard deviations differ substantially, as they do between large and small firms, Neyman allocation can deliver dramatic gains. When the allocation departs from proportionality for other reasons, such as oversampling a small region to support a separate estimate, the weights become unequal, and the resulting loss of precision for national estimates can outweigh the gain from stratification. Designers accept this trade knowingly. Analysts should understand that it has been made. A practical detail matters here. For variance estimation, the analyst needs to know the strata that were used in selection, because the variance is computed within them. Survey organisations sometimes release these strata directly; more often, for confidentiality, they release pseudo-strata or masked variance units, which group or recode the real design strata in ways that preserve approximately correct variance estimates while preventing identification of geographic areas. The public files of the United States National Health and Nutrition Examination Survey, for example, provide masked variance pseudo-strata and pseudo-PSUs for this purpose, with two pseudo-PSUs in each pseudo-stratum. These codes are not geography and should not be used as analytic variables. Their only job is to feed the variance formula. Clustering Stratification divides the population into groups and samples from every group. Clustering divides it into groups and samples some of the groups. The distinction is fundamental, and it has opposite consequences for variance. In a cluster sample, the population is partitioned into clusters, which might be villages, city blocks, schools, hospitals or households, and a sample of clusters is selected. Then either all units within each selected cluster are observed, or a subsample is taken from each. The motive is cost. Listing every adult in a country is impossible, but listing the dwellings in a few hundred selected neighbourhoods is feasible. Sending interviewers to 5,000 scattered addresses is expensive; sending them to 100 neighbourhoods and having each complete 50 interviews is much cheaper. Testing pupils in 150 schools is far easier than testing individually sampled pupils in 3,000 schools. The cost of clustering is statistical. People in the same neighbourhood tend to resemble one another: they share housing markets, labour markets, water supplies, schools, and often ethnicity and income. Pupils in the same school share teachers and curricula. The 50 interviews in a neighbourhood therefore do not provide 50 independent pieces of information. They provide something less, and how much less depends on how similar the members of a cluster are. The standard measure of within-cluster similarity is the intraclass correlation coefficient, written ρ (rho). It is the correlation between the values of two different units drawn from the same cluster, and it can be interpreted as the share of the total variance of the outcome that lies between clusters rather than within them. When ρ is zero, clusters are internally as diverse as the population and cluster sampling costs nothing in precision. When ρ is one, every member of a cluster has the same value, so observing one member tells you everything about the rest, and interviewing 50 people per cluster yields no more information than interviewing one. In real household surveys ρ is usually small for personal characteristics such as age or attitudes, often well below 0.05, and substantially larger for characteristics determined at the area level, such as access to public services, housing type, or exposure to local environmental conditions. Educational achievement measured within schools commonly has much larger intraclass correlations than attitudes measured within neighbourhoods. Because ρ varies across variables, a single survey has no single precision: some of its estimates are nearly as precise as a simple random sample would give, while others from the same respondents are far less so. The design effect In his 1965 book Survey Sampling, Leslie Kish introduced the design effect, abbreviated deff, as a compact way of expressing the combined influence of a design on precision. It is the ratio of the actual variance of an estimator under the design to the variance it would have under a simple random sample of the same size: deff = V(design) / V(SRS). A design effect of 1 means the design is as efficient as simple random sampling. A value of 2 means the variance is twice as large, so that the standard error is larger by a factor of √2 ≈ 1.41. The effective sample size, n/deff, is the size of a simple random sample that would give the same precision. A sample of 4,000 with a design effect of 2 contains roughly as much information about that particular estimate as a simple random sample of 2,000. For a cluster sample in which each cluster contributes m units, Kish derived the approximation deff ≈ 1 + (m − 1) ρ. This formula repays close attention because it shows how modest correlations become large variance penalties. With 20 interviews per cluster and ρ = 0.05, the design effect is 1 + 19 × 0.05 = 1.95. The standard error is inflated by about 40 percent, and a sample of 4,000 behaves like one of about 2,050. With ρ = 0.2, a value not unusual for area-level variables, the design effect reaches 4.8 and the effective sample falls below 850. Doubling the cluster take to 40 interviews, a tempting economy, pushes the design effect for ρ = 0.05 to 2.95. The formula also explains why the design effect depends on the estimate. For the whole-sample mean, m is the full cluster take. For a subgroup that makes up a quarter of each cluster, the relevant m is roughly a quarter as large, so design effects for subgroup estimates are typically smaller than for totals. For differences between subgroups that are spread evenly across clusters, positive within-cluster correlation can partly cancel, and design effects for such comparisons are sometimes below one. For regression coefficients, the design effect depends on the intraclass correlation of both the predictor and the residual; a predictor that varies mostly within clusters is estimated with little penalty even when the outcome is strongly clustered. Kish also separated out a second contributor: unequal weights. When weights vary for reasons unrelated to the outcome, they inflate variance by a factor of approximately 1 + CV², where CV is the coefficient of variation of the weights. Chapter 3 develops this. For a design with both clustering and unequal weights, a common rough approximation multiplies the two components together. The approximation is useful for planning and for quick checks, but it is not a substitute for proper variance estimation, which captures the actual interaction of weights, strata and clusters for each statistic. A related concept, introduced by Skinner, Holt and Smith in their 1989 book Analysis of Complex Surveys, is the misspecification effect. It compares the true variance to the variance the analyst would compute by wrongly assuming simple random sampling. Where the design effect describes a property of the design, the misspecification effect describes the consequence of ignoring it. For the most common error, computing a naive standard error from clustered data, the two are closely related, and a misspecification effect of 2 means the naive confidence interval covers the true value much less often than its stated level. Multistage selection Clustering in practice nearly always takes the form of multistage sampling. A typical national household survey selects primary sampling units, often census enumeration areas or groups of them, within geographic strata. It then selects dwellings within each primary sampling unit and people within each dwelling. Some designs add intermediate stages, such as blocks within enumeration areas. Primary sampling units are commonly selected with probability proportional to size, where size is a measure such as the number of dwellings recorded at the last census. A fixed number of dwellings is then taken within each selected unit. If the size measures were accurate, every dwelling would have the same overall selection probability: a large area is more likely to be selected, but each of its dwellings is less likely to be chosen within it, and the two effects cancel. Such designs are called self-weighting at the dwelling level. In practice the size measures are out of date, new housing has been built and old housing demolished, and the cancellation is only approximate, so dwelling weights vary somewhat even in a nominally self-weighting design. The overall inclusion probability for a person is the product of the conditional probabilities at each stage: the probability that their primary sampling unit is selected, times the probability that their dwelling is selected given the unit, times the probability that they are selected given the dwelling. The base weight is the reciprocal of that product. For variance estimation, multistage designs present what looks like a formidable problem. Each stage contributes its own component of variance, and exact formulas require selection probabilities, often including joint probabilities, at every stage. Hansen, Hurwitz and Madow, in their 1953 treatise on sample survey methods, showed how to sidestep most of this. If the primary sampling units are treated as having been selected with replacement, the variance of an estimated total can be estimated entirely from the variation among the weighted totals of the primary units within each stratum, whatever happened at later stages. The later-stage variation is automatically included, because each primary unit's estimated total already reflects the subsampling within it. This is the ultimate cluster approach, so called because it treats each primary unit, with everything sampled inside it, as a single final cluster. The with-replacement assumption is not literally true; primary units are almost always selected without replacement. The consequence is that ultimate cluster variance estimates omit a finite population correction at the first stage and tend to be slightly conservative, overstating the variance. When the first-stage sampling fraction is small, as it is in most national surveys where a few hundred areas are chosen from tens of thousands, the overstatement is negligible. When the sampling fraction is large, such as selecting half of the schools in a small region, it can matter, and some software allows finite population corrections or explicit multistage specifications for this reason. The ultimate cluster idea is what makes public-use survey files possible. The analyst needs only three things per respondent: the final weight, a stratum code, and a primary sampling unit code. Everything else about the design, however complicated, is summarised in how those three variables are arranged. How the features combine Stratification, clustering and weighting interact, but their broad effects on estimation can be summarised simply. Table 1 sets out how each feature typically affects the point estimate and its variance, and what the analyst must supply to software to account for it. Table 1. Design features and their consequences for analysis. Design feature Effect on point estimate Typical effect on variance What analysis requires Stratification None if weights are used Decreases, often modestly Stratum identifiers Clustering None if weights are used Increases, by roughly 1 + (m − 1)ρ Primary sampling unit identifiers Unequal selection probabilities Bias if ignored and related to outcome Increases, by roughly 1 + CV² Base weights Nonresponse adjustment Reduces bias under assumed model Usually increases; can decrease Adjusted weights; ideally replicate weights Calibration to known totals Reduces bias and aligns with benchmarks Often decreases for related outcomes Final weights; replicate weights or calibration variables The table makes the chapter's central point concrete. A correctly weighted analysis that ignores strata and clusters will usually have the right point estimates. Its standard errors will be wrong, and for most household surveys they will be too small, because clustering typically dominates stratification. The size of the error differs for every statistic, which is why no single correction factor can be applied after the fact. The minimum number of clusters One final design feature has an outsized effect on analysis: the number of primary sampling units. Variance under the ultimate cluster approach is estimated from differences among primary units within strata. The effective amount of information available to estimate variance is governed not by the number of respondents but by the number of primary units minus the number of strata. This quantity is the design degrees of freedom. Many national designs select exactly two primary units per stratum, because this is the most efficient way to stratify deeply while still allowing variance estimation. A design with 30 strata and 60 primary units then has 30 design degrees of freedom, regardless of whether it interviewed 3,000 people or 30,000. Confidence intervals and tests should be based on reference distributions with that number of degrees of freedom, and statistics that require estimating many variance components simultaneously, such as tests on many regression coefficients at once, can become unstable when the number of parameters approaches the design degrees of freedom. Chapter 9 returns to this. A stratum with only one primary unit, whether by design or because a subgroup analysis has left only one, provides no information at all about its own variance. It cannot contribute a difference between primary units because there is only one. Every software package handles this problem somehow, and the handling matters. For now it is enough to note that the number of clusters, not the number of interviews, sets the ceiling on what a complex survey can say about its own uncertainty. Chapter 3: Building the Weight The final weight on a survey data file is rarely the simple reciprocal of a selection probability. It is the end product of a sequence of adjustments, each designed to repair a particular departure from the ideal of a probability sample in which everyone selected responds. Understanding that sequence matters for the analyst in two ways. It explains what the weight is and is not correcting for, which bears on how far the estimates can be trusted. And it identifies the steps that introduce extra variability, which a correct variance estimate must capture. A typical sequence has four stages: base weights, adjustment for unknown eligibility, adjustment for nonresponse, and calibration to external totals. Weight trimming may be inserted at one or more points. This chapter covers the first three and trimming. Calibration, which is the subject of a large theory of its own, is treated in Chapters 4 and 5. Base weights The base weight, also called the design weight, is the reciprocal of the overall inclusion probability, built up as the product of the reciprocals of the selection probabilities at each stage. For a person selected in a three-stage household design, w(base) = 1 / [P(area) × P(dwelling | area) × P(person | dwelling)]. Two practical wrinkles are common. The first concerns within-household selection. If one adult is chosen at random from a household of k adults, the conditional probability is 1/k and the corresponding factor in the weight is k. In a household with seven adults, that factor is seven. Some organisations cap this factor at a modest value, accepting a small bias in exchange for avoiding a handful of very large weights. The second concerns units that turn up more than once on a frame, such as a person reachable through two telephone numbers or a business listed under two addresses. A unit with multiple chances of selection has a correspondingly higher inclusion probability, and its weight should be divided by the number of chances. Surveys that sample from more than one frame at once face a generalised version of this problem, known as multiple-frame estimation, which is handled by adjusting weights for the overlap between frames. Eligibility Many selected units turn out to be out of scope: vacant dwellings, businesses that have closed, telephone numbers that belong to firms rather than households. These are simply dropped. Their weights are not redistributed, because they represent parts of the frame that are also out of scope in the population. The difficulty arises with units whose eligibility is never determined, such as an address where nobody ever answers the door or a telephone number that rings without reply. Some of these are eligible and some are not. The standard approach distributes the weight of the unknown-eligibility cases across the known-eligible and known-ineligible cases in proportion to their weighted counts, usually within groups of similar units. This effectively assumes that among cases of unknown status, the eligibility rate is the same as among comparable cases whose status was resolved. The assumption is often doubtful, since vacant dwellings and non-working numbers are over-represented among non-contacts, but it is rarely possible to do better without additional information from the frame or from follow-up studies. Nonresponse adjustment Among eligible selected units, some respond and some do not. If the nonrespondents were a random subsample of the selected units, the respondents' base weights would simply need to be scaled up by the inverse of the response rate. They are not a random subsample. Response rates differ by age, sex, region, household composition, urbanicity and many other characteristics, and nonresponse adjustment attempts to compensate for these differences. The logic is a direct extension of the Horvitz–Thompson idea. Each respondent reached the data file through two random processes: selection by the design, with known probability πᵢ, and response given selection, with unknown probability φᵢ. The probability of appearing in the respondent sample is therefore πᵢφᵢ, and the correctly weighted estimator divides by that product. Since φᵢ is unknown, it must be estimated, and the quality of nonresponse adjustment depends entirely on how well that estimation is done. The estimation rests on an assumption, usually called missing at random in the terminology of Donald Rubin: that within groups defined by characteristics known for both respondents and nonrespondents, response is unrelated to the survey outcomes. If people aged 18 to 24 in urban areas respond at a rate of 40 percent, the assumption is that the 40 percent who responded resemble the 60 percent who did not, as far as the survey's questions are concerned. The assumption cannot be tested from the survey data. It can only be made more plausible by adjusting for many relevant characteristics and by drawing on external evidence. Weighting class adjustment The simplest and still very common method divides the eligible sample into weighting classes, or adjustment cells, based on variables known for everyone selected. Within each class c, the adjustment factor is the ratio of the weighted count of all eligible selected units to the weighted count of respondents: f(c) = Σ w(base) over eligible units in c / Σ w(base) over respondents in c. Each respondent's weight is multiplied by the factor for its class, and nonrespondents' weights are set to zero. The weighted total of respondents in each class then equals the weighted total of all eligible units in that class, so the nonrespondents' share of the population has been transferred to the respondents who most resemble them. A small example shows the mechanics. Suppose an address sample yields 1,200 eligible households in urban areas and 800 in rural areas, each with a base weight of 500. Urban response is 600 households, or 50 percent; rural response is 560, or 70 percent. The urban adjustment factor is (1,200 × 500)/(600 × 500) = 2.0 and the rural factor is (800 × 500)/(560 × 500) ≈ 1.43. The adjusted weights are 1,000 for urban respondents and about 714 for rural respondents. The responding sample is 52 percent urban by count, but the adjusted weights restore the urban share of the weighted total to 60 percent, which is what it was among all eligible households. The choice of classes is where judgement enters. Classes need to be homogeneous with respect to response propensity and, crucially, with respect to the outcomes. Roderick Little and Sonya Vartivarian, in a 2005 paper in Survey Methodology with the pointed title "Does weighting for nonresponse increase the variance of survey means?", showed that the effect of a nonresponse adjustment depends on both relationships at once. Adjusting for a variable that predicts response but not the outcome increases variance while doing nothing for bias. Adjusting for a variable that predicts both reduces bias and can even reduce variance. Adjusting for a variable that predicts the outcome but not response has little effect on bias but can reduce variance. The lesson is that good adjustment variables are those related to what the survey measures, not merely to who responds. Classes also need enough respondents to give stable factors. A class with 20 selected units and two respondents produces a factor of ten on noisy evidence, and a handful of such classes can dominate the variance of the whole survey. Common practice sets a minimum number of respondents per class, often somewhere around twenty to thirty, and a maximum adjustment factor, collapsing small or extreme classes with their neighbours until both conditions hold. Response propensity modelling When many auxiliary variables are available, cross-classifying all of them produces far too many cells. The alternative is to model response directly. A logistic regression of the response indicator on the auxiliary variables, fitted to all eligible selected units and weighted by base weights, produces an estimated response propensity φ̂ᵢ for each respondent. The adjusted weight is then w(base)/φ̂ᵢ. Direct inverse-propensity adjustment can produce extreme weights when some respondents have very small predicted propensities. A widely used compromise, following ideas from Rosenbaum and Rubin's work on propensity scores in observational studies and applied to surveys by Little and others, sorts the sample by estimated propensity and divides it into a small number of classes, commonly five, of roughly equal size. The weighting class adjustment is then applied within those propensity classes. This retains most of the bias reduction of the model while guarding against unstable individual factors. Tree-based methods and other machine learning approaches are also used to form classes, particularly when the auxiliary data are extensive and their interactions unknown. Whatever the method, the adjustment is an estimate, and its uncertainty is part of the uncertainty of every survey statistic computed with the adjusted weights. Linearization methods that treat the final weights as fixed ignore that uncertainty. Replication methods capture it if, and only if, the adjustment is repeated separately within every replicate. Chapter 7 returns to this, because it is one of the strongest practical arguments for replication. The variance cost of unequal weights Weights that vary across respondents cost precision. The intuition is that a sample in which a few respondents carry very large weights relies heavily on those few, and the estimate inherits their idiosyncrasies. Kish gave a widely used approximation for this cost. When the weights are unrelated to the outcome, the variance of a weighted mean is inflated relative to an equally weighted mean by the factor deff(w) = n Σ wᵢ² / (Σ wᵢ)² = 1 + CV², where CV is the coefficient of variation of the weights, their standard deviation divided by their mean. The derivation is short. If the yᵢ are independent with common variance σ², the variance of Σwᵢyᵢ/Σwᵢ is σ² Σwᵢ²/(Σwᵢ)², while the variance of the unweighted mean is σ²/n. Their ratio is the expression above. The formula gives a useful rule of thumb. Weights whose coefficient of variation is 0.5 inflate variance by 25 percent. A coefficient of variation of 1, which is not unusual after heavy oversampling of subgroups followed by nonresponse adjustment, doubles the variance. The corresponding effective sample size is (Σwᵢ)² / Σwᵢ², a quantity every analyst can compute directly from the weight column and which gives an immediate sense of how much information the weighting has consumed. Kish's approximation assumes the weights are unrelated to the outcome, which is often not the case. When weights are positively related to the outcome, as when high-weight respondents are drawn from strata with high values, the actual variance cost may differ substantially, and the weighted estimate may even be more precise than the approximation suggests. The formula is best understood as describing the cost of weighting that serves no purpose for the variable at hand: an upper bound on what the analyst pays for protection that turns out to be unneeded. Trimming extreme weights Extreme weights arise from many sources: a within-household factor for a large household, a nonresponse adjustment in a class with low response, a small primary unit whose size measure was badly understated, a respondent in a sparsely sampled stratum. A single very large weight can shift an estimate substantially and inflate its variance. Trimming caps weights at some threshold and redistributes the excess among the remaining units, typically within the same adjustment class, so that weighted totals are preserved. Thresholds are set in various ways: as a multiple of the median or mean weight, as a percentile of the weight distribution, or through more formal procedures that estimate the mean squared error of the resulting estimates. Frank Potter reviewed a range of such procedures in a 1990 paper in the proceedings of the American Statistical Association's Survey Research Methods Section, and his comparison remains a standard reference. Trimming introduces bias, since the trimmed units no longer represent their full share of the population, in exchange for a reduction in variance. The trade is favourable when the extreme weight arises from something unrelated to the outcome and unfavourable when the extreme weight carries real information about a distinctive part of the population. There is no universal rule. Trimming is also usually followed by recalibration, so that the final weights still reproduce the population totals, and the recalibration may partially undo the trimming, which is why some organisations iterate between the two. For the analyst of a public file, the practical point is that the weight on the file already embodies decisions about trimming, collapsing and capping. Re-trimming it further is rarely advisable without access to the design information that the producer used. If a small number of weights look implausibly large, the right step is to compute estimates with and without the few affected cases, report the sensitivity, and consult the documentation, not to impose an ad hoc cap. The weight as a record of assumptions By the time a weight reaches a data file it has been through perhaps half a dozen stages, each resting on its own assumption: that the frame covered the population, that selection probabilities were computed correctly, that unresolved cases have the same eligibility rate as resolved ones, that nonrespondents resemble respondents within classes, that trimming did more good than harm. The design-based guarantee of unbiasedness holds for the first two stages. Every subsequent stage replaces that guarantee with a modelling assumption. This does not mean survey estimates are unreliable. It means that a weight is best read as a structured record of the producer's assumptions about the relationship between sample and population, and that the variance estimated from the design captures sampling error only. Bias from nonresponse that the adjustment classes did not capture appears in no standard error. The next two chapters turn to calibration, the final stage of weighting, which is where auxiliary population information enters most directly, and which can repair some of what nonresponse adjustment leaves undone. Hashtags: #SurveyWeightingAndComplexDesignAnalysis #ComplexSurveyAnalysis #SurveyWeights #DesignBasedInference #HorvitzThompsonEstimator #HajekEstimator #StratifiedSampling #ClusterSampling #MultistageSampling #PrimarySamplingUnits #DesignEffect #IntraclassCorrelation #UnequalProbabilitySampling #NonresponseAdjustment #CalibrationWeighting #Raking #TaylorLinearization #JackknifeReplication #BalancedRepeatedReplication #FayBRR #SurveyBootstrap #ReplicateWeights #SubpopulationAnalysis #SurveyRegression #FutureOfComplexSurveyAnalysis

Download the Book (PDF): Introduction In 1958 Edward Kaplan and Paul Meier published a paper in the Journal of the American Statistical Association on estimating a survival curve from incomplete observations. The two men had submitted separate manuscripts on the same problem, and the editor, John Tukey, persuaded them to merge their work. The result became one of the most cited papers in the history of science. Its central insight is so plain that it is easy to overlook: when you follow people over time, some of them leave your view before anything happens to them, and throwing those people away, or pretending they had the event, gives the wrong answer. The right move is to use each person for exactly as long as you watched them, and no longer. Fourteen years later David Cox read a paper to the Royal Statistical Society titled "Regression models and life-tables". It proposed that the instantaneous risk of an event could be written as an unspecified baseline function of time multiplied by an exponential function of covariates, and it showed how to estimate the covariate effects without ever estimating the baseline. The proportional hazards model now sits in almost every randomised trial report in oncology and cardiology, in most cohort studies of chronic disease, and in a large share of the machine-learning papers that claim to predict mortality. The hazard ratio has become the default currency of clinical evidence. This book is about what happened between those two papers and the present, and about how to use the resulting toolkit well. Its controlling idea is simple to state and harder to practise: every time-to-event analysis answers a specific question about time, and the method must be chosen to match that question and the way the data went missing, not chosen by habit. A Kaplan–Meier curve answers one question. A Cox model answers a different one. A cumulative incidence function in the presence of competing deaths answers a third, and a multi-state model a fourth. Most of the errors that reach print in biomedical journals are not arithmetic mistakes. They are the right calculation attached to the wrong question. Why time-to-event data are different Three features make survival data awkward. The first is censoring. In a trial that recruits over three years and stops follow-up on a fixed date, a patient randomised in the final month contributes a few weeks of observation; a patient randomised on day one contributes three years. Neither has necessarily had the event. Their data are incomplete in a structured way, and the structure is informative only if we treat it correctly. The second is that the outcome is a duration, and durations are skewed, bounded below by zero, and often have a long right tail. The mean survival time is rarely estimable from real data because the longest survivors have not yet finished surviving. This is why median survival, survival at fixed landmarks such as five years, and the restricted mean survival time appear so often, and why ordinary linear regression on observed times is almost always wrong. The third is that time itself changes things. A patient's risk of death in the month after cardiac surgery is not the same as in the fifth year. Treatment effects can emerge slowly, as with immune checkpoint inhibitors, or fade, as with some adjuvant therapies. Covariates such as blood pressure or viral load change during follow-up. Patients may pass through intermediate states such as relapse, transplant, or hospital admission before reaching the event of interest, or be removed from risk entirely by a different event. A method that treats the whole of follow-up as one undifferentiated block will blur all of this. Who this book is for The intended reader has met a Kaplan–Meier curve and a hazard ratio, perhaps has fitted a Cox model in R, Stata or SAS, and wants to understand what these objects actually estimate, when they mislead, and what to use instead. That reader might be a clinical researcher writing a protocol, an epidemiologist analysing a registry, a trial statistician defending an analysis plan, a health economist extrapolating survival beyond trial follow-up, or a journal reviewer trying to decide whether a competing risks analysis was done correctly. Mathematical notation is kept to short formulas written inline, and each is explained in words. Where software matters, the book names the functions that practitioners actually use, mainly in the R survival, cmprsk, flexsurv, mstate and msm packages and their Stata and SAS equivalents. How the book is organised The eight chapters move from the data to the models to the richer structures that real disease processes demand. Chapter 1 sets out the vocabulary of incompleteness: right, left and interval censoring, left truncation or delayed entry, and the assumption of non-informative censoring on which almost everything else depends. It shows how getting the time origin wrong, or ignoring delayed entry, produces bias before any model is fitted. Chapter 2 turns to description. It builds the Kaplan–Meier estimator by hand on a small data set, explains Greenwood's variance formula and the Nelson–Aalen estimator of the cumulative hazard, and introduces the summary measures that should accompany a survival curve: the median with its confidence interval, landmark survival probabilities, and the restricted mean survival time. Chapter 3 is about comparing groups. The log-rank test is derived as a sum of observed-minus-expected counts, its weighted cousins are set beside it, and the chapter explains why power in survival studies depends on the number of events rather than the number of patients, with a worked sample-size calculation using Schoenfeld's formula. Chapter 4 presents the Cox model: the partial likelihood, the interpretation of a hazard ratio, the handling of tied event times, stratification, and time-varying covariates. It gives particular attention to immortal time bias, the most expensive single error in observational survival research. Chapter 5 addresses the proportional hazards assumption. It covers Schoenfeld residuals and the Grambsch–Therneau test, but its main argument is that the assumption is usually false over long follow-up and that the right response is often to report a different estimand, not to hunt for a test that passes. Chapter 6 covers parametric and accelerated failure time models: exponential, Weibull, log-logistic, log-normal and generalised gamma distributions, flexible spline-based models in the Royston–Parmar tradition, and the specific problem of extrapolating survival for health technology assessment. Chapter 7 is about competing risks. It explains why one minus the Kaplan–Meier estimate overstates the probability of an event when a competing event can occur, distinguishes the cause-specific hazard from the subdistribution hazard of Fine and Gray, and gives rules for which to report when the question is aetiological and which when it is prognostic. Chapter 8 generalises to multi-state models, of which competing risks is the simplest case. The illness–death model, the Markov and semi-Markov assumptions, the Aalen–Johansen estimator of transition probabilities, and the practical workflow for building such models in the mstate and msm packages are all covered, along with the circumstances in which the extra effort is warranted. The Conclusion draws out what follows from these chapters for the design, analysis and reporting of studies, and names the questions that remain unsettled. A note on the estimand Since 2019, when the International Council for Harmonisation adopted its addendum E9(R1) on estimands and sensitivity analysis, regulators have asked trialists to state precisely what treatment effect they intend to estimate before choosing a method. The estimand framework asks five questions: which population, which treatment conditions, which variable, how intercurrent events such as treatment switching or death are handled, and which population-level summary is used. Survival analysis was, in a sense, the field that needed this discipline most. A hazard ratio, a difference in five-year survival, a difference in restricted mean survival time, and a ratio of cumulative incidences are different summaries, and they can point in different directions on the same data. Competing events and intermediate events such as relapse are intercurrent events by another name. Throughout the book, therefore, each method is introduced together with the question it answers. When the reader finishes, the hope is that the first question they ask of any survival analysis, their own or someone else's, will not be "was the model fitted correctly?" but "what exactly is this number an estimate of, and is that what we wanted to know?" Chapter 1. Time, Events and the Structure of Incompleteness Every survival analysis rests on three definitions that are often left implicit: when the clock starts, what counts as the event, and what happens to people who are no longer being watched. Mistakes in these definitions cannot be repaired by any model fitted later. This chapter sets out each of them and the vocabulary of censoring and truncation that describes how survival data come to be incomplete. The time origin, the time scale and the event The time origin is the moment at which every participant becomes at risk in the sense the question requires. In a randomised trial it is almost always the date of randomisation, because that is when the groups are comparable and when treatment assignment takes effect. In a cohort of newly diagnosed patients it is usually the date of diagnosis. In a study of the effect of a drug in routine care it should be the date the drug is started, or, for a comparison of starters with non-starters, a date that both groups share, a point taken up again in Chapter 4. The origin matters because it fixes what "survival time" means. Two cancer registries that measure survival from diagnosis will disagree if one registry diagnoses tumours earlier through screening. The screened patients will appear to live longer even if the date of death is unchanged, a phenomenon called lead-time bias. The problem is not in the analysis but in the choice of origin, and the only honest remedy is to recognise that "survival from diagnosis" is not a fixed biological quantity. The time scale is the clock on which risk is assumed to change. Time since randomisation is natural for a trial. For studies of age-related disease in a general population cohort, such as the UK Biobank, many analysts use age as the time scale, so that each participant enters the risk set at their age at recruitment and leaves at their age at event or censoring. Using age as the time scale compares people of exactly the same age at each event time, which controls for age more finely than including it as a covariate. The Cox model in Chapter 4 accommodates either choice, but the choice must be made deliberately. The event must be defined so that its date can be ascertained with similar accuracy in everyone. Death from any cause is the cleanest endpoint: it is unambiguous and, in countries with national death registration, can be ascertained even after a participant stops attending clinic. Cause-specific death depends on death certificates and adjudication, with all their known inaccuracies. Composite endpoints such as progression-free survival (progression or death, whichever comes first) or major adverse cardiovascular events (typically cardiovascular death, non-fatal myocardial infarction and non-fatal stroke) increase the number of events and hence statistical power, but they combine components that may differ greatly in importance to patients and may respond differently to treatment. Progression detected by scheduled imaging has a further property: its date is only known to lie between two scans, a matter taken up below under interval censoring. Right censoring and what it assumes A survival time is right censored when we know only that the event had not occurred by a certain time. Right censoring is by far the most common kind. It arises in three ways. Administrative censoring happens when the study closes for analysis on a fixed date and some participants are still event-free. Loss to follow-up happens when participants move away, withdraw consent or stop attending. Censoring by design happens when a protocol stops follow-up at a fixed horizon, for example five years after enrolment. The data for each person consist of an observed time, which is the smaller of the event time and the censoring time, and an indicator that records which of the two was observed. The whole machinery of survival analysis is built on these pairs. Everything depends on one assumption about them: that, conditional on the covariates in the model, the censoring time carries no information about the event time. This is usually called independent or non-informative censoring. Formally, the hazard of the event among people still under observation at time t must equal the hazard among everyone in the population who has survived to t, whether or not they are still being watched. Administrative censoring nearly always satisfies this assumption, because the date on which the analysis is run has nothing to do with any individual's prognosis. The one exception is when the kind of patient recruited changes over calendar time. If a trial recruits sicker patients early, as sometimes happens when a new therapy is first offered to those with the fewest alternatives, then late recruits, who are more likely to be administratively censored, are also healthier. The fix is to include the relevant prognostic factors or calendar period as covariates. Loss to follow-up is where the assumption is most at risk. Patients who stop attending an HIV clinic are, in many settings, more likely to have died or to have become too ill to travel. In a now well-known series of studies of antiretroviral programmes in sub-Saharan Africa, tracing of patients classified as lost to follow-up found that a substantial fraction had died, which meant that clinic-based estimates of mortality had been too low. Where tracing is impossible, the standard defence is to measure the covariates that predict both dropout and the event, include them in the model, and, where censoring depends on time-varying factors, use inverse probability of censoring weights. These weights upweight those who remain under observation and resemble those who were lost, so that the observed risk set stands in for the full one. They require a model for censoring, and they can only correct for dropout that is explained by measured factors. The independent censoring assumption cannot be tested from the observed data alone. What can be done is to check its plausibility: compare the baseline characteristics of those censored early with those followed longer, compare the pattern of censoring between treatment arms, and conduct sensitivity analyses. A simple but informative sensitivity analysis sets two extremes. In the first, every participant lost to follow-up is assumed to have had the event on the day after they were last seen. In the second, every such participant is assumed to have remained event-free until the end of the study. If the conclusions hold at both extremes, informative censoring cannot overturn them. If they do not, the reader deserves to know. A related quantity worth reporting is the completeness of follow-up. The reverse Kaplan–Meier method, which treats censoring as the "event" and events as censored, estimates the median potential follow-up time: how long patients would have been followed had none of them had the event. It is preferable to the median observed time among all patients, which is pulled down by early deaths and so understates how mature the data are. The widely cited 1996 note by Michael Schemper and Terry Smith in Controlled Clinical Trials sets out this reasoning. Left censoring, interval censoring and truncation Left censoring occurs when the event is known to have happened before a certain time, but not exactly when. In a study of the age at which children first acquire a particular antibody, a child who is already seropositive at the first blood draw at age two has a left-censored time: the seroconversion occurred at some age below two. Left censoring is common in studies of the onset of chronic infections, of the age at which a developmental milestone is reached, and in assays with a limit of detection, where a concentration below the limit is known only to lie somewhere between zero and that limit. The last case is not a survival problem in the everyday sense, but the mathematics is identical, and survival software is often used for it. Interval censoring occurs when the event is known to have happened between two observation times. It is the rule rather than the exception for events detected by periodic examination: tumour progression detected on a CT scan performed every eight weeks, diabetic retinopathy detected at an annual eye screening, HIV seroconversion between two negative-then-positive tests, or cognitive decline crossing a threshold between two clinic visits. Strictly, left censoring is a special case of interval censoring with a lower bound of zero, and right censoring is the case with an upper bound of infinity. The common practice of imputing the event at the date of the first positive examination, and then analysing the data as if exactly observed, is not harmless. It systematically shifts events later, and when the assessment schedules differ between treatment arms it creates a spurious difference. This is why oncology trial guidance, including the regulatory guidance of the US Food and Drug Administration and the European Medicines Agency on progression-free survival, insists on identical imaging schedules across arms. When assessment schedules are the same, the bias from right-endpoint imputation tends to be similar in both arms, and a hazard ratio comparison is approximately valid, but estimates of median progression-free time are biased upwards. The correct nonparametric estimator for interval-censored data is the Turnbull estimator, published by Bruce Turnbull in 1976, which assigns probability mass to intervals rather than to single points. Parametric models, discussed in Chapter 6, handle interval censoring naturally through the likelihood, and the R packages icenReg and interval, and the SAS procedure ICLIFETEST, make these analyses routine. Truncation is different from censoring and more often misunderstood. A censored observation is someone we know exists and have partial information about. A truncated observation is someone we never see at all, because their event occurred outside the window in which we could have recruited them. Left truncation, also called delayed entry, is the most important form in medicine. Suppose a registry of people living with a rare genetic disease enrols patients when they first attend a specialist centre, and survival is measured from birth. Patients who died in childhood, before any centre existed or before they were referred, never appear. The patients who do appear are survivors to their age at enrolment, and if we analyse their survival from birth as though they had been under observation since birth, we overestimate survival, sometimes badly. The correction is conceptually simple. Each participant should enter the risk set only at the time at which they became observable, their age or time since diagnosis at enrolment, and remain in it until their event or censoring. In R this is expressed with the counting-process form of the survival object, Surv(entry, exit, event), and in Stata with the enter option of stset. The Kaplan–Meier and Cox methods then compute risk sets correctly. A well-known practical consequence is that when very few people are under observation at early times, because most entered late, the estimated survival curve at those times can be unstable, and a single early death among a handful of people at risk can pull the curve down sharply. Some analysts address this by starting the curve at the time from which a reasonable number are at risk and reporting survival conditional on reaching that time. Right truncation arises when only those who have had the event by a certain date are included. The classic example is early studies of the incubation period of transfusion-associated AIDS, in which cases were identified only once they had developed AIDS, so that people with long incubation periods had not yet been observed. Estimating the incubation distribution from such data requires methods that condition on the event having occurred before the sampling date. The same problem recurs whenever a newly emerging disease is studied in real time from notified cases, as the early analyses of COVID-19 incubation periods and delays from symptom onset to death demonstrated in 2020. Table 1 gathers these forms of incompleteness together with a typical example and the usual remedy. Table 1. Forms of incomplete observation in time-to-event data. Type What is known Typical biomedical example Standard remedy Right censoring Event after last contact Alive at data cut-off Kaplan–Meier, Cox, parametric likelihood Left censoring Event before first observation Already seropositive at first test Parametric likelihood; Turnbull Interval censoring Event between two visits Progression between scheduled scans Turnbull estimator; parametric or spline models Left truncation Only survivors to entry are seen Registry enrolling prevalent cases Delayed entry in risk sets Right truncation Only those with event by a date are seen Incubation period from notified cases Reverse-time or conditional likelihood Prevalent cohorts and the choice of whom to count Left truncation often hides inside a design decision rather than announcing itself. Consider a hospital-based study of survival after a diagnosis of idiopathic pulmonary fibrosis that recruits all patients attending clinic in 2024, whenever they were diagnosed. This is a prevalent cohort. A patient diagnosed in 2019 who is still alive in 2024 is eligible; one diagnosed in 2019 who died in 2021 is not. If survival is measured from diagnosis and delayed entry is ignored, the study will overestimate survival because it has systematically excluded the early deaths. The phenomenon is sometimes described as length-biased sampling: people with longer survival have more opportunity to be sampled. The same structure appears in pharmacoepidemiology as the prevalent-user problem. A cohort study that compares current users of a drug with non-users will include long-term users who have tolerated the drug and survived its early risks, while excluding those who stopped because of side effects or died early. Ray's 2003 paper in the American Journal of Epidemiology argued for the new-user design, in which follow-up begins when the drug is first started, as the remedy. The logic is identical to the handling of delayed entry: define a time origin that is common to all members of the comparison, and count person-time only from the point at which each person could have been observed. The broader lesson is that the dataset in hand is always the outcome of a selection process, and time-to-event analysis is unusually sensitive to that process because selection often depends on having survived. Before fitting anything, it is worth writing down, for a typical participant, the date on which they entered the world of the study, the date from which their survival is being measured, and the date on which they left observation. If the first and second dates differ, there is truncation to handle. Data structures that make the analysis possible Most errors in survival analysis are born in the data file, and a small amount of discipline at that stage prevents a great deal of trouble. The minimum dataset for a simple analysis has one row per participant, with the observed time, the event indicator, and the covariates measured at time zero. The observed time should be computed from dates, not recorded directly, and the dates retained, so that errors in the origin or the end of follow-up can be traced. For delayed entry, time-varying covariates or multiple events, the counting-process or long format is needed. Here each participant contributes one or more rows, each covering an interval from a start time to a stop time, with the covariate values that applied during that interval and an indicator of whether the event occurred at the stop time. A patient randomised on day zero who starts a second-line therapy on day 120 and dies on day 300 would have two rows: 0 to 120 with the second-line indicator equal to zero and event zero, and 120 to 300 with the indicator equal to one and event one. The survSplit and tmerge functions in the R survival package, and stsplit in Stata, build these structures. Chapter 4 relies on this format for time-dependent covariates, and Chapter 8 on an extended version of it for multi-state models. Three checks are worth running on every survival data file before any analysis. First, no observed time should be negative or zero; zero-length intervals usually indicate an event on the day of the origin, which should be recorded as a small positive time, such as half a day, rather than dropped. Second, the distribution of censoring times should make sense given the recruitment and follow-up schedule: a spike of censoring at one date suggests an administrative cut-off, whereas censoring spread evenly through the early months suggests loss to follow-up. Third, the event and censoring pattern should be tabulated by treatment arm or exposure group. A difference in early censoring between arms is a warning sign that must be explained. These checks are unglamorous, and they are also the place where the analyst forms an understanding of what the data can and cannot say. A survival analysis is the joint product of a disease process and an observation process. The rest of this book is concerned with modelling the former, but none of it works unless the latter has been understood and, where necessary, corrected. Chapter 2. Describing Survival: Kaplan–Meier, Cumulative Hazards and Summary Measures Before anything is modelled or compared, a survival analysis should describe what happened. The description has two parts: a curve that shows how the probability of remaining event-free changes over time, and a small number of numerical summaries drawn from that curve. This chapter builds both from the ground up, because the logic of the Kaplan–Meier estimator is the logic of everything that follows. Building the Kaplan–Meier estimator by hand The survival function S(t) is the probability that the event has not occurred by time t. Without censoring it would be estimated by the proportion of the sample still event-free at t. With censoring that proportion is undefined, because we do not know the status at t of people censored earlier. Kaplan and Meier's solution was to break survival into a chain of conditional probabilities. To survive to twelve months, a patient must survive each distinct time at which an event occurred up to twelve months, given survival to just before that time. At each event time, the conditional probability of getting through is estimated from those who were still under observation, the risk set, as one minus the number of events divided by the number at risk. Multiplying these conditional probabilities together gives the product-limit estimate. A censored patient contributes to every risk set up to their censoring time and then simply drops out of the denominator. Nobody is thrown away, and nobody is assumed to have had an event they were not seen to have. A worked example makes this concrete. Consider ten patients with a rare sarcoma followed from the start of treatment, with the following observed times in months, where a plus sign marks a censored observation: 3, 5+, 6, 6, 8+, 10, 12, 15+, 18, 20+. Table 2 sets out the calculation. Table 2. Kaplan–Meier and Nelson–Aalen calculation for ten hypothetical patients. Month At risk Events Conditional survival Kaplan–Meier S(t) Nelson–Aalen H(t) 3 10 1 9/10 = 0.900 0.900 0.100 6 8 2 6/8 = 0.750 0.675 0.350 10 5 1 4/5 = 0.800 0.540 0.550 12 4 1 3/4 = 0.750 0.405 0.800 18 2 1 1/2 = 0.500 0.203 1.300 At three months all ten are at risk and one dies, so the estimated probability of surviving past three months is 0.9. The patient censored at five months counts in the risk set at three months but not at six, so eight patients are at risk at six months, two of whom die. The conditional probability of surviving six months, given survival to just before six, is 6/8, and the cumulative estimate is 0.9 times 0.75, or 0.675. The patient censored at eight months leaves the risk set before ten months, so five remain at risk then. And so on. The final censored patient, at twenty months, does not change the estimate but tells us the curve continues flat at 0.203 until at least twenty months. Two naive alternatives show why this matters. If we simply dropped the three censored patients, we would have seven patients of whom six died by eighteen months, giving a survival at eighteen months of 1/7, or 0.14, which is too pessimistic because the censored patients were known to survive for a while. If we treated censored patients as survivors to the end, we would have four survivors among ten at eighteen months, giving 0.40, which is too optimistic because we have no idea whether those censored early survived that long. The Kaplan–Meier estimate of 0.20 sits between the two, using each patient for exactly as long as they were observed. The estimator is a step function that drops only at event times. It is plotted as a staircase, with small tick marks at censoring times. The curve is uninformative, and its steps become erratic, when the number at risk is small. At eighteen months in the example, the estimate falls by half because one of two remaining patients died. Good practice, set out by Pocock, Clayton and Altman in the Lancet in 2002 and reinforced by the KMunicate study of Morris and colleagues in BMJ Open in 2019, is to print the number at risk below the time axis at regular intervals, to show confidence bands or intervals, and to stop the plotted curve, or at least signal caution, where few patients remain. The KMunicate survey of trialists, statisticians and clinicians found strong support for including the number at risk together with the cumulative numbers of events and censorings beneath the plot. Variance, confidence intervals and the Nelson–Aalen alternative The standard error of the Kaplan–Meier estimate comes from Greenwood's formula, first published by Major Greenwood in 1926 for actuarial life tables. It says that the variance of the estimate at time t equals the square of the estimate multiplied by the sum, over event times up to t, of the number of events divided by the product of the number at risk and the number at risk minus the number of events. In the example at six months the sum is 1/(10 times 9) plus 2/(8 times 6), which is 0.0111 plus 0.0417, or 0.0528. Multiplying by 0.675 squared gives a variance of about 0.024 and a standard error of 0.155. By twelve months two more terms, 1/(5 times 4) and 1/(4 times 3), have been added, the sum is 0.186, and the standard error is about 0.175 around an estimate of 0.405. A symmetric interval of the estimate plus or minus 1.96 standard errors can stray below zero or above one when the estimate is near either limit or the sample is small. The usual remedy is to compute the interval on a transformed scale and transform back. The complementary log-log transformation, log of minus the log of S(t), is the default in Stata and SAS; the R survival package uses a log transformation by default and offers log-log as an option. With small samples the choice makes a visible difference, and the method should be stated. The cumulative hazard function H(t) is the accumulated instantaneous risk up to time t, and it is linked to survival by the identity S(t) = exp(minus H(t)) for continuous time. The Nelson–Aalen estimator, proposed by Wayne Nelson in 1969 and 1972 and given its rigorous counting-process foundation by Odd Aalen in 1978, estimates H(t) as the sum, over event times up to t, of the number of events divided by the number at risk. It appears in the final column of Table 2. Exponentiating its negative gives the Fleming–Harrington or Breslow estimate of survival, which at eighteen months in the example is exp(minus 1.3), or 0.273, somewhat higher than the Kaplan–Meier value of 0.203. The two estimators agree closely when risk sets are large and diverge when they are small; the Kaplan–Meier estimator is conventional for reporting survival, while the Nelson–Aalen estimator is the natural tool for inspecting the shape of the hazard. That inspection is often useful. A cumulative hazard that rises as a straight line indicates a constant hazard, the exponential model of Chapter 6. A curve that bends upwards indicates a hazard that increases with time, as in most studies of ageing and many of chronic disease progression. A curve that bends downwards indicates a hazard that falls, as after surgery, where the risk is concentrated in the perioperative period. Plotting log H(t) against log t gives a straight line if the Weibull model holds. These plots are the survival analyst's equivalent of looking at a histogram before fitting a regression. The actuarial life table Before computers made the Kaplan–Meier estimator effortless, survival was estimated from life tables that grouped follow-up into intervals, usually years. The actuarial method, associated in its medical form with Cutler and Ederer's 1958 paper in the Journal of Chronic Diseases, treats people censored during an interval as having been at risk for half of it, so the effective number at risk is the number entering the interval minus half the number censored within it. The method is still used by cancer registries producing population-based survival estimates, by some demographic studies, and when only grouped data are available. It gives very similar answers to Kaplan–Meier when intervals are short relative to the pace of events. Population-based cancer survival raises a further issue. Registries such as the US Surveillance, Epidemiology and End Results programme and national registries in Europe report relative or net survival: the observed survival of patients divided by the survival expected in a general population of the same age, sex and calendar year, taken from national life tables. Relative survival is an estimate of survival in a hypothetical world where the cancer is the only cause of death, and it avoids the need for reliable cause-of-death information. The Pohar Perme estimator, published in Biometrics in 2012, is now the recommended method for net survival because older estimators such as Ederer II are biased when the excess risk varies with age. The concept is related to, but distinct from, the competing risks methods of Chapter 7, and the two should not be confused: net survival answers a hypothetical question, while crude probabilities in the presence of competing risks describe what actually happens to patients. Summary measures: medians, landmarks and restricted means A curve needs numerical summaries, and the choice of summary is the first place where the estimand discussed in the Introduction becomes concrete. The median survival time is the smallest time at which the estimated survival falls to 0.5 or below. In the example, the estimate first reaches 0.405 at twelve months, so the median is twelve months. A confidence interval for the median is obtained by inverting the confidence intervals for the curve, the method of Brookmeyer and Crowley from 1982: it is the set of times at which the confidence band includes 0.5. The median has an intuitive interpretation, and it is robust to what happens in the tail, but it has two weaknesses. It is undefined if survival never drops to one half during follow-up, which is common in trials of early-stage disease; reports then say "median not reached". And it can be unstable when the curve is flat around 0.5, as a small change in one event time can move the median by months. Landmark survival probabilities, such as one-year, two-year or five-year survival, are read directly from the curve with their confidence intervals. They are easy to communicate to patients and are the natural summary for diseases where the clinical question is framed as "what are the chances of being alive and well at five years?" Their weakness is that they ignore everything except a single time point, and differences between groups at a chosen landmark invite suspicion that the landmark was chosen after seeing the data. They should be prespecified. The restricted mean survival time, or RMST, is the area under the survival curve up to a chosen horizon, called tau. It equals the expected event-free time over that horizon. In the example, with tau set to twenty months, the area is the sum of rectangles under the staircase: 1.0 times 3 months, plus 0.9 times 3, plus 0.675 times 4, plus 0.54 times 2, plus 0.405 times 6, plus 0.2025 times 2. The total is 12.3 months. A patient in this group can expect to live about 12.3 of the next 20 months. The difference in RMST between two treatment arms is the average gain in event-free time over the horizon, measured in months, which is a quantity patients and clinicians grasp immediately. Patrick Royston and Mahesh Parmar, in a 2013 paper in BMC Medical Research Methodology, and Hajime Uno and colleagues, in a 2014 paper in the Journal of Clinical Oncology, argued that the RMST difference should be routinely reported in trials, alongside or instead of the hazard ratio. Three reasons stand out. The RMST does not depend on any modelling assumption such as proportional hazards. It is expressed in units of time rather than as a ratio of instantaneous risks. And it is always estimable within follow-up, whereas the median may not be. The price is the choice of tau, which should be prespecified, clinically meaningful, and not beyond the point at which a reasonable number of patients remain at risk in each arm. Software is readily available: the survRM2 package in R, the strmst2 command in Stata, and the RMSTREG procedure introduced in SAS/STAT 15.1. Conditional survival and what a curve does not say A survival curve estimated from diagnosis says nothing directly about the prognosis of a patient who has already survived two years. Conditional survival, the probability of surviving a further t years given survival to s years, is obtained by dividing S(s + t) by S(s). For many cancers conditional survival improves markedly with time since diagnosis, because the patients with the most aggressive disease have died early. A patient who is three years past a diagnosis of colorectal cancer typically has a much better five-year outlook than the population five-year figure suggests. Registry-based studies routinely report conditional survival tables for this reason, and they are among the most useful numbers a clinician can give a survivor. A survival curve is also a population-level quantity. A statement that five-year survival is 60 per cent is not a statement that each patient has a 60 per cent chance, unless the population is homogeneous. In practice, prognosis varies with stage, age, comorbidity and biology, and a single curve averages over this heterogeneity. The heterogeneity has a subtle consequence, known as frailty selection: even if every individual's hazard is constant, the population hazard will fall over time, because the frailest die first and the survivors are progressively a lower-risk group. A declining population hazard therefore does not prove that any individual's risk declines. The same mechanism complicates the interpretation of hazard ratios over time, as Chapter 5 explains. Finally, a Kaplan–Meier curve from observational data is descriptive, not causal. If the curve for patients who received surgery lies above the curve for those who did not, the gap reflects both any effect of surgery and every difference between patients selected for surgery and those not selected. Adjusted survival curves, obtained either by standardising predictions from a regression model over the covariate distribution of the whole sample or by weighting each patient by the inverse of the probability of receiving their treatment, are the right tool for estimating what survival would have been had everyone, or no one, been treated. Both approaches are implemented in the R package adjustedCurves and in Stata's stteffects and teffects frameworks. Descriptive curves remain essential; they tell us what happened. They should simply not be read as telling us why. Reading the tail of the curve The right-hand end of a Kaplan–Meier curve is where readers most often go wrong. Because each death late in follow-up is divided by a small number at risk, the curve there moves in large, noisy steps, and a long flat stretch may reflect nothing more than the absence of anyone left to die. Two practical rules help. First, look at the number at risk before looking at the height of the curve; once fewer than about ten per cent of the original sample remain, or fewer than a dozen or so patients, estimates should be treated as indicative only. Second, look at the censoring ticks. A tail made of many ticks close together at a single date usually reflects administrative censoring at the data cut-off, and the curve will change when the data mature. A genuine plateau, however, can be clinically important. In paediatric acute lymphoblastic leukaemia, in some lymphomas treated with curative chemotherapy, and in a proportion of patients with metastatic melanoma treated with immune checkpoint inhibitors, the curve flattens because a fraction of patients appears to be cured or to have durable disease control. Cure models, also called mixture models, formalise this by writing the population survival as a mixture of a cured fraction, whose survival equals that of the general population, and an uncured fraction with a conventional survival distribution. They estimate the cure fraction and the survival of the uncured separately, and they are implemented in the R packages flexsurvcure and smcure and in Stata's strsmix and stpm2 commands. Their weakness is that the cure fraction is only identifiable if follow-up is long enough for the plateau to be real rather than an artefact of sparse data, and early claims of cure based on short follow-up have not always survived longer observation. A prudent analyst reports the cure fraction as a model-based extrapolation, not an observation, and checks whether it is stable when the most recent data are added. Chapter 3. Comparing Groups: The Log-Rank Test and Its Relatives Most randomised trials with a time-to-event endpoint are designed around a single hypothesis test comparing two survival curves. The log-rank test is the default, and it is the test on which sample-size calculations, interim monitoring boundaries and regulatory decisions are usually built. It is worth understanding exactly what it does, because its strengths and blind spots follow directly from its construction. Observed minus expected: how the log-rank test works The log-rank test compares two groups one event time at a time. At each distinct time at which at least one event occurred in either group, the risk sets of the two groups are laid side by side. Suppose that at a given time there are 40 patients at risk in group A and 60 in group B, and that three events occur in total. If the groups had identical hazards, the three events would be shared between them in proportion to their numbers at risk, so the expected number in group A would be 3 times 40/100, or 1.2. The difference between the observed number in group A and this expectation is recorded, along with its variance under the null hypothesis, which comes from the hypergeometric distribution: the number of events times the proportion at risk in A times the proportion in B times a small correction when there are ties. These observed-minus-expected differences are then summed over all event times, as are their variances. The test statistic is the square of the total difference divided by the total variance, and it is compared with a chi-squared distribution with one degree of freedom. In essence it is a Mantel–Haenszel test in which each event time is a separate stratum. Nathan Mantel proposed the approach in 1966, and Richard Peto and Julian Peto gave it the name log-rank in 1972 in the Journal of the Royal Statistical Society, noting its connection to the ranks of the log survival times. The Peto group's 1976 and 1977 papers in the British Journal of Cancer on the design and analysis of clinical trials made it standard practice in cancer research. Two features of this construction deserve attention. First, the test uses only the ordering of event times and the composition of risk sets. It does not care how far apart the events are in calendar time; it would give the same answer if every event time were doubled. Second, each event time receives the same weight in the sum, regardless of how many patients remain at risk. This is what makes the log-rank test the most powerful rank test when the ratio of the two hazards is constant over time, the proportional hazards alternative. It is also what makes it lose power when the hazards are not proportional. The observed-minus-expected sum gives a simple estimate of the hazard ratio as well. The Peto one-step estimator exponentiates the total observed-minus-expected divided by the total variance. When the effect is modest and the groups are of similar size, this is close to the estimate from a Cox model with a single treatment indicator. The ratio of observed to expected counts in each group, the O/E ratio, is a cruder but still common alternative, and it appears in many older meta-analyses. The Early Breast Cancer Trialists' Collaborative Group, whose individual patient data meta-analyses of adjuvant therapies have been published in the Lancet since the 1980s, uses observed-minus-expected statistics from stratified log-rank analyses of each trial, combined across trials, as its principal method. Weighted tests for non-proportional alternatives Because the log-rank test weights all event times equally, it is most sensitive to differences that persist throughout follow-up. When the difference is concentrated early or late, other weights do better. The family of weighted log-rank tests multiplies each event time's observed-minus-expected contribution by a weight before summing. The Gehan–Breslow test, a generalisation of the Wilcoxon rank-sum test to censored data, weights each event time by the number at risk. Because the number at risk is largest early in follow-up, it emphasises early differences. The Peto–Peto and Prentice modifications use the Kaplan–Meier estimate of pooled survival as the weight, which has a similar emphasis but is less affected by differences in censoring patterns between groups. The Tarone–Ware test uses the square root of the number at risk, a compromise between log-rank and Gehan. Fleming and Harrington proposed a flexible family in which the weight is the pooled survival raised to a power rho multiplied by one minus pooled survival raised to a power gamma. Setting both powers to zero gives the log-rank test; rho equal to one and gamma equal to zero emphasises early differences; rho zero and gamma one emphasises late differences. Table 3 summarises the members of this family that appear most often in the medical literature. Table 3. Common members of the weighted log-rank family. Test Weight at each event time Emphasis Typical use Log-rank 1 Constant across time Proportional hazards expected Gehan–Breslow (Wilcoxon) Number at risk Early differences Early effect, similar censoring by arm Peto–Peto, Prentice Pooled Kaplan–Meier S(t) Early differences Early effect, differing censoring Fleming–Harrington G(0,1) 1 − pooled S(t) Late differences Delayed effect, as with immunotherapy MaxCombo Maximum over several G(rho,gamma) Adaptive Uncertain pattern of effect The late-weighted tests became prominent with immune checkpoint inhibitors. In several trials of PD-1 and PD-L1 antibodies against chemotherapy, the survival curves overlapped or even crossed for the first few months, as chemotherapy produced early responses and some immunotherapy patients progressed rapidly, before separating as durable responses to immunotherapy accumulated. In such circumstances the ordinary log-rank test loses power, because the early event times, where there is no difference or a difference in the wrong direction, dilute the late benefit. The difficulty is that the shape of the effect is rarely known in advance, and choosing a weight after seeing the data inflates the type I error. The MaxCombo test, advocated by a cross-pharmaceutical working group whose recommendations were published by Lin and colleagues in Statistics in Biopharmaceutical Research in 2020, computes several Fleming–Harrington statistics, typically G(0,0), G(0,1), G(1,0) and G(1,1), and uses the maximum, with a critical value that accounts for the correlation among them. It retains good power across a range of alternatives at a small cost when hazards are truly proportional. The approach has been used in some trial designs, though regulators have been cautious because a significant MaxCombo result says only that the curves differ somewhere, not in which direction or by how much. A crossing pattern in which one arm is better early and worse late can yield a significant result that is clinically ambiguous. Any weighted test must therefore be accompanied by an estimate of effect that is interpretable, such as a difference in restricted mean survival time or survival at prespecified landmarks. Stratification, trend and more than two groups The log-rank test extends naturally to more than two groups, with degrees of freedom equal to the number of groups minus one, and to a test for trend across ordered groups, such as tumour grade or quartiles of a biomarker, which concentrates power on a monotonic pattern with a single degree of freedom. The stratified log-rank test computes observed-minus-expected sums and variances separately within strata, such as study centre, disease stage or a randomisation stratification factor, and then adds them across strata before forming the test statistic. It compares like with like within each stratum, while allowing the baseline hazard to differ freely between strata. Because randomisation is often stratified by prognostic factors, the analysis should normally stratify by the same factors; failing to do so leaves the test valid but somewhat conservative. Too many strata, however, produce strata with few patients and few events, and power is lost when strata contribute little information. Regulatory guidance, including the EMA guideline on adjustment for baseline covariates, advises prespecifying the stratification factors in the analysis and keeping them to a small number of strong prognostic variables. Why the number of events, not patients, drives power The variance of the log-rank statistic, and therefore its power, depends almost entirely on the number of events observed, not on the number of patients enrolled. A trial of 10,000 patients with 50 events has little more information about a hazard ratio than a trial of 200 patients with 50 events. This is why large cardiovascular outcome trials, which enrol low-risk participants, need tens of thousands of patients to accumulate a few hundred or a thousand events, and why most such trials are event-driven: they continue follow-up until a target number of events has occurred rather than for a fixed duration. David Schoenfeld's formula, published in Biometrika in 1981 and in Biometrics in 1983, gives the required number of events for a log-rank test with equal allocation. It is four times the square of the sum of the standard normal quantiles for the significance level and the power, divided by the square of the natural logarithm of the hazard ratio. For a two-sided significance level of 0.05 the quantile is 1.96, and for 80 per cent power it is 0.842. Their sum is 2.802, whose square is 7.85, and four times that is 31.4. To detect a hazard ratio of 0.75, whose logarithm is minus 0.288 and whose square is 0.0828, the trial therefore needs about 31.4 divided by 0.0828, or 380 events. For 90 per cent power the power quantile is 1.282, the sum is 3.242, four times its square is 42.0, and the requirement rises to about 508 events. To detect a hazard ratio of 0.70 with 80 per cent power, about 247 events suffice. The steepness of this relationship is the most important fact in trial design for time-to-event endpoints: small changes in the assumed effect size have large consequences for the required number of events. The number of patients then follows from the number of events divided by the probability that a patient will have an event during follow-up. That probability depends on the baseline hazard, the treatment effect, the accrual rate and period, the minimum follow-up and the rate of dropout, and it is usually computed under an exponential or piecewise exponential assumption. If 380 events are needed and the expected overall probability of an event by the planned analysis is 0.40, about 950 patients are needed. Laurence Freedman's 1982 formula gives a slightly different event count based on the expected proportions of events; the two agree closely for hazard ratios near one. Software such as the R packages gsDesign and rpact, Stata's power logrank command, and commercial products including East and nQuery implement these calculations and their group sequential extensions. Unequal allocation, for example two patients on the experimental treatment for each on control, reduces efficiency: the four in Schoenfeld's formula is replaced by one divided by the product of the two allocation proportions, which for a 2:1 ratio is 4.5, so about 12.5 per cent more events are needed. Non-proportional hazards reduce efficiency more seriously, and simulation under the anticipated pattern of effect has become standard practice for trials of therapies in which a delayed effect is plausible. Interim analyses and the information clock Because information accrues with events, interim analyses in survival trials are scheduled by the fraction of the target number of events observed, the information fraction, rather than by calendar time. A typical design might plan an interim analysis for efficacy at 50 per cent of events and a final analysis at 100 per cent, with an O'Brien–Fleming type boundary that requires very strong evidence to stop early. The Lan–DeMets alpha-spending approach, published in Biometrika in 1983, allows the timing of interim looks to depart from the plan while preserving the overall type I error. Interim analyses of survival data carry a specific hazard. Early in follow-up, the survival curves are dominated by early events, and if the treatment effect is delayed or changes over time, an interim estimate of the hazard ratio can differ markedly from the final one. Several trials stopped early for benefit have reported hazard ratios that later analyses, with longer follow-up, showed to have been exaggerated. A systematic review by Bassler and colleagues in JAMA in 2010 found that trials stopped early for benefit systematically overestimated treatment effects compared with trials of the same intervention that were not stopped early, with the overestimation largest in trials with fewer events. Data monitoring committees therefore weigh not just the p-value at an interim look but the maturity of the data, the consistency of the effect across time and subgroups, and the plausibility of the effect size. Comparing a group with a reference population Not every comparison involves two randomised arms. Single-arm phase II trials, long-term follow-up of rare-disease cohorts and occupational studies often need to compare a single group with an external reference. The one-sample log-rank test does this. For each patient, the expected cumulative hazard over their own period of follow-up is computed from a reference distribution, often national life tables matched on age, sex and calendar year, or a historical control survival curve. Summing these individual cumulative hazards gives the expected number of events, E, under the hypothesis that the group has the same hazard as the reference. The observed number, O, is compared with E, and the ratio O/E is the standardised mortality ratio when the event is death and the reference is the general population. Suppose a cohort of 400 adults who survived childhood cancer is followed for a combined 6,000 person-years, and population rates matched on age, sex and year predict 30 deaths. If 75 are observed, the standardised mortality ratio is 2.5, with an exact Poisson confidence interval of roughly 2.0 to 3.1. Large cohort studies such as the British Childhood Cancer Survivor Study and the US Childhood Cancer Survivor Study have reported excess mortality in exactly this form. The same approach underlies the use of historical controls in single-arm trials, with an important caveat: historical control data carry their own sampling error and the patients may differ systematically from contemporary ones in supportive care, diagnostic methods and eligibility. Treating a historical survival curve as known without error overstates the precision of the comparison, and selection differences cannot be removed by any test. Modern proposals for external control arms, discussed in regulatory guidance from the FDA and the EMA, therefore rely on individual patient data from comparable sources, careful alignment of time zero and eligibility, and adjustment by weighting or matching rather than on one-sample comparisons against published curves. What a significant log-rank test does and does not tell you A log-rank test answers the question of whether two survival distributions are identical. A small p-value is evidence against identity. It does not by itself say how large the difference is, whether the difference is clinically meaningful, or whether one group has better survival at every time point. When curves cross, the log-rank test can be significant in either direction, or not significant despite a large difference in both directions that cancels. Nor should the log-rank test be replaced by comparing survival at a single time point with a z-test on two Kaplan–Meier estimates, unless that time point was prespecified as the primary comparison. Such point-wise comparisons are valid tests of a specific hypothesis, but repeated across several time points, or chosen after inspecting the curves, they are a reliable route to false positives. The disciplined sequence is therefore the following. Before the data are seen, state the estimand and choose the test that has good power for it. Report the test, then report an estimate of effect with a confidence interval on a scale that clinicians can interpret, and then show the curves with numbers at risk so that readers can judge the pattern of effect over time for themselves. The next chapter introduces the model that provides the most commonly reported estimate, the hazard ratio, and explains what it is that such a ratio measures. Hashtags: #SurvivalAnalysisInBiomedicalScience #SurvivalAnalysis #TimeToEventAnalysis #KaplanMeierEstimator #CoxProportionalHazards #HazardRatio #Censoring #LeftTruncation #DelayedEntry #LogRankTest #RestrictedMeanSurvivalTime #ProportionalHazardsAssumption #SchoenfeldResiduals #TimeVaryingCovariates #ImmortalTimeBias #AcceleratedFailureTimeModels #ParametricSurvivalModels #WeibullModel #RoystonParmarModels #CompetingRisks #CumulativeIncidenceFunction #FineGrayModel #CauseSpecificHazards #MultiStateModels #FutureOfSurvivalAnalysis

Download the Book (PDF): Introduction A visitor walking into a well-funded synthetic biology laboratory in 2026 sees the same things they would have seen in a pharmaceutical screening group twenty years ago, plus a few that are newer. There is a robotic arm on a linear track, moving microplates between a liquid handler, an incubator-shaker, and a multimode plate reader. There is an acoustic dispenser that fires droplets of a few nanolitres upward into an inverted plate without ever touching the liquid. There is a colony picker with a camera and a sterilising bath, a bench-top microfluidic rig with tubing running into a dark box, and somewhere in the corner a rack of servers or a network cable to a cloud account where the data lands. The visitor's natural conclusion is that this laboratory is fast. Sometimes it is. But speed is a poor description of what the equipment is actually for, and treating it as the goal is the single most reliable way to waste an automation budget. The useful way to think about a laboratory like this one is as a measurement instrument that happens to be the size of a room. Its output is not strains, plasmids, or plates. Its output is numbers — fluorescence per cell, product titre, growth rate, sequence reads — and the value of those numbers depends entirely on whether you can believe them. A robot that produces ten thousand measurements a week, of which an unknown fraction are corrupted by evaporation at the plate edge, a mis-set detector gain, or a tip that picked up half its intended volume, has not accelerated the laboratory. It has industrialised uncertainty. Somebody downstream will spend months chasing results that were never real. This is not a hypothetical failure. It is the ordinary experience of teams who buy throughput before they buy trust. A screen returns two hundred hits; forty survive re-testing; six reproduce in a different week; two reproduce in a different laboratory. The attrition is often blamed on biology — on the messiness of living systems, on context dependence, on the famous unreliability of genetic parts. Some of it genuinely is biology. A large fraction of it is instrumentation and process, and that fraction is engineerable. What this book argues The argument of this book is straightforward and, in most laboratories, unpopular: the limiting factor in high-throughput synthetic biology is not how many experiments you can run, but how many of their results you can act on. Everything that follows is about closing the gap between those two numbers. That reframing has practical consequences, and they are the substance of the chapters ahead. It means an assay has to be designed for the format it will eventually run in, not developed in tubes and then hopefully transplanted into 384-well plates. It means liquid handling is an engineering discipline with an error budget, verification procedures, and documented tolerances, not a convenience that replaces a technician's hands. It means detection instruments must be calibrated to units that survive a change of machine, a change of gain setting, and a change of institution — which is why a plate reader that reports "arbitrary fluorescence units" is, for most serious purposes, reporting nothing. It means protocols need explicit error handling, because a twelve-hour unattended run that encounters an unexpected condition will either stop and waste the run or continue and quietly poison the dataset, and which of those it does should be a decision you made in advance. It means metadata is not paperwork but the thing that makes a result reusable six months later by somebody who was not there. And it means the point of all of it is to close the design–build–test–learn loop faster with better information, not to fill freezers. A second argument runs alongside the first. Automation changes what kinds of experiments are worth doing. When a single construct costs two weeks of a scientist's time, you build the one you think will work, and you reason your way to it from mechanism. When a hundred constructs cost three days of machine time, the optimal strategy changes: you build a designed set that spans the space, you accept that most will be uninformative individually, and you extract the answer from the population. That shift — from advocacy for a hypothesis to interrogation of a space — is the real intellectual content of laboratory automation, and it is why statistical design of experiments and machine learning have become core synthetic biology skills rather than peripheral ones. It also explains why so many automated laboratories underperform: they bought the robots and kept the one-factor-at-a-time habits. Who this is for, and what it assumes This book is written for people who build and run automated biological laboratories, and for the scientists whose experiments run on them. That includes the postdoc who has just been handed responsibility for a liquid handler nobody has calibrated in two years, the facility manager specifying a new workcell, the computational biologist trying to work out why a dataset will not normalise, and the group leader deciding whether an automation platform is worth the capital and the two full-time staff it will quietly consume. It assumes you know what a plasmid is, roughly how transcription and translation work, and what a microplate looks like. It does not assume you have written a robot method, specified a scheduler, or fought with a LIMS. Where molecular biology is needed to make an automation point, the book explains it in the terms the automation requires. The scope is deliberately bounded. Everything here concerns standard, published methodology for engineering benign genetic circuits and metabolic pathways in the usual laboratory chassis: Escherichia coli, Saccharomyces cerevisiae, and cultured mammalian cell lines. These are the organisms that automation platforms were built around, and they are where the measurement problems are best characterised. Where biosecurity appears — and it does, in the final chapter — it appears as what it actually is in a working facility: a governance and screening obligation, a set of procedures around ordering synthetic DNA and documenting what a laboratory builds, integrated into the same information systems that handle everything else. How the book is organised The chapters follow the order in which the problems arrive, which is roughly the order of the design–build–test–learn loop but weighted towards the parts that break. The opening chapters are about the test side, because that is where automation pays off first and where bad practice does the most damage. Chapter 1 examines where time and information are actually lost in an automated laboratory, and why the pipetting step — the thing everyone automates first — is rarely the bottleneck. Chapter 2 is about assay design for scale: the statistics that tell you whether a screen can work before you run it, and the plate-level artefacts that will otherwise generate confident nonsense. Chapter 3 treats liquid handling as the metrology problem it is. Chapter 4 covers miniaturisation and microfluidics, including the cases where they are the wrong answer. Chapter 5 is about detection and calibration — how to get numbers in units that mean something. The middle chapters turn to building and to the machinery that holds a facility together. Chapter 6 covers automated DNA assembly and strain construction, including the verification steps that are routinely skipped and routinely regretted. Chapter 7 is about error handling: the taxonomy of ways an automated protocol fails, and how to design runs that fail safely rather than silently. Chapter 8 addresses data architecture — metadata, provenance, and the unglamorous work that determines whether a dataset is an asset or a liability. The last chapters are about what the whole apparatus is for. Chapter 9 covers closing the loop: design of experiments, active learning, and the current state of so-called self-driving laboratories, with an honest account of what they can and cannot yet do. Chapter 10 is about running the facility — validation, maintenance, training, costing, governance — the operational reality that determines whether any of the preceding advice survives contact with a working week. A note on what is not here. There are no illustrations. Automation is a visual subject and it is tempting to render every workflow as a flowchart, but a flowchart of a protocol tells you the order of operations and hides everything that matters: the tolerances, the failure modes, the reason a step exists. Those live in sentences. Where a genuine comparison across several options on the same criteria would sprawl in prose, the book uses a small table; there are five in total. A word about the pace of the field Laboratory automation for biology has been through several cycles of overpromise. The robot scientist demonstrations of the late 2000s, the cloud laboratory ventures of the mid-2010s, the biofoundry buildout that followed, and the current wave of machine-learning-driven closed-loop platforms have each been announced as the end of manual experimentation. Manual experimentation is still here, and will be. What has genuinely changed is less dramatic and more useful. Standard microplate geometries, acoustic dispensing, cheap sequencing, cell-free prototyping systems, and shared data standards have together made it routine to do things that were research projects fifteen years ago: build and characterise a few hundred genetic constructs in a month, calibrate fluorescence measurements to absolute units that another laboratory can reproduce, or run a designed experiment across ten variables in a single week. A global network of biofoundries now exists explicitly to make such capability shared infrastructure rather than a local advantage. Those capabilities are real, they compound, and most laboratories use a fraction of what their existing equipment could deliver. The gap is almost never the hardware. It is in assay design, calibration discipline, error handling, and data hygiene — the parts nobody photographs for the grant report. This book is about those parts. Chapter 1: The Bottleneck Is Not Pipetting Ask a synthetic biology group what they would automate first and most will say liquid handling. It is the obvious answer. Pipetting is repetitive, it is tiring, it causes injuries, it is the visible bulk of bench work, and it is the thing robots are unambiguously good at. A workstation that can set up three hundred assembly reactions overnight looks like an enormous win over a person doing thirty. Then the workstation arrives, and the laboratory discovers that it now sets up three hundred reactions overnight and still completes roughly the same number of useful experiments per month as before. This outcome is common enough to deserve a name. What happens is that automation removes a constraint that was not binding. The pipetting was never the limit; it merely felt like the limit because it was the part the scientist experienced as labour. The actual limits sit elsewhere — in the wait states, the verification steps, the analysis backlog, and above all in the fraction of results that turn out not to be worth acting on. Understanding where the loop actually stalls is the precondition for every technical decision in the rest of this book. If you automate the wrong step, you have bought an expensive machine that produces a faster version of your previous throughput. Anatomy of the loop Synthetic biology organises its work as a cycle: design a construct or a set of constructs, build them, test them, learn from the results, and design again. The design–build–test–learn framing is now ubiquitous, and like most ubiquitous framings it has become decorative — printed on posters, rarely used as an analytical tool. Used properly, it is a timing diagram. For any given project, you can put a number on how long each arc takes and how much information each turn of the loop yields. Do that honestly for a typical strain engineering project and the picture is consistent across laboratories. Design, if it means choosing what to build, is fast — hours to days. It can become slow when it means solving a genuine computational problem, such as selecting a ribosome binding site library or laying out a multi-gene pathway with compatible assembly junctions, but for most projects it is not the constraint. Build is where automation obviously helps and where the gains are real but bounded. The physical operations — setting up assembly reactions, transforming cells, plating, picking colonies, preparing DNA — compress well. What does not compress is the biology's own clock. A transformation needs an overnight recovery and growth. A yeast strain needs a day or two. Mammalian cell lines need a week or more for selection and expansion. You can parallelise these, and parallelising them is exactly what automation is for, but you cannot shorten them. The consequence is that build time for a single item is dominated by incubation, while build time for a batch is dominated by handling — which means the return on automating the build step scales with batch size and is close to zero for one-offs. Test is where the loop most often breaks, and for reasons that have little to do with speed. Running a plate reader assay on three hundred clones takes an afternoon. Designing an assay that gives a trustworthy answer on three hundred clones takes weeks, and skipping that work is the most common single cause of wasted automated capacity. A screen that has not been validated for its plate format, its controls, its detection settings, and its statistical power will produce numbers at an impressive rate, and those numbers will not survive re-testing. Learn is the most neglected arc. In many groups it does not exist as a distinct activity at all: results are looked at, a few obvious winners are picked, and the next round is designed by intuition. The data from previous rounds sits in spreadsheets on individual laptops, in formats that cannot be combined, without the metadata that would allow combination even if the formats matched. Each turn of the loop therefore starts nearly from scratch. This is the single largest structural inefficiency in automated biology, and no instrument purchase addresses it. Where the time actually goes Take a concrete case: characterising a library of promoter variants driving a fluorescent reporter in E. coli. This is the archetypal automated synthetic biology experiment, simple enough to serve as a benchmark. Suppose the target is 200 variants, each measured in triplicate, with growth curves and fluorescence collected over eight hours. The plate handling is trivial — 600 wells is two 384-well plates with room for controls. A liquid handler can inoculate them in twenty minutes. The reader can run the kinetic protocol unattended. Now count the rest. Someone has to design the library and order the oligonucleotides: three days to a week of turnaround. Assembly and transformation: two days including overnights. Colony picking and overnight culture: two days. Preparation of the assay plates and the run: one day. So far the timeline is around ten days, of which the robot is actively working for perhaps four hours. Then the analysis. The reader emits a file per plate, typically a proprietary format or an awkward spreadsheet export with the plate laid out as a grid and metadata in a header block. Somebody must join those grids to the plate map — which well held which variant — and the plate map lives in a different file, made by a different person, possibly with a different well-numbering convention. They must subtract blanks, normalise fluorescence to cell density, decide what to do with wells where growth failed, identify the edge wells that evaporated, and propagate all of this into a per-variant estimate with an uncertainty. If the laboratory has not built this pipeline already, it takes days to weeks and is done slightly differently each time. Finally, verification. Of the 200 variants, some fraction are not what they were supposed to be — misassembled, mutated, or simply a colony that picked up the wrong plasmid. Without sequence verification, every downstream conclusion carries an unknown error rate. With sequence verification, add another few days and a real cost. The robot's four hours sit inside a three-week process. Doubling the robot's speed changes the three weeks to two weeks and six days. This arithmetic is not an argument against automation. It is an argument about which automation. The steps worth automating are the ones that are slow, repetitive, error-prone, and on the critical path — and in the example above, the analysis join, the plate map handling, and the sequence verification tracking are all much better candidates than the inoculation step everyone automates first. Throughput and information are different quantities There is a deeper issue underneath the timing, and it is the one that separates laboratories that get value from automation from those that do not. Throughput is the number of measurements per unit time. Information is the reduction in uncertainty about the question you care about. These are related but they are not proportional, and under common conditions increasing one decreases the other. Consider a screen with a measurement whose noise is large relative to the effect size you are hunting. Running more wells increases the number of apparent hits roughly in proportion to the number of wells, because most apparent hits are noise. The true positives grow in proportion to the number of genuinely interesting variants in the library, which is fixed. So scaling up a poorly-powered screen increases the false discovery rate, increases the downstream confirmation burden, and can leave you with less usable knowledge than a smaller, better-controlled experiment would have given. Anyone who has run a large screen recognises the pattern: a top-hit list dominated by wells in the same corner of the same plate, or by wells adjacent to a control that overflowed, or by a set of clones that all turn out to carry the same assembly artefact. These are not biological discoveries. They are the screen measuring itself. The practical implication is that the first investment in any automated laboratory should be in assay quality, not capacity. A screen with a well-separated signal, tight replicate variation, and proper plate-position controls can be run at modest scale and give hits that mostly confirm. The same screen with a marginal signal window will consume ten times the reagents and return a hit list that is mostly an artefact map. Chapter 2 gives the statistics that let you tell these apart before committing. There is a corollary that is easy to miss. Because the cost of confirming a hit is often far higher than the cost of generating one — a hit that reaches secondary screening might cost fifty times what its primary well cost — the economics of a screening campaign are dominated by the false positive rate, not by the primary throughput. Improving assay quality by a modest amount can therefore be worth more than doubling capacity, and it is almost always cheaper. The cost of a bad number It is worth being concrete about what a wrong measurement costs, because the cost is routinely underestimated. A single incorrect data point in an exploratory dataset costs almost nothing; it is averaged away. A single incorrect data point that becomes a lead costs the whole downstream investigation: the re-testing, the follow-up constructs, the scale-up culture, the analytics. In a metabolic engineering programme, a false positive that survives into a fermentation trial can cost weeks of a pilot facility's time. Worse, and more insidious, is a systematic error, because systematic errors do not average away and they correlate with things you care about. Evaporation from the outer wells of a microplate concentrates the medium, changes growth, and changes optical density and fluorescence together. If library members were laid out in plate order — which they often are, because that is what the picking robot produces — then position is confounded with construct identity, and the resulting artefact looks exactly like a biological effect. Randomising the layout does not remove the artefact but it does decouple it from the variable of interest, which converts a bias into noise. That single change, which costs nothing but a few lines in the plate map generator, is among the highest-return interventions available in a screening laboratory. Then there is the compounding cost. Bad data does not stay in its original experiment. It goes into the model that designs the next round. In a laboratory that has genuinely closed the loop — where machine learning models propose the next library from previous results — a systematic measurement artefact becomes a systematic design error, and the platform efficiently explores a region of design space that exists only in the instrument. Automation amplifies whatever process it is given, including the mistakes. What automation is actually good for None of this is an argument for doing things by hand. It is an argument for automating the right things for the right reasons. Four reasons hold up. Consistency. A robot pipettes the same way at 3 a.m. on a Sunday as at 10 a.m. on a Tuesday. For any experiment where run-to-run variation competes with the effect size — which is most screening — this is worth more than speed. Human pipetting variability is not large in absolute terms for a skilled operator, but it drifts with fatigue and it differs between operators, and both of those introduce structure into datasets that is impossible to model afterwards. Parallelism against a fixed biological clock. Since incubations cannot be shortened, the only way to increase the number of completed experiments is to have more running at once. Automation makes batch size cheap. This is the clearest and most robust benefit, and it is why the return on automation scales so strongly with batch size. Capabilities that a human cannot deliver at all. Dispensing 2.5 nanolitres, maintaining a hundred cultures at defined density, sampling a bioreactor every fifteen minutes for three days, or sorting ten thousand droplets a second are not faster versions of manual work. They are different experiments. Miniaturisation in particular changes reagent cost per assay by two orders of magnitude, which changes what is affordable to screen. Enforced documentation. A robot method is an executable description of a protocol. If the platform logs what it did — which plates, which volumes, which errors, which timestamps — then the laboratory gets provenance as a by-product of doing the work, rather than as an act of memory afterwards. This is the benefit laboratories most consistently fail to collect, because it requires the data architecture of Chapter 8 to be in place. Notice what is not on that list: reducing headcount. Automated laboratories do not need fewer people; they need different people. A workcell requires someone who can write and debug methods, someone who maintains and verifies the instruments, and someone who builds and runs the analysis pipeline. In a small group these may be the same person, which is a well-known single point of failure. The staffing question is taken up properly in Chapter 10, but it should be settled before the purchase order, not after. The economics of batch size Because the benefit of automation scales with batch size, the decision of what to automate is really a decision about how large your typical experiment is — and that in turn is a decision about how you do science. The arithmetic is simple enough to do on the back of an envelope. Every automated protocol carries a fixed overhead: writing and debugging the method, laying out labware, preparing reagent reservoirs, running a test plate, and cleaning up. Call that overhead a few hours for a simple protocol and a few days for a complex multi-instrument one, amortised over however many times the method is reused. Against that sits a variable saving proportional to the number of samples. For a protocol used once on twelve samples, the overhead dominates absolutely, and the honest recommendation is to do it by hand. For a protocol used weekly on three hundred samples, the overhead disappears into the second run. The crossover — the batch size at which automation starts paying — is typically somewhere between fifty and a hundred samples for a simple transfer protocol, and considerably higher for anything involving multiple instruments and a scheduler. Two things distort this calculation in practice, and both are worth naming. The first is method reuse. Laboratories consistently overestimate how often a given method will be run again. A method written for one project, parameterised for that project's specific plate layout and reagent set, is frequently never run again, and its overhead is never amortised. The discipline that fixes this is writing methods that take a plate map as an input rather than hard-coding the layout — a small amount of extra work that converts a single-use script into an asset. A laboratory with a dozen general, parameterised methods is in a completely different position from one with two hundred bespoke ones. The second distortion is that the manual comparison is not really manual. A scientist doing three hundred transfers by hand makes errors at a rate that is small per transfer but not negligible in aggregate, and those errors are invisible — they do not announce themselves, and they have no log. The honest comparison is not robot time against hand time but robot time against hand time plus the expected cost of undetected errors. Once that term is included, the crossover moves substantially in the robot's favour for any experiment whose results will be acted upon. There is a third consideration that has nothing to do with cost. Automation changes the psychological economics of an experiment. When a condition costs an hour of your own hands, you include only conditions you expect to be informative, and you leave out controls that feel redundant. When a condition costs thirty seconds of machine time, the marginal cost of a control column is essentially zero, and there is no reason not to include the full set: blanks, a dilution series of a reference standard, a positive control in every plate quadrant, replicate wells distributed across positions. This is, quietly, one of the largest real benefits of automation — not that it does the same experiment faster, but that it makes well-controlled experiments cheap enough that people actually run them. Diagnosing your own bottleneck Before specifying any equipment, it is worth doing a deliberately unflattering audit. Take the last three completed projects and reconstruct their timelines from laboratory notebooks and file timestamps. For each, record elapsed time from design freeze to a decision made on the data, and then apportion that elapsed time into categories: active hands-on work, incubation and other unavoidable waiting, queueing for an instrument or a person, analysis, and rework caused by failures. Two numbers usually stand out. The first is the ratio of active work to elapsed time, which in most academic laboratories is well under one in five — the loop is dominated by waiting and queueing, not by labour. The second is the rework fraction: the proportion of effort spent repeating something that did not work the first time. Where rework is high, the cause is almost always a missing verification step earlier in the process, and adding that step will do more than any robot. Then look at the hit confirmation rate from the last screening campaign. If fewer than half of primary hits confirm on re-test, the assay is the problem and capacity is irrelevant until it is fixed. The audit usually produces an uncomfortable conclusion: the most valuable automation project available is not a liquid handler but a data pipeline, a calibration procedure, or a verification step. That is the correct conclusion, and acting on it is what separates a laboratory that gets compounding returns from automation from one that has an expensive robot with a dust cover on it. The chapters that follow take those unglamorous problems in turn, starting with the one that determines everything downstream: whether the assay can carry the weight you are about to put on it. Chapter 2: Designing an Assay That Survives Scale-Up The most expensive mistake in automated biology is to develop an assay in tubes, confirm that it works, and then move it into plates. It feels like a reasonable sequence. Establish the biology first, then engineer the format. In practice the two are not separable, because almost everything that makes an assay behave differently at scale is a property of the format rather than the biology. A reporter assay that gives a clean ten-fold induction in a 5 mL culture may give a two-fold window in 50 µL, not because the cells have changed but because the aeration, the surface-to-volume ratio, the path length, the evaporation rate, and the detector's integration time have all changed at once. By the time this is discovered, a library has been built and a screening campaign has been scheduled. The alternative is to develop the assay in the format it will run in, from the first pilot, and to spend real effort establishing that it can carry the weight before committing to a campaign. This chapter is about what that effort consists of. The signal window, and the number that describes it Every screen depends on separating two populations: wells that contain something interesting and wells that do not. The question of whether a screen can work is the question of whether those populations are separable given the noise. The standard quantitative answer is the Z′-factor, introduced by Zhang, Chung and Oldenburg in 1999 and now the common currency of screening groups. It compares the spread of the positive and negative controls to the distance between their means: subtract three standard deviations of each control from the separation between the two means, and express the result as a fraction of that separation. A Z′ of 1 would mean perfectly tight controls with an enormous gap. A Z′ above 0.5 is conventionally regarded as an excellent assay suitable for screening. Between 0 and 0.5 the assay is marginal — usable with replicates, but expect a substantial confirmation burden. Below 0 the control distributions overlap within three standard deviations and the screen cannot distinguish anything; running it anyway generates a hit list of noise. Two things about Z′ are widely misunderstood and worth stating plainly. First, it is a property of the assay in a given format on a given day on a given instrument, not a property of the biology. Measuring Z′ once during development and assuming it holds is a common error. It should be computed for every plate in a campaign, from the on-plate controls, and plotted over the run. A drift in Z′ across a campaign is the earliest available warning that something has changed — a reagent lot, a cell passage number, a lamp, a shaker. Second, Z′ describes the controls, not the samples. The positive control is usually an extreme case chosen for convenience, and real hits are usually weaker. An assay with an excellent Z′ computed against a strong positive control may still be unable to resolve the two-fold effects you actually care about. The honest version is to compute the separation using a control that sits at the smallest effect size you would want to detect, which is harder to construct and much more informative. In practice, the useful companion to Z′ is a simple power calculation: given the replicate standard deviation you measured, and the number of replicates you can afford, what is the smallest fold-change you can detect at your chosen false positive rate? If the answer is larger than the effects you are hunting, no amount of throughput will save the campaign. There is a third statistic worth tracking alongside these: the strictly standardised mean difference, or the simpler ratio of signal to background. Both are cruder than Z′ but they fail differently, and a disagreement between them is usually diagnostic of a distributional problem — most often a long tail caused by a handful of aberrant wells. What changes when the format changes Miniaturisation is not a linear scaling. Several things change at different rates, and the interactions between them are where assays break. Working volume falls faster than surface area, so the surface-to-volume ratio rises. That increases evaporation rate per unit volume, increases the fraction of cells adhering to walls, and increases the relative importance of the meniscus in optical measurements. Gas exchange changes: a shallow, wide well in a 384-well plate is a different aeration environment from a deep 96-well, and for aerobic cultures that changes growth rate and, for anything with a redox-sensitive readout, the readout itself. Path length falls, which matters directly for absorbance. An optical density reading in a microplate is not comparable to a cuvette reading, because the path length depends on the fill volume and the meniscus shape rather than being a fixed 1 cm. This is the reason a plate reader OD600 of 0.4 and a spectrophotometer OD600 of 0.4 describe different cell densities, and the reason that any cross-format comparison requires a calibration described in Chapter 5. Mixing becomes harder, not easier. Small volumes have low Reynolds numbers; liquids in a microwell do not turbulently mix, they diffuse. A reagent added to the top of a 5 µL well may take minutes to homogenise, and if the reading happens before it does, the measurement depends on where in the well the optics sampled. Orbital shaking helps in larger wells and is unreliable in very small ones. Dispense precision becomes a larger fraction of the volume. Transferring 1 µL with a tip-based handler carries a coefficient of variation that may be a percent or two; transferring 100 nL carries considerably more, depending on the technology. When the assay volume is 5 µL and the reagent addition is 500 nL, a 5% dispense error is a 0.5% concentration error — tolerable. When the reagent addition is a serial dilution and errors compound across steps, it is not. And edge effects grow. This deserves its own treatment. Table 1 summarises what changes and what must be re-established at each common format. Table 1. What changes as an assay moves to smaller plate formats. Format Typical working volume Dominant new problem What must be re-established 24-well 0.5–2 mL Poor aeration in deep wells Growth rate, shaking speed 96-well 100–250 µL Edge evaporation over long runs Blank values, kinetics, Z′ 96 deep-well 0.5–2 mL Mixing and oxygen transfer Growth kinetics, sampling method 384-well 20–80 µL Evaporation, mixing, dispense CV Full assay validation, detector gain 1536-well 2–10 µL Evaporation dominates; contact dispensing impractical Non-contact dispensing, humidity control, whole assay The table is a planning aid, not a permission slip. The rightmost column is the honest one: at each step down, the assay is a new assay and must be validated as one. Choosing what to measure Before any of this comes a choice that determines everything downstream: what quantity the screen will actually read. Synthetic biology screens are almost always screens of a proxy, because the property of interest — a titre, a dynamic response, a therapeutic effect — is rarely measurable at throughput. The proxy is chosen for measurability, and the quality of the campaign depends on how faithfully it tracks the real objective. Four modalities carry most of the load. Fluorescent and luminescent reporters are the workhorses. A fluorescent protein fused to or expressed from the circuit of interest gives a continuous, non-destructive, kinetically resolvable readout in a plate reader or a cytometer. The costs are well known: maturation time means fluorescence lags transcription by tens of minutes to hours; the protein imposes a metabolic burden that can itself alter the phenotype; spectral overlap limits multiplexing; and autofluorescence from the medium and the cells sets a floor. Luminescence has a far better signal-to-background ratio because there is no excitation light and essentially no background, but it consumes substrate, is usually destructive, and decays during the read, which makes plate-reading order a source of systematic error unless the reader injects substrate well by well. Growth and fitness readouts — optical density over time, or competition in a pooled culture — are cheap, label-free, and directly meaningful for anything involving burden, toxicity, or a selection. They are also blunt: growth integrates everything, so a growth difference tells you that something changed without telling you what. Biosensors convert a chemical of interest into a fluorescence readout by coupling a transcription factor responsive to that metabolite to a reporter. This is the technique that made metabolic engineering screenable at scale, and it is the most powerful proxy available. It is also the most dangerous, because the screen now selects for anything that activates the sensor. Variants that produce a structurally similar metabolite, or that perturb the sensor's expression, or that alter cellular redox state, will score as hits. Every biosensor screen needs a counter-screen and an orthogonal confirmation by analytical chemistry on a subset. Direct analytics — mass spectrometry, chromatography, sequencing — measure the thing itself. Throughput has improved dramatically; acoustic ejection coupled directly to mass spectrometry now allows sample rates that were unthinkable a decade ago, and sequencing-based readouts allow pooled assays of enormous libraries. These are the correct choice for secondary screening and, increasingly, for primary screening where the budget allows. The discipline that matters here is to establish the relationship between the proxy and the objective, quantitatively, on a set of variants spanning the range, before the campaign. A correlation coefficient between reporter output and measured titre, computed on thirty strains, is the most important single number in a screening campaign's design, and it is routinely never computed. Edge effects and the humidity problem The outer wells of a microplate evaporate faster than the interior wells. This is the single most reliable artefact in plate-based biology, and every screening laboratory encounters it, usually by discovering that its top hits form a ring. The mechanism is straightforward. Evaporation from a well depends on the vapour pressure gradient above it, and a well on the perimeter has neighbours on fewer sides, so it sits in drier air. Over an eight-hour kinetic run in a 384-well plate at 37 °C, perimeter wells can lose a noticeable fraction of their volume. That concentrates the medium, concentrates the cells, raises the apparent optical density, and raises fluorescence. If the reporter's expression is also sensitive to nutrient concentration or osmolarity, the biological signal changes too, so the artefact is not a simple multiplicative correction. There are four responses, in increasing order of cost and effectiveness. Do not use the edge wells. Fill the perimeter with medium or water and use only the interior. This costs 40% of a 96-well plate and 25% of a 384-well plate, which is an acceptable price for a small campaign and an unacceptable one for a large one. Control the environment. Humidified incubation, plate seals that are gas-permeable but restrict vapour loss, and lids with condensation rings all reduce the gradient. A humidified reader chamber is the single most effective hardware investment for kinetic assays. Beware that gas-permeable seals differ enormously in their oxygen transfer rate and that some fluoresce. Include position in the analysis. If you have enough control wells distributed across the plate, you can fit a spatial model — a smooth surface across row and column — and correct for it. Several established normalisation methods for plate data do exactly this. The risk is that a spatial model will happily absorb real biological signal if your layout has any spatial structure, which is why the next point matters most. Randomise the layout. If the assignment of library members to wells is randomised, and re-randomised between replicate plates, then position-driven artefacts become noise rather than bias. A variant that appears to be a hit because it landed in a corner will not land in a corner on the replicate plate. This costs nothing except a slightly more complicated plate map and a liquid handler method that can execute an arbitrary mapping — which is precisely why methods should take plate maps as inputs. Randomisation does not remove the artefact and should not replace environmental control, but it is the difference between an inflated variance and a fabricated result. The common practice of laying out a library in the order the clones were picked, with controls in column 1 and column 24, combines the worst of all worlds: it confounds identity with position and it puts the controls exclusively in the wells most affected by the edge. Controls that earn their place An automated assay should carry more controls than a manual one, because they are nearly free. A reasonable standard set for a fluorescent reporter screen in 384-well format: · Blank wells containing medium only, distributed across the plate rather than clustered, used to establish background for both absorbance and fluorescence. · Negative controls — cells carrying the vector without the reporter, or with a non-functional variant — which capture cellular autofluorescence, a real and wavelength-dependent contribution that varies with growth phase. · Positive controls at two or three levels, not one. A single strong positive control tells you the assay is alive. A graded set tells you the assay is linear over the range you care about, which is the actually useful information. · A calibrant — a well or a separate plate containing a known concentration of a fluorescent standard, discussed in Chapter 5 — which is what allows the plate to be compared to any other plate. · Replicate reference wells of a single strain, scattered across positions, which give a direct empirical estimate of well-to-well variation for the thing you are actually measuring, rather than for a control that behaves differently. The last item is the most often omitted and among the most useful. Twelve wells of the same strain, spread across the plate, give you the plate's true reproducibility in a way that no amount of control-based statistics can. Dynamic range, saturation, and the trap of the good result A screen that reports many samples at the top of its range is not finding many excellent variants; it is saturated. Detector saturation is easy to spot when the reader reports an overflow value, and easy to miss when it reports a number that is merely at the ceiling of linearity. Fluorescence detection is linear over a wide but finite range, and at high fluorophore concentration the inner filter effect — reabsorption of emitted light by the sample itself — bends the response downward without any warning flag. The remedy is to establish the linear range explicitly during assay development, with a dilution series of the fluorophore or of a strongly expressing strain, at the exact gain and optical settings the campaign will use. Then set the gain so the strongest expected sample sits comfortably inside that range, and fix it. Automatic gain adjustment, which many readers offer and many users leave enabled, is actively harmful for screening: it rescales each plate independently based on its brightest well, which makes plates incomparable and destroys any possibility of absolute calibration. The same caution applies at the bottom. A weakly expressing variant whose signal is close to the blank is being measured as a difference between two similar numbers, and its relative uncertainty is large. Screens routinely report fold-changes for such wells with a confidence the underlying numbers cannot support. Building the funnel before the screen Finally, a point about campaign design rather than assay design. A screen is not a single measurement; it is the first stage of a funnel, and the funnel should be designed backwards from what you can afford at the end. Suppose the final stage — a shake-flask culture with analytical chemistry — costs you a day per variant and you can run twenty. That fixes the number of variants that must emerge from the previous stage, which fixes the required specificity at that stage, which fixes what the primary screen has to deliver. Working backwards in this way turns vague ambitions about throughput into concrete requirements: the primary screen needs to reduce ten thousand to two hundred with a false negative rate you can tolerate, and the secondary needs to reduce two hundred to twenty with high precision. The two stages have genuinely different requirements, and conflating them is a common design error. A primary screen should be cheap, fast, tolerant of false positives, and intolerant of false negatives — you cannot recover what you discard. A secondary screen should be expensive, careful, replicated, and closer to the eventual application. Using the same assay for both, at the same number of replicates, wastes money at the top of the funnel and accepts too much uncertainty at the bottom. And a primary screen should be validated against the secondary before the campaign, not after. Take thirty variants spanning the expected range, measure them in both assays, and look at the correlation. If the primary does not predict the secondary, the campaign will produce a hit list that the secondary rejects, and you will have learned that at the cost of the whole screen rather than the cost of thirty wells. Chapter 3: Liquid Handling as Metrology A liquid handler is a measurement instrument. It is not usually treated as one. Chromatographs get calibration curves, balances get check weights, plate readers get reference standards; liquid handlers get a service visit when they start crashing tips, and are otherwise assumed to deliver whatever volume the method requested. This assumption is almost always wrong in detail and sometimes wrong in ways that matter. An eight-channel head may deliver volumes that differ between channels by several percent. A tip type substituted by purchasing may change the aspiration geometry. A method written for aqueous buffer may deliver 20% less when applied to a glycerol-containing enzyme mix. None of these produce an error message. They produce data. Treating liquid handling as metrology means three things: knowing what the instrument's tolerance actually is for the liquid and volume you are using, verifying it periodically against a traceable method, and designing protocols with an error budget that the verified tolerances can meet. How liquids get moved The technologies available differ in ways that matter far beyond the specification sheet, and choosing badly is expensive because the choice is embedded in the hardware. Air-displacement pipetting is the mechanism of a standard handheld pipette and of most robotic pipetting heads. A piston moves a column of air, which moves the liquid. It is versatile and cheap, it uses disposable tips, and its accuracy depends on the physical properties of the liquid — because the air column is compressible and because aspiration depends on the liquid's viscosity, density, vapour pressure, and surface tension. Volatile solvents partially evaporate into the air column and cause under-delivery; viscous liquids flow slowly and need slower aspiration and a delay before withdrawal; detergent-containing solutions wet the tip exterior and carry extra volume. All of these are manageable, and all of them require the method to know what liquid it is handling. This is what liquid class definitions are for, and they are the most consistently neglected part of liquid handler configuration. Positive-displacement pipetting puts a piston in direct contact with the liquid, inside a disposable capillary. There is no air column, so viscosity and volatility matter much less. It is the right choice for glycerol stocks, DMSO, organic solvents, and anything where the liquid class problem is otherwise intractable. The consumables cost more. Acoustic dispensing uses focused ultrasound to eject a droplet from the surface of a source well upward into an inverted destination plate. Nothing touches the liquid. Common instruments dispense in increments of a few nanolitres — 2.5 nL on widely used models — and build larger volumes by firing repeatedly. The advantages are considerable: no tips at all, therefore no tip cost and no carryover; excellent precision at volumes far below what tips can manage; and the ability to create arbitrary dose-response layouts directly, since every well can receive a different number of droplets. The limitations are equally real. The instrument must acoustically characterise each source well, which requires the fluid to be within a recognised class; not all biological fluids qualify, and cell suspensions certainly do not. Source plates are specialised and have a minimum working volume that becomes dead volume. And total transferred volume per well is limited in practice by how long you are willing to wait. Pin tools transfer a fixed small volume by dipping an array of pins into a source plate and touching them to a destination. They are fast, cheap, and mechanically simple, and they transfer whatever volume the pin geometry and the liquid's wetting behaviour dictate — which means the delivered volume is a property of the liquid as much as the tool, and carryover between uses requires a rigorous wash regime. Bulk dispensers — peristaltic or syringe-driven reagent dispensers with a manifold — add the same reagent to many wells quickly. They are the correct tool for adding medium, buffer, or a common reagent to a whole plate, and they are far faster and cheaper than doing it with a pipetting head. Their weakness is priming volume and the need to change tubing between reagents. Table 2 compares them on the criteria that actually determine a choice. Table 2. Liquid transfer technologies compared. Technology Practical volume range Carryover risk Sensitivity to liquid properties Best use Air displacement 0.5 µL – 1 mL None with new tips High General-purpose transfers, cells Positive displacement 0.5 µL – 1 mL None with new capillaries Low Viscous or volatile liquids Acoustic 2.5 nL – ~10 µL None (non-contact) High; fluid must be characterised Dose–response, reagent miniaturisation Pin tool Fixed, ~10 nL – 1 µL High without wash regime High Rapid replication of a plate Bulk dispenser 1 µL – several mL Within a reagent only Low Adding a common reagent to all wells A well-equipped workcell usually has two or three of these, because none covers the whole range. The most common productive combination is a tip-based head for cells and general work, a bulk dispenser for medium, and an acoustic dispenser for anything requiring small volumes or dose-response layouts. What accuracy and precision actually mean here Two distinct quantities get confused. Accuracy, or trueness, is how close the mean delivered volume is to the requested volume — a systematic offset. Precision, expressed as a coefficient of variation, is the scatter around that mean. They fail for different reasons and have different consequences. A systematic 5% under-delivery of an enzyme is usually harmless in a reaction with a broad optimum, and is fatal in a serial dilution where it compounds. Poor precision is the opposite: it adds variance to every well, which directly erodes the signal window and therefore the Z′ of every assay run on the instrument. The reference standard for volumetric apparatus is ISO 8655, which covers piston-operated volumetric instruments and specifies both the permissible errors and the gravimetric method used to establish them. Its central procedure is simple: dispense the target volume onto a calibrated analytical balance, repeatedly, under controlled temperature and humidity, and convert mass to volume using the density of water at the measured temperature, with a correction for air buoyancy and one for evaporation. The tolerances it specifies scale with volume — a large relative error is permitted at the bottom of an instrument's range and a small one at the top — which is itself the most important practical fact about pipetting: no instrument is accurate at the bottom of its range. A 1000 µL channel asked to deliver 10 µL is being used badly, and the fix is to use a smaller channel or a different technology, not to recalibrate. Gravimetry becomes impractical below roughly 1 µL, because evaporation during weighing and balance drift swamp the signal. Below that, photometric methods take over: dispense a dye of known absorbance into a known volume of diluent and read the resulting absorbance, either in a plate reader or with a dedicated dual-dye system that uses a ratio of two wavelengths to cancel path-length variation. Commercial kits for this exist and are the practical route for verifying nanolitre dispensing. For acoustic dispensers and other non-contact systems, a third approach is often more informative than either: dispense a fluorescent standard in a designed pattern across a plate — a gradient, a checkerboard, a set of replicate blocks — and read it. This does not give you traceable volumes, but it gives you the thing you actually need, which is a map of systematic spatial variation across the plate and across the instrument's source wells. Verification as a routine, not an event The useful mental model is the one used in analytical chemistry: instruments are qualified when installed, verified periodically, and checked with a quick control before consequential work. Installation qualification happens once, ideally with the vendor present, and establishes that the instrument meets specification with the tips, plates, and liquid classes you will actually use — not the vendor's demonstration configuration. Insist on testing your own consumables. Tip geometry varies between manufacturers and a third-party tip that fits mechanically may seal differently. Periodic verification is a scheduled gravimetric or photometric check of each channel at three volumes spanning the working range — typically the minimum, roughly 10% of maximum, and the maximum. Quarterly is a defensible default for a heavily used instrument; annually is the minimum for a lightly used one. Record the results as a time series, not as a pass/fail. The trend is what tells you a seal is failing, months before it fails audibly. Pre-run checks are the cheap ones that catch the acute problems: a visual confirmation that tips are seated, a test dispense into a clear plate to check for blocked channels, a weight check on a single channel. Some platforms support in-line verification, such as pressure monitoring during aspiration that detects a clot or an empty well and flags the affected wells. Where this exists, it should be enabled and its output should reach the dataset, not just the log file — a well flagged for a failed aspiration should be marked in the results, a point developed in Chapter 7. The most valuable habit, and the cheapest, is to keep a verification log that lives with the instrument and is readable by everyone who uses it. A laboratory where any user can see that channel 6 has been drifting for two months is a laboratory where somebody will fix channel 6. Liquid classes and the things that break them A liquid class is a bundle of parameters — aspiration speed, dispense speed, air gaps, delays, tip immersion depth, retract speed, blowout volume — tuned for a particular fluid. Most platforms ship with classes for water, ethanol, glycerol, DMSO, and serum, and most laboratories use the water class for everything. The fluids that punish this, in rough order of how often they cause trouble: Glycerol-containing enzyme mixes. Commercial enzymes are supplied in 50% glycerol. A master mix is often 10–20% glycerol, which is viscous enough that a water class under-delivers substantially and leaves a residual film in the tip. Slow the aspiration, add a post-aspiration delay of a second or more, slow the dispense, and touch the tip to the well wall. Detergent-containing buffers. Low surface tension means the liquid wets the tip exterior and creeps. Use a class with reduced immersion depth and be alert to over-delivery. Cell suspensions. Cells settle. A suspension aspirated from a reservoir that has been sitting for ten minutes is not the same suspension the method assumed, and the first plate of a batch will differ from the last. Mixing before each aspiration is essential; for anything that settles quickly, a stirred reservoir or a repeated remix step is required. This is a leading cause of apparent position effects that are in fact time effects — the wells filled last had fewer cells — and it is easily mistaken for an edge artefact. Volatile organics. Evaporation into the air column causes under-delivery that worsens with hold time. Positive displacement is the right answer. Small volumes of anything. Below about 2 µL with air displacement, surface tension at the tip orifice competes with the dispensed volume and a droplet may not detach at all. Dispensing into liquid rather than into air, or touching the tip to the well wall, resolves this and should be the default for small transfers. A laboratory that invests one week in defining and testing five or six liquid classes for its actual reagents will recover that week many times over, and will eliminate an entire category of irreproducibility that would otherwise be attributed to biology. Labware is part of the instrument A surprising share of liquid handling failures are not about liquid at all. They are about the physical objects the liquid is moved between, and about the coordinate system the robot believes it is working in. The reason a robotic arm can move a plate from a liquid handler to a reader to an incubator is that microplates have a standardised footprint. The ANSI/SLAS standards — which grew out of the earlier Society for Biomolecular Screening specifications — fix the outer dimensions, the flange, the height, and the well positions for the common formats. Every piece of automation is built around those dimensions, and any labware that deviates will eventually cause a collision. Within the standard footprint, however, plates vary enormously in ways that matter. Well bottom geometry — flat, round, or conical — changes the optical path, the residual volume a tip can recover, and how cells settle. Well colour changes everything optical: clear plates for absorbance, black plates for fluorescence to suppress well-to-well crosstalk and background, white plates for luminescence to maximise reflected photons. A laboratory that runs a fluorescence assay in clear plates because that is what was in the cupboard has thrown away a large fraction of its signal window for no reason. Plates also warp. Polystyrene plates subjected to a temperature cycle, or stacked under weight, can bow by enough to change the distance between the tip and the well bottom by a millimetre. For a 384-well plate with a 5 µL residual volume this is the difference between aspirating liquid and aspirating air, or between dispensing into liquid and crashing a tip. Plate sealing and de-sealing is another underappreciated failure mode: an automated sealer that leaves adhesive residue, or a peeler that lifts a corner of the plate, will produce a run of missing wells that look like biological failures. All of this connects to teaching — the process of establishing, for each deck position and each labware type, the exact coordinates the robot should move to. Most platforms store this as a labware definition with offsets. The definitions drift: a deck adapter is removed for cleaning and replaced slightly differently, an instrument is bumped, a new lot of plates is a fraction of a millimetre taller. A laboratory should re-verify teaching on a schedule and always after any physical change to the deck, and should treat labware definitions as version-controlled configuration rather than as settings somebody adjusted once. The practical rule is to standardise ruthlessly on as few labware types as the science permits, buy them from one supplier in one specification, and record the catalogue number in the protocol. Substituting a visually identical plate from a different manufacturer is one of the most common causes of an automated protocol that worked last month and does not work today. Designing protocols within an error budget The engineering discipline that ties this together is the error budget: deciding, in advance, how much variation the final measurement can tolerate, and allocating it across the steps that contribute. Consider a typical assay: cells are diluted from an overnight culture, distributed into a plate, an inducer is added from a serial dilution, and the plate is read after growth. Four transfers contribute. If each has a coefficient of variation of 3%, and the errors are independent, the combined contribution is roughly the square root of the sum of squares — about 6%. If one step is a serial dilution of six steps, its errors compound multiplicatively rather than adding in quadrature, and a systematic 3% offset per step becomes a 19% error at the end of the series. Three design rules follow. Prefer direct dispensing to serial dilution. An acoustic dispenser creating a twelve-point dose-response by varying droplet count has no compounding error, because every well is made independently from the same source. A serial dilution has error that grows down the series and is systematically biased. Where the technology allows it, direct dispensing is strictly better, and this is one of the strongest arguments for acoustic dispensing in assay work. Prefer fewer, larger transfers. Every transfer adds variance. A protocol that combines three reagents into a premix and transfers once is more precise than one that transfers three times into the well, provided the premix is stable. Put the imprecise step where it matters least. If one transfer must be at the bottom of an instrument's range, make it the one whose concentration the assay is least sensitive to. Knowing which that is requires having actually characterised the assay's sensitivity to each component — which is a design-of-experiments question, taken up in Chapter 9. Finally, measure the budget rather than assuming it. A single experiment in which the whole protocol is run with a fluorescent tracer substituted for one reagent, and the resulting plate is read, gives an empirical distribution of the delivered amount across all wells and all steps. That number — the end-to-end coefficient of variation of the actual protocol — is worth more than any individual channel calibration, and almost no laboratory measures it. It is the number that determines what your screen can detect. Hashtags: #SyntheticBiologyProtocols #HighThroughputScreening #LaboratoryAutomation #DesignBuildTestLearn #Biofoundry #AssayDevelopment #AssayValidation #ZPrimeFactor #MicroplateScreening #PlateRandomization #EdgeEffects #LiquidHandling #LiquidHandlingMetrology #AcousticDispensing #PositiveDisplacementPipetting #Microfluidics #Miniaturization #PlateReaderCalibration #MeasurementTraceability #AutomatedDNAAssembly #ErrorHandling #LaboratoryInformationManagement #ActiveLearning #SelfDrivingLaboratories #FutureOfSyntheticBiologyAutomation