Skip to content
Field Atlas

Atlas / Biology / The Tree of Life Thread

Field · Emerged 1985 – 2020

Microbial Phylogenomics

How can the ancestry of organisms be read when almost none of them can be grown, and when their genes move sideways between lineages?

5 chapters7 min read6 turning points2 open problems

Branched from
Phylogenetics + Microbiology
Branched into
Not yet surveyed past here
Figures
James Staley, Allan Konopka, Norman Pace, Stephen Giovannoni, W. Ford Doolittle, Craig Venter, Jillian Banfield, Laura Hug, Anja Spang, Hiroyuki Imachi

In brief

For a century microbiology could study only what would grow on a plate, and classification rested on what a colony looked like and what sugars it fermented. Both limits fell between 1985 and 2005. Ribosomal RNA could be sequenced straight out of seawater or soil, with no culture step, and it showed that the organisms known to microbiologists were a sliver of what is there. Then whole communities were shotgun-sequenced, and genomes could be assembled for organisms nobody had ever seen.

The results broke two expectations. The number of major bacterial lineages roughly doubled, and most of the new ones have no cultured representative and no known physiology. And the tree itself came under suspicion: genes move between unrelated microbes often enough that different genes give different histories, which raises the question of what a microbial lineage even is. The current best reading of the deepest branches puts eukaryotes inside the archaea, which would mean there are two primary domains of life rather than three.

Key ideas

The great plate count anomalyEnters 1985

Direct microscopic counts of cells in a water or soil sample exceed the number of colonies that grow from it by two to three orders of magnitude. The gap is not a technical slip; it is the normal state of affairs, and it means culture-based microbiology sampled under one per cent of its subject.

Culture-independent surveyEnters 1986 – 1991

Extract DNA from an environmental sample, amplify a gene that every organism has — the small-subunit ribosomal RNA gene — sequence the products, and infer who was present from the sequences alone. The organism never has to be grown, or even seen.

Horizontal gene transferEnters 1999 – 2002

Genes passing between lineages rather than from parent to offspring, by conjugation, viruses or uptake of free DNA. In microbes it is common enough that a genome is a mosaic with several histories, and a single tree cannot represent all of them.

Metagenome-assembled genomeEnters 2004

A genome reconstructed by shotgun-sequencing a whole community and sorting the fragments into bins by composition and abundance. It is a consensus over a population rather than a clone, and it is how most known microbial genomes were obtained.

Candidate phylumEnters 2013 – 2016

A deep lineage known only from sequences, with no cultured member and no formal name under the bacteriological code. Many have reduced genomes and appear to live attached to other cells.

Two domains or threeEnters 2015 – 2020

Whether archaea and eukaryotes are sister groups, giving three domains, or eukaryotes branch from within the archaea, giving two. The second reading makes our own ancestry archaeal.

Chapter I

The Ninety-Nine Per Cent

Microbiology was built on the plate. Robert Koch's solid media let a single cell be grown into a visible, pure colony, and for a century that technique defined what a microbe was: something you could isolate, feed and describe. The trouble was visible from early on and named in 1985 by James Staley and Allan Konopka. Stain a millilitre of seawater and count the cells under a microscope and you find hundreds of thousands. Spread the same millilitre on rich agar and you get a few hundred colonies. The ratio is roughly a thousand to one, and it is normal — the same gap appears in soil, in sediment, in the gut.

So the organisms in the textbooks were the ones that happened to like laboratory conditions. Norman Pace drew the conclusion that mattered: if a cell cannot be grown, sequence it anyway. The ribosomal RNA gene is present in every organism, changes slowly enough to compare across the whole tree, and — crucially — can be amplified from DNA extracted straight out of mud. Carl Woese had already used it to show that the archaea are a lineage apart, work described in evolutionary biology. Pace's move was to point the same molecule at environments instead of strains.

In 1990 Stephen Giovannoni cloned ribosomal genes from Sargasso Sea water and found an abundant group with no cultured member. SAR11 is now thought to be among the most numerous organisms on the planet, and it was not isolated until 2002.

Chapter II

Reading Genomes Nobody Owns

Amplifying one gene tells you who is present. It says nothing about what they do. The next step was to sequence everything in a sample at once and reassemble genomes out of the mixture. In 2004 Jillian Banfield's group did this for an acid mine drainage biofilm, simple enough — five dominant organisms — that near-complete genomes came out, and Craig Venter's group did it for Sargasso seawater, returning more than a billion base pairs and over a million genes, most without any known relative.

Metagenome-assembled genomes are a strange kind of object. They are consensus sequences over a population rather than a clone; they can be contaminated by binning errors; they describe organisms that have never been in a flask. They are also now the majority of known microbial genomes, and they revealed a large part of the tree that culture had missed entirely. Filtering groundwater to remove anything cell-sized left a residue of bacteria with genomes under a megabase, lacking the pathways to make their own amino acids and nucleotides, belonging to dozens of lineages as distinct from each other as the familiar phyla are. Laura Hug's 2016 tree of life, built from over 3,000 genomes, has more than half of its bacterial branches populated only by sequences.

Chapter III

The Tree, the Web, and Two Domains

Whole genomes brought a harder problem than diversity. Genes move sideways in microbes. A gene for antibiotic resistance, for a metabolic step, for a toxin, can pass between unrelated organisms by conjugation, by virus, or by uptake of DNA from the water, and once arrived it is inherited normally. W. Ford Doolittle argued in 1999 that if this happens often enough, the universal tree is not an approximation to microbial history but the wrong shape for it. A genome is a mosaic, and each tile may have its own ancestry.

The partial reply is that not all genes travel equally. Those of the ribosome and the transcription machinery are embedded in so many interactions that a transferred copy rarely works, and trees built from them agree with one another far more than chance allows. That core is what deep phylogenies use, and it is why a universal tree is still drawn — with the understanding that it is the history of a conserved core, not of every gene in any genome.

That core tree then produced the field's largest surprise. In 2015, metagenomes from marine sediment near Loki's Castle, a vent field on the Mid-Atlantic Ridge, yielded archaea carrying genes that were supposed to be eukaryotic: relatives of actin, components of the membrane-remodelling ESCRT machinery, small GTPases. More Asgard lineages followed, and in 2020 one was cultured, after twelve years of coaxing, as a small cell with branching protrusions. When these organisms are included, phylogenies place eukaryotes not as a sister group to the archaea but inside them. If that is right, there are two primary domains of life, not three, and our own lineage is a branch of the archaea that acquired a bacterium — the event discussed under endosymbiosis.

Chapter IV

A Closer Look: Why the Rare Biosphere Appeared Only When Reads Got Cheap

Take a millilitre of coastal seawater. Direct counts give roughly 5×1055 \times 10^{5} cells; plating gives a few hundred colonies, so culture reaches of order

5×1025×105=0.1%.\frac{5 \times 10^{2}}{5 \times 10^{5}} = 0.1\%.

Now sequence instead. A Sanger-era survey cloned perhaps n=100n = 100 ribosomal genes. If a taxon makes up a fraction ff of the community, the chance that at least one of nn independent reads comes from it is

P(detected)=1−(1−f)n.P(\text{detected}) = 1 - (1-f)^{n}.

For a taxon at 10% abundance and 100 clones, detection is a certainty: 1−0.9100≈1−3×10−51 - 0.9^{100} \approx 1 - 3 \times 10^{-5}. At 1%, 1−0.99100=0.631 - 0.99^{100} = 0.63 — better than a coin flip. At 0.1%,

1−0.999100=0.095,1 - 0.999^{100} = 0.095,

so nine times out of ten the organism is simply absent from the result. A survey of a hundred clones is blind below about one part in a thousand, and it is blind in a way that leaves no trace: the output looks like a complete community of a dozen abundant types.

Modern amplicon sequencing returns n=105n = 10^{5} reads from one sample. For a taxon at f=10−4f = 10^{-4} the expected number of reads is nf=10nf = 10, and

P(detected)=1−(1−10−4)105≈1−e−10=0.99995.P(\text{detected}) = 1 - (1 - 10^{-4})^{10^{5}} \approx 1 - e^{-10} = 0.99995.

Three orders of magnitude deeper, and the long tail becomes visible: thousands of low-abundance types in a single sample, the "rare biosphere". Nothing about the ocean changed between 1990 and 2006. The detection limit moved, and with it the apparent shape of microbial diversity — which is a warning worth carrying. Every claim about how many kinds of organism are present is a claim about sampling depth, and the curve of new types against reads has, in most environments, not yet flattened.

The scale underneath these numbers is worth stating plainly. Estimates put the number of bacterial and archaeal cells on Earth at 44 to 6×10306 \times 10^{30}, with a large fraction in sediments and the deep subsurface, and bacteria alone hold some 70 gigatonnes of carbon, about fifteen times the mass of all animals. Most of that is in lineages described in the last twenty years, by people who never saw a cell of it.

Chapter V

What Counts as a Lineage

The practical response to all this has been to stop asking what a microbial species is and to define an operational unit instead. Two genomes sharing more than about 95% average nucleotide identity are treated as one species; ribosomal sequences above 98.7% identity likewise. The Genome Taxonomy Database rebuilt bacterial and archaeal classification on these rules in 2018, renaming a great many organisms and producing a taxonomy in which ranks are defined by evolutionary distance rather than by judgement.

It works, and it is an admission. The units are stipulated, not discovered, which is the species problem of systematics in its sharpest form: for most of life on Earth, the kinds are drawn by threshold. What the resulting lineages have done over geological time — whether they diversify, saturate, or turn over — is a question the fossil record can barely address for microbes, and that macroevolution answers mainly for animals and plants.

Applications

Where it is used

  • Biotechnology

    Gene editors found in groundwater

    CRISPR systems are bacterial defences, and most of the known variants were discovered not in cultures but in metagenomes. CasX, found in genomes assembled from groundwater sediment, is compact enough to be delivered where Cas9 will not fit, and the Cas12 and Cas13 families came from similar surveys. The uncultured majority is a parts catalogue that nobody had been able to open.

    › Sources (1)
    • Burstein, D. et al. (2017). New CRISPR–Cas systems from uncultivated microbes. Nature 542: 237–241.
  • Biogeochemistry

    Who runs the nitrogen cycle

    Culture-independent surveys overturned the textbook account of nitrogen in the sea twice. Ammonia-oxidising archaea, unknown before environmental sequencing, turned out to be among the most abundant organisms in the ocean and to perform a step attributed to bacteria; and anaerobic ammonium oxidation, carried out by a bacterial group with no cultured representative when it was found, accounts for a large share of the nitrogen leaving the ocean.

    › Sources (2)
    • Könneke, M. et al. (2005). Isolation of an autotrophic ammonia-oxidizing marine archaeon. Nature 437: 543–546.
    • Kuypers, M. M. M. et al. (2003). Anaerobic ammonium oxidation by anammox bacteria in the Black Sea. Nature 422: 608–611.
  • Conservation

    Surveying by the DNA an ecosystem sheds

    The same logic applied to larger organisms gives environmental DNA surveys: filter a litre of river water, amplify a standard marker, and list the fish, amphibians and invertebrates upstream without catching any of them. It has become a standard monitoring method, with the same interpretive problems — what the reference library lacks, the survey cannot report.

    › Sources (1)
    • Deiner, K. et al. (2017). Environmental DNA metabarcoding: transforming how we survey animal and plant communities. Molecular Ecology 26: 5872–5895.

Open problems

Where the map runs out

Open

Where the universal tree is rooted

Open as of 2026; the two-domain topology is favoured, but the root's position within it is not fixed.

A tree without a root has no direction, and nothing outside life can serve as an outgroup for all of life. The root has been placed on the bacterial branch, between bacteria and archaea, and inside the bacteria, using ancient gene duplications, models of gene gain and loss, and arguments from which features are likely to be primitive. No placement commands agreement.

Why it is hard

The events in question are some 3.5 billion years old, the sequences are saturated, and every candidate outgroup is a duplicated gene whose own history must be assumed. Horizontal transfer in the deep past erases the distinction between inheritance and acquisition for exactly the genes that would be most informative.

What resolving it unlocks

What the last universal common ancestor was like — whether it was a cell, a community, or something less tidy — and therefore what the earliest biology looked like.

› Sources (2)
  • Gogarten, J. P. et al. (1989). Evolution of the vacuolar H+-ATPase: implications for the origin of eukaryotes. PNAS 86: 6661–6665.
  • Coleman, G. A. et al. (2021). A rooted phylogeny resolves early bacterial evolution. Science 372: eabe0511.

Open

What the uncultured majority does

Open as of 2026; most candidate phyla still have no characterised member.

Thousands of lineages are known only as genomes. Their gene content suggests dependence on other organisms — missing pathways for amino acids, nucleotides and lipids — but for most of them nobody knows the host, the exchange, or the role in any cycle of matter. Several attempts to culture them have taken a decade each.

Why it is hard

A genome lists capacities, not behaviour, and roughly a third of the genes in these organisms match nothing characterised. Growing an organism whose requirements are unknown is a search over media, partners and conditions with no gradient to follow.

What resolving it unlocks

The accounting of the planet's carbon, nitrogen and sulphur cycles, which currently assigns fluxes to organisms whose metabolism is inferred from sequence alone.

› Sources (2)
  • Rinke, C. et al. (2013). Insights into the phylogeny and coding potential of microbial dark matter. Nature 499: 431–437.
  • Lewis, W. H., Tahon, G., Geesink, P., Sousa, D. Z. & Ettema, T. J. G. (2021). Innovations to culturing the uncultured microbial majority. Nature Reviews Microbiology 19: 225–240.

Further reading

  1. Pace, N. R. (1997). A molecular view of microbial diversity and the biosphere. Science 276: 734–740.

    The programmatic paper for culture-independent microbiology, still the clearest statement of why it mattered.

  2. Doolittle, W. F. (1999). Phylogenetic classification and the universal tree. Science 284: 2124–2129.

    The case that the tree is the wrong picture for microbial history.

  3. Quince, C., Walker, A. W., Simpson, J. T., Loman, N. J. & Segata, N. (2017). Shotgun metagenomics, from sampling to analysis. Nature Biotechnology 35: 833–844.

    How metagenome-assembled genomes are actually produced, and where they go wrong.