RNA polymerases (RNAPs) carry out transcription in all living organisms. All multisubunit RNAPs are derived from a common ancestor, a fact that becomes apparent from their amino acid sequence, subunit composition, structure, function and molecular mechanisms. Despite the similarity of these complexes, the organisms that depend on them are extremely diverse, ranging from microorganisms to humans. Recent findings about the molecular and functional architecture of RNAPs has given us intriguing insights into their evolution and how their activities are harnessed by homologous and analogous basal factors during the transcription cycle. We provide an overview of the evolutionary conservation of and differences between the multisubunit polymerases in the three domains of life, and introduce the 'elongation first' hypothesis for the evolution of transcriptional regulation.