Over the past decade, many studies documented high genetic divergence between closely related species in genomic regions experiencing restricted recombination in hybrids, such as within chromosomal rearrangements or areas adjacent to centromeres. Such regions have been called 'islands of speciation' because of their presumed role in maintaining the integrity of species despite gene flow elsewhere in the genome. Here, we review alternative explanations for such patterns. Segregation of ancestral variation or artifacts of nucleotide diversity within species can readily lead to higher F(ST) in regions of restricted recombination than other parts of the genome, even in the complete absence of interspecies gene flow, and thereby cause investigators to erroneously conclude that islands of speciation exist. We conclude by discussing strengths and weaknesses of various means for testing the role of restricted recombination in maintaining species.