Generalized hidden Markov models for phylogenetic comparative datasets

Abstract Hidden Markov models (HMMs) have emerged as an important tool for understanding the evolution of characters that take on discrete states. Their flexibility and biological sensibility make them appealing for many phylogenetic comparative applications. Previously available packages placed unnecessary limits on the number of observed and hidden states that can be considered when estimating transition rates and inferring ancestral states on a phylogeny. To address these issues, we expanded the capabilities of the R package corHMM to handle n ‐state and n ‐character problems and provide users with a streamlined set of functions to create custom HMMs for any biological question of arbitrary complexity. We show that increasing the number of observed states increases the accuracy of ancestral state reconstruction. We also explore the conditions for when an HMM is most effective, finding that an HMM is an appropriate model when the degree of rate heterogeneity is moderate to high. Finally, we demonstrate the importance of these generalizations by reconstructing the phyllotaxy of the ancestral angiosperm flower. Partially contradicting previous results, we find the most likely state to be a whorled perianth, whorled androecium, whorled gynoecium. The difference between our analysis and previous studies was that our modelling explicitly allowed for the correlated evolution of several flower characters.