Abstract Active galactic nuclei (AGNs) consist of a central supermassive black hole (SMBH) embedded in a region with both high gas and stellar densities: the gas is present as a thin accretion disc that fuels the central SMBH, while the stars form a dense, roughly isotropic nuclear star cluster. The binaries present in such a cluster could be considered naturally as triples, with the SMBH as a third object, and their dynamics also depend on the interaction with the gas-rich disc. In this paper, we study the evolution of such a binary on an inclined orbit with respect to the disc. The binary experiences both eccentricity excitation via the von Zeipel-Lidov-Kozai (ZLK) effect and drag forces from each time it penetrates the disc. We find that, as long as the inner binary remains in the ZLK regime, then the evolution of inner orbital separation can transition from a regime of gradual hardening to a regime of rapid softening as the outer orbital inclination decreases. As such binaries grow wider, their minimum pericentre distances (during ZLK oscillations) decrease. We show that a simple geometric condition, modulated by the complex ZLK evolution, dictates whether a binary expands or contracts due to the interactions with the AGN disc. Our results suggest that the interaction with gas-rich accretion disc could enhance the rate of stellar mergers and formation of gravitational wave sources, as well as other transients. The treatment introduced here is general and could apply, with the proper modifications, to hierarchical triples in other gas-rich systems.
Su et al. (Thu,) studied this question.