Intermediate-mass black hole binary evolution in nuclear star clusters: The effect of the stellar-mass black hole population | Synapse