Physics-agnostic inverse design using transfer matrices | Synapse