Answers are grounded in this paper and cite their sources.
GPUs are seeing increasingly widespread use for general purpose computation due to their excellent performance for highly-parallel, throughput-oriented applications. For many workloads, however, the performance benefits of offloading are hindered by the large and unpredictable overheads of launching GPU kernels and of transferring data between CPU and GPU.
No takes yet. Share an insight, caveat, or question.
Lustig et al. (2013) studied this question.