Answers are grounded in this paper and cite their sources.
Four‐dimensional scanning transmission electron microscopy (4D‐STEM) generates datasets whose volume already outpaces practical storage, transfer, and analysis. We benchmark 13 off‐the‐shelf lossless compression implementations across five datasets and find that the Blosc family substantially outperforms the compressors built into HDF5, achieving comparable compression ratios at far higher throughput. The broader conclusion is that this route is closing. Lossless compression is bounded by the entropy of the source, and on a simulated dataset where that bound can be computed exactly, the best implementation already comes within a factor of 2.5. A better implementation would recover a small multiple, not the orders of magnitude that rising detector rates demand. What must be decided instead is which data to keep and which to discard. Researchers already make this judgement routinely and often intuitively; it will have to be made explicit as agentic systems take on data collection and analysis. We argue for inference‐sufficient representations: a record suffices when it retains what an intended inference requires, not when it is complete. We distinguish coarsening, which cannot be false, from interpretation, which can, and show that event‐based detectors already perform the latter. We suggest design principles for deciding what a given inference requires.
No takes yet. Share an insight, caveat, or question.
Dyck et al. (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: