Answers are grounded in this paper and cite their sources.
Fig. When sufficiently tilted, the object slides across the tray and hits the walls of the tray. This generates sound, which is captured by four contact microphones mounted on each side of the tray. An overhead camera records visual (RGB+Depth) information, while the robotic arm applies the tilting actions through end-effector rotations.
No takes yet. Share an insight, caveat, or question.
Gandhi et al. (2020) studied this question.