Answers are grounded in this paper and cite their sources.
Smartphones are frequently used in stationary (i.e., static) contexts where users place them on surfaces for extended periods to support tasks such as following recipe instructions while cooking, accessing manuals while repairing, or practicing crafts like painting or pottery through video. However, interacting with a smartphone in these scenarios often requires direct touchscreen contact, which becomes problematic to execute easily when both of the user’s hands get wet, greasy, or contaminated with substances such as oils and chemicals. This is because it can cause liquid ingress or display staining when touching the smartphone, as well as the triggering of technical faults such as “ghost touches” or screen non-responsiveness due to the presence of wet or contaminated insulating material. Existing solutions face limitations: voice control struggles with environmental noise, while Back-of-Device interactions are inaccessible when the smartphone is placed on a surface. Accordingly, we introduce Unobtrusive Ferromagnetic Objects (UFO)—a lightweight, passive solution that enables touch-free interaction with smartphones using readily available ferromagnetic (FM) objects found in everyday settings in various forms, e.g., keys, spoons, screwdrivers, pens, and scales. UFO requires no modifications to the smartphone, object, environment, or surface, as it operates entirely through the built-in magnetometer. We conducted comprehensive technical and user-based (N=12) evaluations of the UFO technique across a wide range of real-world scenarios. The results demonstrated highly accurate identification of FM object-based inputs (98.9% on average) without requiring prior calibration, while maintaining consistent performance across diverse real world environments. Additionally, a user study (N = 21) demonstrated that the UFO approach achieved high task performance and low reported difficulty and fatigue when compared with direct touchscreen interaction under the matched temporal-gesture condition. These findings support the feasibility of UFO for providing touch-free input to smartphones placed on surfaces and motivate potential applications in situations where direct contact with the smartphone may be undesirable, including scenarios involving gloved or contaminated hands. By leveraging everyday objects as input tools, UFO presents an intuitive, scalable, and user-friendly alternative that complements traditional touchscreen interaction.
No takes yet. Share an insight, caveat, or question.
Mishra et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: