Hearing Touch: Audio-Visual Pretraining for Contact-Rich Manipulation
arXiv:2405.08576v1 Announce Type: new Abstract: Although pre-training on a considerable amount of information is useful for robotic studying, present paradigms solely carry out large-scale pretraining for visible representations, whereas representations for different modalities are educated from scratch. In distinction to the abundance of visible information, it’s unclear what related internet-scale information could also be used for pretraining different modalities corresponding to tactile sensing. Such pretraining turns into more and more essential within the low-data regimes widespread in robotics functions. In this paper, we tackle this hole by utilizing contact microphones instead tactile sensor. Our key perception is that contact microphones seize inherently audio-based info, permitting us to leverage large-scale audio-visual pretraining to acquire representations that increase the efficiency of robotic manipulation. To the most effective of our data, our methodology is the primary strategy leveraging large-scale multisensory pre-training for robotic manipulation. For supplementary info together with movies of actual robotic experiments, please see https://ift.tt/mKk5T4s.
HI-FI News
by way of cs.RO updates on arXiv.org https://ift.tt/FTks806
May 15, 2024 at 09:34AM
-
Product on saleAudiophile Vinyl Records Cleaning BundleOriginal price was: €44.95.€34.95Current price is: €34.95. excl. VAT
-
Product on saleEasy Start Vinyl Records Cleaning KitOriginal price was: €39.90.€29.90Current price is: €29.90. excl. VAT
-
Vinyl Records Cleaner Easy Groove Concentrate€19.95 excl. VAT
-
Easy Groove Super Set€199.00 excl. VAT
-
Easy Groove Enzycaster – vinyl records prewash cleaner€25.00 excl. VAT
-
Easy Groove Spray&Wipe vinyl records cleaner€19.95 excl. VAT