conference paper

Conference Paper

International Conference on Wireless and Mobile Computing, Networking and Communications. 2022, 2022-October, p. 381-386

Semantic Communication for Capacity-aware Remote Collaboration

IEEE Computer Society

English

2022-11-15

https://doi.org/10.1109/WiMob55322.2022.9941595

Amano T., Kala S.M., Mizumoto T., et al. Semantic Communication for Capacity-aware Remote Collaboration. International Conference on Wireless and Mobile Computing, Networking and Communications 2022-October, 381 (2022); https://doi.org/10.1109/WiMob55322.2022.9941595.

The global spread of coronavirus has sparked a considerable interest in technologies that facilitate seamless communication between users which are physically or spatially distant. Using current remote collaboration systems that utilize 3D sensing with LiDAR and depth cameras, point cloud streaming, and MR/VR devices, distant users can communicate with each other as if they did in person. However, these systems may violate users' privacy since they can share information of their entire personal space with other users. In addition, although various point cloud compression methods have been proposed, remote transmission of 3D scenes still requires significant bandwidth. This paper proposes a 3D spatial data sharing system based on the paradigm of 'semantic communication', i.e., controlling communication in the units of semantic objects. Our system understands the semantics of the scene and leverages point cloud streaming, thereby enabling users to assert fine-grained control over their privacy. Further, the system adaptively controls the size of the data frame based on network capacity and scene context. The experimental results show that the network delay can be reduced by 96%. We have also tested our system in a commercial 4G network, showing that 3-D spatial sharing with point clouds over severe networks is possible.

© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

100957

Semantic Communication for Capacity-aware Remote Collaboration

IEEE Computer Society

English

2022-11-15

International Conference on Wireless and Mobile Computing, Networking and Communications

2022-October

381

386

https://doi.org/10.1109/WiMob55322.2022.9941595

https://hdl.handle.net/11094/100957