Multi-Modal Beam Prediction Challenge 2022: Towards Generalization
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:MR4XES6Yrecord.jsonopen to challenge →
read the original abstract
Beam management is a challenging task for millimeter wave (mmWave) and sub-terahertz communication systems, especially in scenarios with highly-mobile users. Leveraging external sensing modalities such as vision, LiDAR, radar, position, or a combination of them, to address this beam management challenge has recently attracted increasing interest from both academia and industry. This is mainly motivated by the dependency of the beam direction decision on the user location and the geometry of the surrounding environment -- information that can be acquired from the sensory data. To realize the promised beam management gains, such as the significant reduction in beam alignment overhead, in practice, however, these solutions need to account for important aspects. For example, these multi-modal sensing aided beam selection approaches should be able to generalize their learning to unseen scenarios and should be able to operate in realistic dense deployments. The "Multi-Modal Beam Prediction Challenge 2022: Towards Generalization" competition is offered to provide a platform for investigating these critical questions. In order to facilitate the generalizability study, the competition offers a large-scale multi-modal dataset with co-existing communication and sensing data collected across multiple real-world locations and different times of the day. In this paper, along with the detailed descriptions of the problem statement and the development dataset, we provide a baseline solution that utilizes the user position data to predict the optimal beam indices. The objective of this challenge is to go beyond a simple feasibility study and enable necessary research in this direction, paving the way towards generalizable multi-modal sensing-aided beam management for real-world future communication systems.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
Resolving Multi-Target Association in OFDM-based ISAC via Vision-aided Multi-Modal Learning
Vision-aided multi-modal fusion resolves multi-target association and resolution limits in OFDM-ISAC, reporting 16 cm localization RMSE and 60x improvement over wireless-only on a simulated vehicular testbed.
-
Multimodal Learning for MIMO Beam Prediction Based on Variational Inference
A two-stage variational inference framework decouples multimodal feature extraction and alignment for MIMO beam prediction, achieving competitive accuracy on DeepSense6G with only 20% of the usual multimodal training data.
-
Knowledge Distillation for Sensing-Assisted Long-Term Beam Tracking in mmWave Communications
Knowledge distillation creates a compact neural network for long-term beam tracking in mmWave communications that matches a larger teacher's accuracy with far fewer parameters and shorter input sequences.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.