TY - JOUR
T1 - DCR-KD
T2 - Dynamic Class Relation Knowledge Distillation for Semantic Segmentation With the Frontal-Viewing Camera of Limited Field of View in an Internet of Things Environment
AU - Jeong, Seong In
AU - Jeong, Min Su
AU - Jeon, Eun Som
AU - Park, Kang Ryoung
N1 - Publisher Copyright:
© 2014 IEEE.
PY - 2025
Y1 - 2025
N2 - In autonomous driving with Internet of Things (IoT)Internet of Things (IoT) devices, real-time road perception and semantic segmentation are essential for intelligent transportation systemsintelligent transportation systems. However, deploying models on IoT devices is challenging due to their limited computational power, memory, and energy availability. Additionally, limited field of view (FoV)field of view (FoV) occurs frequently in real-world scenarios, such as constrained camera angles or occlusion by large objects, leading to significant degradations in segmentation performance. To address these challenges, we propose dynamic class relation-knowledge distillation (DCR-KD), a framework that generates lightweight models by transferring knowledge from high-performance teacher models. Central to our method is the limited FoV edge module (LFEM)limited FoV edge module (LFEM), which extracts edge-aware features of the teacher to refine the learning of the student. LFEM is designed to capture edge-based features in regions with limited FoV, effectively representing critical object boundaries. A channel attentionchannel attention mechanism further enhances semantic features, allowing the student to focus on key information in constrained visual contexts. A dynamic class relation map captures global semantic relationships among classes, enriching the scene understanding of the student. The final student model is independent of the teacher during inference, enabling efficient deployment in resource-constrained environments. Extensive evaluations demonstrate the effectiveness of DCR-KD, including segmentation performance and feature visualizations. Our method bridges the performance gap between resource-intensive teacher models and efficient student models, providing a practical solution for IoT-based real-time road perception, particularly under limited FoV conditions.
AB - In autonomous driving with Internet of Things (IoT)Internet of Things (IoT) devices, real-time road perception and semantic segmentation are essential for intelligent transportation systemsintelligent transportation systems. However, deploying models on IoT devices is challenging due to their limited computational power, memory, and energy availability. Additionally, limited field of view (FoV)field of view (FoV) occurs frequently in real-world scenarios, such as constrained camera angles or occlusion by large objects, leading to significant degradations in segmentation performance. To address these challenges, we propose dynamic class relation-knowledge distillation (DCR-KD), a framework that generates lightweight models by transferring knowledge from high-performance teacher models. Central to our method is the limited FoV edge module (LFEM)limited FoV edge module (LFEM), which extracts edge-aware features of the teacher to refine the learning of the student. LFEM is designed to capture edge-based features in regions with limited FoV, effectively representing critical object boundaries. A channel attentionchannel attention mechanism further enhances semantic features, allowing the student to focus on key information in constrained visual contexts. A dynamic class relation map captures global semantic relationships among classes, enriching the scene understanding of the student. The final student model is independent of the teacher during inference, enabling efficient deployment in resource-constrained environments. Extensive evaluations demonstrate the effectiveness of DCR-KD, including segmentation performance and feature visualizations. Our method bridges the performance gap between resource-intensive teacher models and efficient student models, providing a practical solution for IoT-based real-time road perception, particularly under limited FoV conditions.
KW - Dynamic class relations
KW - Internet of Things (IoT)
KW - knowledge distillationknowledge distillation (KD)
KW - limited field of viewfield of view (FoV)
KW - road perception
KW - semantic segmentation
UR - https://www.scopus.com/pages/publications/105009622237
U2 - 10.1109/JIOT.2025.3585188
DO - 10.1109/JIOT.2025.3585188
M3 - Article
AN - SCOPUS:105009622237
SN - 2327-4662
VL - 12
SP - 38198
EP - 38216
JO - IEEE Internet of Things Journal
JF - IEEE Internet of Things Journal
IS - 18
ER -