Skip to main navigation Skip to search Skip to main content

Leveraging Multi-Image Representations for Improved Time-Series Knowledge Distillation on Wearable Sensor Data

  • Jae Chan Jeong
  • , Jun Soo Kim
  • , Matthew P. Buman
  • , Pavan Turaga
  • , Eun Som Jeon
  • Seoul National University of Science and Technology (SNUST)
  • Arizona State University

Research output: Contribution to journal › Article › peer-review

Abstract

Wearable sensors are key components of the Internet of Things (IoT), enabling continuous and context-aware monitoring of human activities. As the demand for wearable sensors increases, accurate analysis of time-series data has become critical for reliable activity classification. However, raw wearable sensor signals are often affected by noise and have limited ability to capture contextual and discriminative information. To address these challenges, recent studies have investigated image-based representations derived from time-series data, such as persistence images and Gramian angular fields, which provide richer feature representations for learning. Meanwhile, wearable devices operate under stringent computational and memory constraints, making lightweight models essential for practical deployment. Knowledge distillation (KD) has therefore adopted as an effective approach to transfer knowledge from large, complex models to compact ones suitable for resource-constrained environments. Despite the representational advantages of image-based approaches, their effective integration into KD frameworks for wearable sensor data remains underexplored. In this paper, we analyze how image-based representations contribute to activity classification from wearable sensor signals, and investigate how their incorporation into KD frameworks interacts with model compactness and representation richness. We further extend this analysis to the joint use of multiple image-based representations within KD, investigating their interactions and distillation behaviors. We conduct a comprehensive empirical study and extensive experimental analyses across multiple wearable sensor datasets, evaluating different KD strategies in terms of noise robustness, generalizability, intermediate feature representations, and computational efficiency. The results provide practical design guidelines to design compact and high-performance IoT-based wearable sensing systems.

Original languageEnglish
JournalIEEE Internet of Things Journal
DOIs
StateAccepted/In press - 2026

Keywords

  • gramian angular field
  • knowledge distillation
  • multimodal representation learning
  • persistence image
  • topological data analysis
  • wearable sensor data

Cite this