Venue: IEEE Transactions on Big Data

Authors: Ziyu Jia, Heng Liang, Yucheng Liu, Haichao Wang, Tianzi Jiang

We design a generic heterogeneous model knowledge distillation framework for sleep staging that addresses large structural differences between heterogeneous models, proposes multi-level knowledge distillation to transfer important feature knowledge, and introduces a teacher assistant module to ease scale differences between heterogeneous models.

Tags: Knowledge Distillation, Sleep Staging, Teacher Assistant