Tianjin University Logo

Multimedia Signal Processing and Hardware Aware Intelligent Systems Lab

Some Publications of Recent 5 Years

Sensing - Theme 1: 3D Gaze Sensing- Stereoscopic Video Stimul & Gaze Depth

Journal Papers

Sun J, Wu Z, Wang H, Jing P, Liu Y, "A novel integrated eye-tracking system with stereo stimuli for 3-D gaze estimation," IEEE Trans. on Instrumentation and Measurement, vol. 72, pp. 1-15, 2023.

Sensor Fusion Paper 1

Sha T, Su J, Pun S, Liu Y, "Monocular 3D gaze estimation using feature discretization and attention mechanism," Optoelectronics Letters, vol. 19, no. 5, pp. 301-306, 2023.

Sensor Fusion Paper 2

李畅, 刘昱, 孙景林, "用于红外眼动图像分割的优化方法," 激光与光电子学进展, vol. 59, no. 02, pp. 223-231, 2022.

Sensor Fusion Paper 3

Patents

刘昱, 孙景林, "基于匹配特征的三维注视点估计及三维眼动模型建立方法," 专利号 ZL202110417364.X, 专利申请日: 2021年04月19日.

Patent 1

Sensing - Theme 2: Highly Synchronous Multi-spectral Sensing

Journal Papers

J. Liu, H. Wang, R. Liu, S. Wang and Y. Liu, "Sequential Spectral - Spatial Feature Convolution Network With Self - Attention for Remote Sensing Hyperspectral Image Classification," IEEE Transactions on Geoscience and Remote Sensing, vol. 63, pp. 1 - 15, 2025, Art no. 5601815.

Remote Sensing Hyperspectral Image Classification Paper

Processing - Theme 1: AI - Empowered Multimedia Signal Processing

Journal Papers

Peiguang Jing, Haoyi Sun, Liqiang Nie, Yun Li, Yuting Su. "Deep Multi - modal Hashing with Semantic Enhancement for Multi - label Micro - video Retrieval," IEEE Transactions on Knowledge and Data Engineering, 2024, 36(10): 5080 - 5091.

Journal Paper 1

Peiguang Jing, Xuan Zhao, Fugui Fan, Fan Yang, Yun Li, Yuting Su. "Multimodal Progressive Modulation Network for Micro - video Multi - label Classification," IEEE Transactions on Multimedia, 2024, 26: 10134 - 10144.

Journal Paper 2

Jing P, Liu X, Zhang L, Li Y, Liu Y, Su Y. "Multimodal Attentive Representation Learning for Micro-video Multi-label Classification," ACM Transactions on Multimedia Computing, Communications and Applications. 2024.

Journal Paper 3

Peiguang Jing, Yuting Su, Liqiang Nie, Xu Bai, Jing Liu, Meng Wang. "Low - rank Multi - view Embedding Learning for Micro - video Popularity Prediction," IEEE Transactions on Knowledge and Data Engineering, 2018, 30(8): 1519 - 1532.

Journal Paper 4

Wei Lu, Yujia Zhai, Jiaze Han, Peiguang Jing*, Yu Liu, Yuting Su. "VMemNet: A Deep Collaborative Spatial - Temporal Network with Attention Representation for Video Memorability Prediction," IEEE Transactions on Multimedia, 2024, 26: 4926 – 4937.

Journal Paper 5

Peiguang Jing, Yuechen Shang, Liqiang Nie, Yuting Su*, Jing Liu, Meng Wang. "Learning Low - rank Sparse Representations with Robust Relationship Inference for Image Memorability Prediction," IEEE Transactions on Multimedia, 2021, 23: 2259 - 2272.

Journal Paper 6

Peiguang Jing, Xianyi Liu, Ji Wang, Yinwei Wei, Liqiang Nie, Yuting Su. "StyleEDL: Style - Guided High - order Attention Network for Image Emotion Distribution Learning," In Proceedings of ACM International Conference on Multimedia, 2023: 853 - 861.

Journal Paper 7

Yuting Su, Wei Zhao, Peiguang Jing*, Liqiang Nie. "Exploiting Low - rank Latent Gaussian Graphical Model Estimation for Visual Sentiment Distribution," IEEE Transactions on Multimedia, 2023, 25: 1243 - 1255.

Journal Paper 8

Anan Liu, Yingdi Shi, Peiguang Jing*, Jing Liu, Yuting Su. "Structured Low - rank Inverse - covariance Estimation for Visual Sentiment Distribution Prediction," Signal Processing, 2018, 152: 206 - 216.

Journal Paper 9

Conference Papers

K. Hu, Y. Liu, F. Xu, R. Liu, H. Wang and S. Song, "Asymmetric Neural Image Compression with High - Preserving Information," 2024 IEEE International Symposium on Circuits and Systems (ISCAS), Singapore, Singapore, 2024, pp. 1 - 5, doi: 10.1109/ISCAS58744.2024.10558635.

Conference Paper 1

S. Wang, H. wang, R. Liu, Z. Wu, B. Wei, Y. Liu. "MSCFormer: Multi - Scale Circular Transformer for Image Deblurring." in 2024 IEEE International Conference on Visual Communications and Image Processing (VCIP), Tokyo, Japan, Dec, 2024.

Conference Paper 2

Processing - Theme 2: Medical Data Processing with AI

Journal Papers

Z Huang, J Duan, Y Xie, Y Liu. "UDNet: Unified Deep Network based on Transformer and Multi - stage Fusion for brain tumor classification from undersampled MRI," Neurocomputing 619, 129109.

Journal Paper 1

J Duan, Z Huang, Y Xie, J Wang, Y Liu. "Transformer - and joint learning - based dual - domain networks for undersampled MRI segmentation," Medical Physics 51 (11), 8108 - 8123.

Journal Paper 2

H Jiang, H Wang, T Pan, Y Liu, P Jing, Y Liu. "Mobile Application and Machine Learning - Driven Scheme for Intelligent Diabetes Progression Analysis and Management Using Multiple Risk Factors," Bioengineering 11 (11), 1053.

Journal Paper 3

J Duan, Y Liu, J Wang. "Accelerated SPIRiT parallel MR image reconstruction based on joint sparsity and sparsifying transform learning," IEEE Transactions on Computational Imaging 9, 276 - 288.

Journal Paper 4

T Pan, J Duan, J Wang, Y Liu. "Iterative self - consistent parallel magnetic resonance imaging reconstruction based on nonlocal low - rank regularization," Magnetic Resonance Imaging 88, 62 - 75.

Journal Paper 5

J Duan, T Pan, Y Liu, J Wang. "Non - local low - rank constraint - based self - consistent PMRI reconstruction using eigenvector maps," IET Signal Processing 17 (3), e12180.

Journal Paper 6

Conference Papers

R Liu, Y Liu, H Wang, K Hu, S Du. "A Novel Medical Image Fusion Framework Integrating Multi - scale Encoder - Decoder with Discrete Wavelet Decomposition," ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and ….

Conference Paper

Processing - Theme 3: Multi-modal Signal Fusion

Journal Papers

Renhe Liu, Yu Liu, Han Wang, Shan Du. "WaveFusionNet: Infrared and visible image fusion based on multi - scale feature encoder - decoder and discrete wavele decomposition," Optics Communications, Volume 573, 2024, https://doi.org/10.1016/j.optcom.2024.131024.

Journal Paper 1

H Wang, J Tang, Z Wu, Y Liu. "A multibeam steerable parametric array loudspeaker for distinct audio content directing," IEEE Sensors Journal 22 (13), 13640 - 13647.

Journal Paper 2

H Wang, X Liu, P Jing, Y Liu. "Airborne Ultrasound Haptics from Amplitude and Spatiotemporal Modulation of Acoustic Vortices," IEEE Sensors Letters.

Journal Paper 3

Computing - Theme 1: Customizable MCUs based on RISC-V

Journal Papers

[1] Yin Q, Li D, Wu Z, Liu Y, et al. "Design and implementation of RISC-V system-on-chip for SPWM generation based on FPGA," IEICE Electronics Express, 2024, 21(24): 20240603 - 20240603.

Journal Paper 1

唐钏,曾林,刘昱. "面向步进电机控制的 RISC-V 微控制器的设计与实现," Journal of Chongqing University, Vol. 44, No. 11, Nov. 2021, doi:10.11835/j.issn.1000 - 582X.2021.11.005.

Journal Paper 2

Conference Papers

唐钏, 白志华, 李德建,王于波, 刘昱. "面向 SM4 算法优化的指令集扩展方法与 SoC 实现," 第十五届全国信号和智能信息处理与应用学术会议论文集, p. 107.

Conference Paper

Computing - Theme 2: Hardware Co-Accelerators for AI Computing

Journal Papers

Yin, Xiaodi, Zhipeng Wu, Dejian Li, Chongfei Shen, and Yu Liu. "An efficient hardware accelerator for block sparse convolutional neural networks on fpga," IEEE Embedded Systems Letters, 2023.

Journal Paper 1

Lai, Ji, Lixin Yang, Dejian Li, Chongfei Shen, Xi Feng, Jizeng Wei, and Yu Liu. "Design and Optimization of Winograd Convolution on Array Accelerator," Journal of Beijing Institute of Technology, 32, no. 1 (2023): 69 - 81.

Journal Paper 2

Chen Y, Dejian L, Xi F, Yu Liu, et al. "Fast Fourier transform convolutional neural network accelerator based on overlap addition," The Journal of China Universities of Posts and Telecommunications, 2024, 31(05): 71 - 84. DOI: 10.19682/j.cnki.1005 - 8885.2024.0015.

Journal Paper 3

Conference Papers

Tianle M, Zhipeng W, Yu Liu et al. "FCCOA:a High - Performance FPGA - Based Accelerator for Approximate Nearest Neighbor Search," Accepted 2025 IEEE International Symposium on Circuits and Systems(ISCAS).

Conference Paper 1

Computing - Theme 3: Compilation Optimization for Heterogeneous Hardware Computing

Journal Papers

Wu, Zhipeng, Yue Hu, Ning Li, Wei Lu, and Yu Liu. "HiEval: A scheduling performance estimation approach for spatial accelerators via hierarchical abstraction," Journal of Systems Architecture, 148 (2024): 103079.

Journal Paper 1

Li, Ning, Dejian Li, Zhipeng Wu, Peiguang Jing, Sio Hang Pun, and Yu Liu. "SubMap: A Partial Mapping Strategy for CGRA Based on sub-CGRA Exploration," IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (2024).

Journal Paper 2

Conference Papers

Hu, Yue, Chongfei Shen, Lixin Yang, Zhipeng Wu, and Yu Liu. "A novel predictor with optimized sampling method for hardware-aware NAS," In 2022 26th International Conference on Pattern Recognition (ICPR), pp. 2114 - 2120. IEEE, 2022.

Conference Paper

System Design - Theme 1: Multi-modal Signal-Driven Diagnosis and Rehabilitation of Neurological Diseases

Journal Papers

Y Yin, H Wang, S Liu, J Sun, P Jing, Y Liu. "Internet of things for diagnosis of alzheimer’s disease: A multimodal machine learning approach based on eye movement features," IEEE Internet of Things Journal 10 (13), 11476 - 11485.

Journal Paper 1

F Zuo, P Jing, J Sun, J Duan, Y Ji, Y Liu. "Deep Learning - based Eye - Tracking Analysis for Diagnosis of Alzheimer's Disease Using 3D Comprehensive Visual Stimuli," IEEE Journal of Biomedical and Health Informatics.

Journal Paper 2

J Sun, Z Wu, H Wang, P Jing, Y Liu. "A novel integrated eye - tracking system with stereo stimuli for 3 - D gaze estimation," IEEE Transactions on Instrumentation and Measurement 72, 1 - 15.

Journal Paper 3

J Sun, Y Liu, H Wu, P Jing, Y Ji. "A novel deep learning approach for diagnosing Alzheimer's disease based on eye - tracking data," Frontiers in Human Neuroscience 16, 972773.

Journal Paper 4

System Design - Theme 2: AI Driven Digital Therapeutics for Nutritional Intervention

Journal Papers

H Jiang, H Wang, T Pan, Y Liu, P Jing, Y Liu. "Mobile Application and Machine Learning - Driven Scheme for Intelligent Diabetes Progression Analysis and Management Using Multiple Risk Factors," Bioengineering 11 (11), 1053.

Journal Paper 1

Y Liu, S Li, H Jiang, J Wang. "Exploring the relationship between hypertension and nutritional ingredients intake with machine learning," Healthcare Technology Letters 7 (4), 103 - 108.

Journal Paper 2

Conference Papers

Y Ru, H Jiang, H Song, B Wei, Y Liu. "DDIN: Enhancing Food Ingredient Recognition with Region and Category Discovery Modules," 2024 IEEE International Conference on Visual Communications and Image.

Conference Paper 1

System Design - Theme 3: Pedestrian Indoor Positioning Based on PDR

Journal Papers

B Chen, R Zhang, S Wang, L Zhang, Y Liu. "Deep - learning - based inertial odometry for pedestrian tracking using attention mechanism and res2net module," IEEE Sensors Letters 6 (11), 1 - 4.

Journal Paper 1

Y Liu, Q Gong, S Wang, L Zhang, F Xu. "An Outdoor Pedestrian Localization Scheme Fusing PDR and VPR," Wireless Communications and Mobile Computing 2022 (1), 2898343.

Journal Paper 2

L Zhang, B Chen, H Li, Y Liu. "Deep neural network‐based adaptive zero‐velocity detection for pedestrian navigation system," Electronics Letters 58 (1), 28 - 31.

Journal Paper 3

L Zhang, Y Liu, J Sun. "A hybrid framework for mitigating heading drift for a wearable pedestrian navigation system through adaptive fusion of inertial and magnetic measurements," Applied Sciences 11 (4), 1902.

Journal Paper 4

Y Liu, S Li, C Mu, Y Wang. "Step length estimation based on D‐ZUPT for pedestrian dead‐reckoning system," Electronics letters 52 (11), 923 - 924.

Journal Paper 5

Competition

"Pedestrian dead reckoning" RUNNER-UP," IEEE IPIN 2017 Indoor Localization Offline Competition, in Sapporo 2017.

Journal Paper 5