avatar

Shiyu Xuan

Associate Professor
School of Computer Science and Engineering
Nanjing University of Science and Technology, China

About Me

I am now an Associate Professor in School of Computer Science and Engineering of Nanjing University of Science and Technology, where I am a member of IMAG. I got my Ph.D. degree at Peking University under the supervision of Prof. Shiliang Zhang. Before that, I received a master's degree from the University of Chinese Academy of Sciences in 2020 and received a bachelor’s degree in School of Electronic Information and Communications at Huazhong University of Science and Technology (HUST) in 2017. My research interests include computer vision, and deep learning, focusing on multimodal learning, unsupervised learning, object tracking, domain adaptation, and domain generalization.

News

  • [2024. 09] I got 2024 CCF-Baidu Open Fund. Thanks for all.
  • [2024. 09] One paper related to multi-modal prompt learning was accepted by T-IP.
  • [2024. 05] One paper related to incremental learning was accepted by IJCV.
  • [2024. 05] I successfully defended my Ph.D. Thesis.
  • [2024. 03] One paper on multi-modal large language model was accepted by CVPR.
  • [2024. 03] My co-author's paper on human pose estimation was accepted by CVPR.
  • [2023. 12] After a tough time, one paper on long-tailed recognition was accepted by AAAI.
  • [2023. 12] My co-author's paper on long-tailed recognition was accepted by AAAI.
  • [2022. 06] I got the Peking University President Scholarship.
  • [2022. 05] The code of IIDS was released.
  • [2022. 03] The extended version of IICS was accepted by T-PAMI.
  • [2021. 06] I was invited to give a tutorial on person ReID on ICME2021.
  • [2021. 03] One paper on unsupervised person ReID was accepted by CVPR.
  • [2020. 10] One paper on long-term object tracking was accepted by Pattern Recognition.
  • [2020. 09] I started pursuing Ph.D at Peking University.
  • [2020. 06] I started an internship in SenseTime.
  • [2020. 06] I graduated from Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences.
  • [2019. 07] I achieved 5th place (Overall) and 2nd place (Long-term tracking) in Single Object Tracking, VisDrone Challenge, ICCVW.
  • [2019. 05] I achieved 1st place in test set of OxUvA long-term tracking dataset.
  • [2019. 04] One paper on object tracking in satellite video was accepted by TGRS.

Publications

  • Xuan, S., Yang M, & Zhang, S. Adapting Vision-Language Models via Learning to Inject Knowledge. IEEE Transactions on Image Processing (2024). [Paper]
  • Xuan, S., Yang M, & Zhang, S. Incremental Model Enhancement via Memory-based Contrastive Learning. International Journal of Computer Vision (2024). [Paper]
  • Xuan, S., Guo, Q, Yang M, & Zhang, S. Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2024). [Paper], [Code]
  • Xuan, S., & Zhang, S. Decoupled Contrastive Learning for Long-Tailed Recognition. Proceedings of the AAAI Conference on Artificial Intelligence (2024). [Paper], [Code]
  • Xuan, S., & Zhang, S. Intra-Inter Domain Similarity for Unsupervised Person Re-Identification. IEEE Transactions on Pattern Analysis and Machine Intelligence. [Paper], [Code]
  • Xuan, S., & Zhang, S. Intra-Inter Camera Similarity for Unsupervised Person Re-Identification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2021). [Paper], [Code]
  • Xuan S, Li S, Zhao Z, et al. Siamese networks with distractor-reduction method for long-term visual object tracking. Pattern Recognition. [Paper]
  • Xuan S, Li S, Han M, et al. Object tracking in satellite videos by improved correlation filters with motion estimations. IEEE Transactions on Geoscience and Remote Sensing. [Paper], [Code]
  • Xuan, S, Li S, Zhao Z, et al. Rotation adaptive correlation filter for moving object tracking in satellite videos. Neurocomputing. [Paper]
  • Wang, D., Xuan, S., & Zhang, S. LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2024). [Paper], [Code]
  • Cong, C., Xuan, S., Liu, S., Zhang, S., Pagnucco, M., & Song, Y. Decoupled Optimisation for Long-tailed Visual Recognition. Proceedings of the AAAI Conference on Artificial Intelligence (2024). [Paper]

Professional Activities

  • Journal Reviewer of ISPRS, TMM, TIP, TNNLS, TCSVT, TGRS, ToMM, CVIU, GRSL, KBS.
  • Conference Reviewer of ICCV, ECCV, CVPR, AAAI, ACM MM.