🚀 Open for Internship Opportunities and Collaboration

About Me

I am Renjie Liang, a Ph.D. student at the University of Florida (UF), where I serve as a research assistant in the Health Outcomes & Biomedical Informatics (HOBI) department. My research interests focus on medical image report generation using Large Language Models (LLMs), particularly for 3D CT images. My recent work includes compressing 3D CT visual tokens (ORCA), forecasting encoder performance with a lightweight probe (CheapCT), retrieval-augmented report generation (AdaRAG-CT), contrastive decoding that makes a report generator state what it has detected (SelfCue), and an agent with a learnable rule memory that revises each section of a generated report. My goal is to develop amazing models with real-world data to reduce the tedious workload for medical scripting and improve its quality. Eventually, I hope to contribute to the advancement of medical report generation and improve healthcare outcomes for humanity.

Publications

please refer to google scholar page to check all my publications. (* Equal Contribution)

SelfCue: Making a 3D CT Report Generator Say What It Already Knows
Renjie Liang, Yang Yang, Jinqian Pan, Zhengkang Fan, Chengkun Sun, Jie Xu
arXiv 2026  
ORCA: ORgan-Centroid Aggregation for Training-Free 3D CT Visual Token Compression
Renjie Liang, Zijian Xu, Jinqian Pan, Chengkun Sun, Zhengkang Fan, Shawn Li, You Qin, Mei Liu, Jie Xu
arXiv 2026  
When Do Cheap Probes Predict Expensive Training? Probing 3D-CT Encoders for Text Generation
Renjie Liang, Zijian Xu, Jinqian Pan, Chengkun Sun, Zhengkang Fan, Shawn Li, You Qin, Mei Liu, Jie Xu
arXiv 2026  
Multi-Granularity 3D Kidney Lesion Characterization from CT Volumes
Renjie Liang, Zhengkang Fan, Jinqian Pan, Chenkun Sun, Jiang Bian, Russell Terry, Jie Xu
arXiv 2026, submitted to Medical Image Analysis  
Beyond the Embedding Bottleneck: Adaptive Retrieval-Augmented 3D CT Report Generation
Renjie Liang, Yiling Ma, Yang Xing, Zhengkang Fan, Jinqian Pan, Chengkun Sun, Li Li, Kuang Gong, Jie Xu
arXiv 2026  
TVR-Ranking: A Dataset for Ranked Video Moment Retrieval with Imprecise Queries
Renjie Liang, Li Li, Chongzhi Zhang, Jing Wang, Xizhou Zhu, Aixin Sun
ACM SIGIR-AP 2025  
Secure On-Device Video OOD Detection Without Backpropagation
Shawn Li, Peilin Cai, Yuxiao Zhou, Zhiyu Ni, Renjie Liang, You Qin, Yi Nian, Zhengzhong Tu, Xiyang Hu, Yue Zhao
ICCV 2025  
A Clinically-Grounded Two-Stage Framework for Renal CT Report Generation
Renjie Liang, Zhengkang Fan, Jinqian Pan, Chenkun Sun, Bruce Daniel Steinberg, Russell Terry, Jie Xu
arXiv 2025  
Efficient Temporal Sentence Grounding in Videos with Multi-Teacher Knowledge Distillation
Renjie Liang , Yiming Yang, Hui Lu, Li Li
arXiv 2023  
Partial Annotation-based Video Moment Retrieval via Iterative Learning
Wei Ji, Renjie Liang, Lizi Liao, Hao Fei, Fuli Feng
ACM MM 2023  
Are Binary Annotations Sufficient? Video Moment Retrieval via Hierarchical Uncertainty-based Active Learning
Wei Ji, Renjie Liang, Zhedong Zheng, Wenqiao Zhang, Shengyu Zhang, Juncheng Li, Mengze Li, Tat-Seng Chua
CVPR 2023  

Work Experiences

2024. Aug - Present
Research Assistant, HOBI, University of Florida
Prof. Jie Xu


2023. Apr - 2024. Aug
Research Associate, S-Lab, Nanyang Technological University
Prof. Aixin Sun


2022. Feb - 2023. Apr
Research Intern, NExT++, National University of Singapore
Prof. Tat-Seng Chua and Postdoc Wei Ji


2020. Oct - 2021. Dec
Engineer, Bytedance

Education

2024. Aug - Present
Doctor of Philosophy in Biomedical Informatics
University of Florida, USA


2018. Sep - 2020. Jun
Master of Engineering in Computer Science
Sun Yat-sen University, China


2013. Sep - 2017. Jun
Bachelor of Engineering in Mining Engineering
Central South University, China