Vision and Learning Lab (ViL) at Clemson University

2024

3DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors

Xi Liu*, Chaoyi Zhou*, Siyu Huang

NeurIPS, 2024 (Spotlight)

Project Website | PDF | Code

Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptation

Lanqing Guo, Yingqing He, Haoxin Chen, Menghan Xia, Xiaodong Cun, Yufei Wang, Siyu Huang, Yong Zhang, Xintao Wang, Qifeng Chen, Ying Shan, Bihan Wen

ECCV, 2024

Project Website | PDF | Code

Fundus2Video: Cross-Modal Angiography Video Generation from Static Fundus Photography with Clinical Knowledge Guidance

Weiyi Zhang, Siyu Huang, Jiancheng Yang, Ruoyu Chen, Zongyuan Ge, Yingfeng Zheng, Danli Shi, Mingguang He

MICCAI, 2024

MTPret: Improving X-ray Image Analytics with Multi-Task Pre-training

Weibin Liao, Qingzhong Wang, Xuhong Li, Yi Liu, Zeyu Chen, Siyu Huang, Dejing Dou, Yanwu Xu, Haoyi Xiong

IEEE Transactions on Artificial Intelligence (TAI), 2024

Learning Gaze-aware Compositional GAN from Limited Annotations

Nerea Aranjuelo Ansa, Siyu Huang, Ignacio Arganda-Carreras, Luis Unzueta Irurtia, Oihana Otaegui Madurga, Hanspeter Pfister, Donglai Wei

ACM Symposium of Eye Tracking Research & Applications (ETRA), 2024

PDF | Code

S3-TTA: Scale-Style Selection for Test-Time Augmentation in Biomedical Image Segmentation

Kangxian Xie, Siyu Huang, Sebastian Andres Cajas Ordonez, Hanspeter Pfister, Donglai Wei

IEEE International Symposium on Biomedical Imaging (ISBI), 2024

PDF | Code

2023

Towards Robust Image Denoising via Flow-based Joint Image and Noise Model

Lanqing Guo, Siyu Huang, Haosen Liu, and Bihan Wen

IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2023

PDF

ContRE: A Complementary Measure for Robustness Evaluation of Deep Networks via Contrastive Examples

Xuhong Li, Xuanyu Wu, Linghe Kong, Xiao Zhang, Siyu Huang, Dejing Dou, and Haoyi Xiong

IEEE International Conference on Data Mining (ICDM), 2023

PDF

Domain-Scalable Unpaired Image Translation via Latent Space Anchoring

Siyu Huang*, Jie An*, Donglai Wei, Zudi Lin, Jiebo Luo, Hanspeter Pfister

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

PDF | Code

3D Domain Adaptive Instance Segmentation via Cyclic Segmentation GANs

Leander Lauenburg, Zudi Lin, Ruihan Zhang, Marcia dos Santos, Siyu Huang, Ignacio Arganda-Carreras, Edward S. Boyden, Hanspeter Pfister, Donglai Wei

IEEE Journal of Biomedical and Health Informatics (JBHI), 2023

PDF | Project | Code | Dataset

QuantArt: Quantizing Image Style Transfer Towards High Visual Fidelity

Siyu Huang*, Jie An*, Donglai Wei, Jiebo Luo, Hanspeter Pfister

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023

PDF | Slides | Code

ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removal

Lanqing Guo, Chong Wang, Wenhan Yang, Siyu Huang, Yufei Wang, Hanspeter Pfister, Bihan Wen

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023

PDF | Code

Making Your First Choice: To Address Cold Start Problem in Vision Active Learning

Liangyu Chen, Yutong Bai, Siyu Huang, Yongyi Lu, Bihan Wen, Alan Yuille, Zongwei Zhou

Medical Imaging with Deep Learning (MIDL), 2023

PDF | Code

Cross-Model Consensus of Explanations and Beyond for Image Classification Models: An Empirical Study

Xuhong Li, Haoyi Xiong, Siyu Huang, Shilei Ji, Dejing Dou

Machine Learning, European Conference on Machine Learning 2022 journal track (MLJ), 2023

PDF | Code

ShadowFormer: Global Context Helps Shadow Removal

Lanqing Guo, Siyu Huang, Ding Liu, Hao Cheng, Bihan Wen

AAAI Conference on Artificial Intelligence (AAAI), 2023

PDF | Code

2022

Temporal Output Discrepancy for Loss Estimation-based Active Learning

Siyu Huang, Tianyang Wang, Haoyi Xiong, Bihan Wen, Jun Huan, Dejing Dou

IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022

PDF | Code

MUSCLE: Multi-task Self-supervised Continual Learning to Pre-train Deep Models for X-ray Images of Multiple Body Parts

Weibin Liao, Haoyi Xiong, Qingzhong Wang, Yan Mo, Xuhong Li, Yi Liu, Zeyu Chen, Siyu Huang, Dejing Dou

Medical Image Computing and Computer Assisted Intervention (MICCAI), 2022

PDF

A Unified Framework for Bidirectional Prototype Learning from Contaminated Faces across Heterogeneous Domains

Meng Pang, Binghui Wang, Siyu Huang, Yiu-ming Cheung, Bihan Wen

IEEE Transactions on Information Forensics and Security (TIFS), 2022

PDF | Code

Parameter-Free Style Projection for Arbitrary Style Transfer

Siyu Huang, Haoyi Xiong, Tianyang Wang, Bihan Wen, Qingzhong Wang, Zeyu Chen, Jun Huan, Dejing Dou

International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2022

PDF | Code | Official PaddleHub

BM-NAS: Bilevel Multimodal Neural Architecture Search

Yihang Yin, Siyu Huang, Xiang Zhang

AAAI Conference on Artificial Intelligence (AAAI), 2022 (Oral)

PDF | Video | Code

AutoGCL: Automated Graph Contrastive Learning via Learnable View Generators

Yihang Yin, Qingzhong Wang, Siyu Huang, Haoyi Xiong, Xiang Zhang

AAAI Conference on Artificial Intelligence (AAAI), 2022

PDF | Video | Code

Boosting Active Learning via Improving Test Performance

Tianyang Wang, Xingjian Li, Pengkun Yang, Guosheng Hu, Xiangrui Zeng, Siyu Huang, Cheng-Zhong Xu, Min Xu

AAAI Conference on Artificial Intelligence (AAAI), 2022

PDF | Code

2021

Semi-Supervised Active Learning with Temporal Output Discrepancy

Siyu Huang, Tianyang Wang, Haoyi Xiong, Jun Huan, Dejing Dou

International Conference on Computer Vision (ICCV), 2021

ReLLIE: Deep Reinforcement Learning for Customized Low-Light Image Enhancement

Rongkai Zhang, Lanqing Guo, Siyu Huang, Bihan Wen

ACM International Conference on Multimedia (ACM MM), 2021

PDF | Code

An Investigation of Containment Measure Implementation and Public Responses to the COVID-19 Pandemic in Mainland China

Ji Liu, Haoyi Xiong, Xiakai Wang, Jizhou Huang, Qiaojun Li, Tongtong Huang, Siyu Huang, Haifeng Wang, Dejing Dou

IEEE International Conference on Digital Health (ICDH), 2021

PDF

ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flows

Jie An*, Siyu Huang*, Yibing Song, Dejing Dou, Wei Liu, Jiebo Luo

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021

PDF | Supp | Code

2020 and earlier

Dual Low-Rank Multimodal Fusion

Tao Jin*, Siyu Huang*, Yingming Li, Zhongfei Zhang

Findings of the Association for Computational Linguistics: EMNLP (EMNLP Findings), 2020

PDF

Neighbours Matter: Image Captioning with Similar Images

Qingzhong Wang, Jiuniu Wang, Antoni Chan, Siyu Huang, Haoyi Xiong, Xingjian Li, Dejing Dou

British Machine Vision Conference (BMVC), 2020

PDF

Generating Person Images with Appearance-aware Pose Stylizer

Siyu Huang, Haoyi Xiong, Zhi-Qi Cheng, Qingzhong Wang, Xingran Zhou, Bihan Wen, Jun Huan, Dejing Dou

International Joint Conference on Artificial Intelligence (IJCAI), 2020

PDF | Code

SBAT: Video Captioning with Sparse Boundary-Aware Transformer

Tao Jin, Siyu Huang, Ming Chen, Yingming Li, Zhongfei Zhang

International Joint Conference on Artificial Intelligence (IJCAI), 2020

PDF

Stacked Pooling for Boosting Scale Invariance of Crowd Counting

Siyu Huang, Xi Li, Zhi-Qi Cheng, Zhongfei Zhang, Alexander Hauptmann

International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020

PDF | Code

Low-Rank HOCA: Efficient High-Order Cross-Modal Attention for Video Captioning

Tao Jin, Siyu Huang*, Yingming Li, Zhongfei Zhang

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2019

PDF

Text Guided Person Image Synthesis

Xingran Zhou, Siyu Huang*, Bin Li, Yingming Li, Jiachen Li, Zhongfei Zhang

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019

PDF | Supp

User-Ranking Video Summarization with Multi-Stage Spatio-Temporal Representation

Siyu Huang, Xi Li, Zhongfei Zhang, Fei Wu, Junwei Han

IEEE Transactions on Image Processing (TIP), 2019

PDF | Demo

Perceiving Physical Equation by Observing Visual Scenarios

Siyu Huang*, Zhi-Qi Cheng*, Xi Li, Xiao Wu, Zhongfei Zhang, Alexander Hauptmann

NeurIPS Workshop on Modeling the Physical World, 2018

PDF

TVT: Two-View Transformer Network for Video Captioning

Ming Chen, Yingming Li, Zhongfei Zhang, Siyu Huang

Asian Conference on Machine Learning (ACML), 2018

PDF

GNAS: A Greedy Neural Architecture Search Method for Multi-Attribute Learning

Siyu Huang, Xi Li, Zhi-Qi Cheng, Zhongfei Zhang, Alexander Hauptmann

ACM International Conference on Multimedia (ACM MM), 2018 (Oral)

PDF | Slides | Poster

Learning to Transfer: Generalizable Attribute Learning with Multitask Neural Model Search

Zhi-Qi Cheng, Xiao Wu, Siyu Huang, Jun-Xiu Li, Alexander Hauptmann, Qiang Peng

ACM International Conference on Multimedia (ACM MM), 2018

PDF

Body Structure Aware Deep Crowd Counting

Siyu Huang, Xi Li, Zhongfei Zhang, Fei Wu, Shenghua Gao, Rongrong Ji, Junwei Han

IEEE Transactions on Image Processing (TIP), 2018

PDF | Demo

Deep Learning Driven Visual Path Prediction From a Single Image

Siyu Huang, Xi Li, Zhongfei Zhang, Zhouzhou He, Fei Wu, Wei Liu, Jinhui Tang, Yueting Zhuang

IEEE Transactions on Image Processing (TIP), 2016 (Oral)

PDF | Dataset