Haoyu Dong

haoyudong.jpg

Email:haoyu (dot) dong151 (at) duke (dot) edu

I am a 3rd year Ph.D. student at Duke University, working on AI + Healthcare. I am fortunate to be advised by Prof. Maciej A. Mazurowski.

I am interested in several research topics, including foundation models, image harmonization, anomaly detection, and multi-modal learning. See my Research Topics Bar for details.

Before starting my Ph.D., I got my master degree from Duke University, majoring in Computer Science, supervised by Prof. Guillermo Sapiro. Before that, I did double major in Compute Science and Cognitive Science from UC San Diego, where I worked with Prof. Zhuowen Tu.

See my Google Scholar page for a full list of my publications, with a few recent papers highlighted in the section below.

News

Oct 03, 2024 We have One Paper on Image Generation with mask guidance accepted at MICCAI 2024!
Sep 24, 2024 We have One Paper on LLM Agent for medical images accepted at EMNLP!
Aug 01, 2024 We have One paper on Evaluation of SAM2 on medical images out on Arxiv!
Apr 11, 2024 We have One paper on Test-time Adapation accpeted at CVPR Workshop (Oral)!
Sep 05, 2023 We have One Paper on Anomaly Detection accepted at IEEE Trans. on Medical Imaging!
Jul 31, 2023 We have One Paper on Evaluation of SAM accepted at Medical Image Analysis!
Jun 20, 2023 We have One paper on Medical Report Generation accpeted at ICML Workshop, IMLH!
May 03, 2023 We have One Paper on Anomaly Localization in Breast Scans accepted at Medical Image Analysis!

Selected publications

* indicates equal contribution.

  1. ft_sam
    How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Model
    Hanxue Gu*, Haoyu Dong*, Jichen Yang, and Maciej A Mazurowski
    arXiv preprint arXiv:2404.09957, 2024
  2. medagent
    MMedAgent: Learning to Use Medical Tools with Multi-modal Agent
    Binxu Li, Tiankai Yan, Yuanting Pan, Jie Luo, Ruiyang Ji, Jiayuan Ding, Zhe Xu, Shilong Liu, Haoyu Dong*, Zihao Lin*, and Yixin Wang*
    In EMNLP, 2024
  3. tta2
    Medical Image Segmentation with InTEnt: Integrated Entropy Weighting for Single Image Test-Time Adaptation
    Haoyu Dong, Nicholas Konz, Hanxue Gu, and Maciej A Mazurowski
    In DEF-AI_MIA @ CVPR (Oral), 2024
    arXiv
  4. sam_eval2
    Segment anything model for medical image analysis: an experimental study
    Maciej A Mazurowski, Haoyu Dong, Hanxue Gu, Jichen Yang, Nicholas Konz, and Yixin Zhang
    Medical Image Analysis, 2023
    arXiv
  5. swssl2
    SWSSL: Sliding window-based self-supervised learning for anomaly detection in high-resolution images
    Haoyu Dong, Yifan Zhang, Hanxue Gu, Nicholas Konz, Yixin Zhang, and Maciej A Mazurowski
    IEEE Transactions on Medical Imaging, 2023