Original Works

Publications

• Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learning.

  Colorado Reed*, Shufan Li*, Ritwik Gupta*, Sarah Brockman, Christopher Funk, Brian Clipp, Kurt Keutzer, Salvatore Candido, Matt Uyttendaele, Trevor Darrell

  [Arxiv]. ICCV 2023. (Oral)

  Scale-Aware representation learning with prior information of image scale.
• Hierarchical Open-vocabulary Universal Image Segmentation.

  Xudong Wang*, Shufan Li*, Konstantinos Kallidromitis*, Yusuke Kato, Kazuki Kozuka, Trevor Darrell

  [Arxiv]. NeurIPS 2023.

  Segmentating arbritrary objects and object parts using text prompts
• xT: Nested Tokenization for Larger Context in Large Images .

  Ritwik Gupta*, Shufan Li*, Tyler Zhu*, Jitendra Malik, Trevor Darrell, Karttikeya Mangalam

  [Arxiv]. ICML 2024.

  Long context visual perception on large images.
• Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data.

  Shufan Li*, Harkanwar Singh, Aditya Grover

  [Arxiv]. ECCV 2024 (Oral)

  Modeling multi-dimensional data with linear complexity.
• Aligning Diffusion Models by Optimizing Human Utility.

  Shufan Li*, Konstantinos Kallidromitis, Akash Gokul, Yusuke Kato, Kazuki Kozukar

  [Arxiv] NeurIPS 2024

  Aligning text-to-image models with human feedback.

Preprints

• PopAlign: Population-Level Alignment for Fair Text-to-Image Generation

  Shufan Li*, Harkanwar Singh, Aditya Grover

  [preprint]. 2024.

  Aligning Diffusion Model For Fairness
• SegLLM: Multi-round Reasoning Segmentation

  XuDong Wang*, Shaolun Zhang*, Shufan Li*, Konstantinos Kallidromitis, Kehan Li, Yusuke Kato, Kazuki Kozuka, Trevor Darrell

  [preprint]. 2024.

  Multi-round interactive Segmention using Large Language Model
• InstructAny2Pix: Flexible Visual Editing via Multimodal Instruction Following.

  Shufan Li*, Harkanwar Singh, Aditya Grover

  [Arxiv]. [Project Page]

  Image editing following multi-modal instructions.
• Refine and Represent: Region-to-Object Representation Learning

  Akash Gokul*, Konstantinos Kallidromitis*, Shufan Li*, Yusuke Kato, Kazuki Kozuka, Trevor Darrell, Colorado J Reed

  [preprint]. 2022.

  Representation learning benefits by first learning from image regions and then learning from actual objects.

Technical Reports

• Interpreting Audiograms with Multi-stage Neural Networks

  Shufan Li*, Congxi Lu, Linkai Li,Jirong Duan, Xinping Fu, Haoshuai Zhou

  [Arxiv]. 2021.

  Accelerate Hearing Aid Fitting using Computer Vision
• Chart-RCNN: Efficient Line Chart Data Extraction from Camera Images

  Shufan Li*, Congxi Lu, Linkai Li, Haoshuai Zhou

  [preprint]. 2022.

  Line Chart Data Extraction in the wild.