SJTU Deng Lab is affiliated with Qing Yuan Research Institute, Shanghai Jiao Tong University, working on pioneering novel methods and theories that enhance the efficiency, efficacy, reliability, and trustworthiness of machine learning approaches, especially for generative AI. Our members conduct comprehensive research across the entire machine learning cycle, encompassing data, methods, models, and evaluation.

Current research interests focus on:

  • Model efficiency

    • Inference acceleration for large language and diffusion models
    • Novel methods and architectures for generative modeling
  • Data efficiency

    • Data selection, active learning, and data difficulty quantification
    • Deep spectral methods
  • Modality efficiency

    • Unified modeling methods, learning principles, and architectures for texts, images, videos, and beyond
    • Applications of efficient world models in Embodied AI

News

09/2024: Amortized Fourier Neural Operators is accepted to NeurIPS! 🎉
09/2024: AdaMOE is accepted to EMNLP Findings! 🎉
08/2024: Calibrating Deep Ensemble through Functional Variational Inference is accepted to TMLR! 🎉
08/2024: Accurate and Reliable Forecasting using Stochastic Differential Equations is accepted to TKDD! 🎉
07/2024: Lost in Translation: Latent Concept Misalignment in Text-to-Image Diffusion Models is accepted to ECCV 2024! 🎉
05/2024: Efficient Detection of LLM-generated Texts with a Bayesian Surrogate Model is accepted to ACL Findings! 🎉
05/2024: Four papers are accepted to ICML 24! Check out: OSD, Othogonal attention, CLLMs, and Spiking transformer. 🎉
02/2024: Bayesian Exploration of Pre-trained Models for Low-shot Image Classification is accepted to CVPR 24! 🎉
01/2024: BayesDiff is accepted to ICLR 24! 🎉
09/2023: Three papers are accepted to NeurIPS 23! Check out: Bayesian Data Selection, Learning Sample Difficulty from Pre-trained Models for Reliable Prediction, and CalibratedDPMs. 🎉
07/2023: Learning Neural Eigenfunctions for Unsupervised Semantic Segmentation is accepted to ICCV 23! 🎉

     

Sponsors and Collaborators