Kai Chen

Research Scientist & Head of Large Model Center, Shanghai AI Laboratory

prof_pic.jpg

I am leading a group of talented researchers and engineers to develop LLMs/VLMs, as well as build impactful open-source projects. Some projects led by me include: InternLM, OpenCompass, OpenMMLab, OpenXLab.

Before joining Shanghai AI Lab, I was a director at SenseTime and led R&D teams for computer vision. I received the PhD in 2019 degree at MMLab, The Chinese University of Hong Kong, under the supervision of Prof. Dahua Lin and Chen Change Loy. Prior to that, I received the B.Eng. degree from Tsinghua University in 2015.

We have opening positions for full-time employees, interns, joint PhDs (with THU/SJTU/FDU/ZJU/USTC, etc).

news

Sep 26, 2024 7 papers accepted to NeurIPS 2024 and 4 papers accepted to NeurIPS 2024 Datasets and Benchmarks Track.
Sep 20, 2024 3 papers (1 main + 2 findings) accepted to EMNLP 2024.
Jul 01, 2024 6 papers accepted to ECCV 2024.
May 16, 2024 5 papers (2 main + 3 findings) accepted to ACL 2024.
May 02, 2024 2 papers accepted to ICML 2024.

selected publications

  1. 2024_ANAH.png
    ANAH: Analytical Annotation of Hallucinations in Large Language Models
    Ziwei Ji, Yuzhe Gu, Wenwei Zhang, and 3 more authors
    In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2024
  2. 2024_TEval.png
    T-Eval: Evaluating the Tool Utilization Capability of Large Language Models Step by Step
    Zehui Chen, Weihua Du, Wenwei Zhang, and 8 more authors
    In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2024
  3. 2024_AgentFLAN.png
    Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models
    Zehui Chen, Kuikun Liu, Qiuchen Wang, and 5 more authors
    In Findings of the Association for Computational Linguistics: ACL, 2024
  4. 2024_MathBench.png
    MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmark
    Hongwei Liu, Zilong Zheng, Yuxuan Qiao, and 7 more authors
    In Findings of the Association for Computational Linguistics: ACL, 2024
  5. 2024_PIA.gif
    PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Models
    Yiming Zhang, Zhening Xing, Yanhong Zeng, and 2 more authors
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024
  6. 2023_RIFormer.png
    RIFormer: Keep Your Vision Backbone Effective But Removing Token Mixer
    Jiahao Wang, Songyang Zhang, Yong Liu, and 6 more authors
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023
  7. 2023_DDQ.png
    Dense Distinct Query for End-to-End Object Detection
    Shilong Zhang, Jiaqi Wang, Jiangmiao Pang, and 4 more authors
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023
  8. 2022_GroupRCNN.png
    Group R-CNN for Weakly Semi-supervised Object Detection with Points
    Shilong Zhang, Zhuoran Yu, Liyang Liu, and 3 more authors
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
  9. 2022_mmrotate.png
    MMRotate: A Rotated Object Detection Benchmark Using PyTorch
    Yue Zhou, Xue Yang, Gefan Zhang, and 9 more authors
    In Proceedings of the 30th ACM International Conference on Multimedia, 2022
  10. 2021_KNet.png
    K-Net: Towards Unified Image Segmentation
    Wenwei Zhang, Jiangmiao Pang, Kai Chen, and 1 more author
    Advances in Neural Information Processing Systems (NeurIPS), 2021
  11. 2021_TRoI.png
    Temporal ROI Align for Video Object Recognition
    Tao Gong, Kai Chen, Xinjiang Wang, and 5 more authors
    In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2021
  12. cvpr2019_libra_rcnn.png
    Towards Balanced Learning for Instance Recognition
    Jiangmiao Pang, Kai Chen, Qi Li, and 5 more authors
    International Journal of Computer Vision (IJCV), 2021
  13. 2020_CARAFE++.png
    CARAFE++: Unified Content-Aware ReAssembly of FEatures
    Jiaqi Wang, Kai Chen, Rui Xu, and 3 more authors
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021
  14. 2020_FPG.png
    Feature Pyramid Grids
    Kai Chen, Yuhang Cao, Chen Change Loy, and 2 more authors
    arXiv preprint arXiv:2004.03580, 2020
  15. cvpr2019_libra_rcnn.png
    Libra R-CNN: Towards Balanced Learning for Object Detection
    Jiangmiao Pang, Kai Chen, Jianping Shi, and 3 more authors
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
  16. cvpr2019_guided_anchoring.png
    Region Proposal by Guided Anchoring
    Jiaqi Wang*Kai Chen*, Shuo Yang, and 2 more authors
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
  17. cvpr2019_HTC.png
    Hybrid task cascade for instance segmentation
    Kai Chen, Jiangmiao Pang, Jiaqi Wang, and 9 more authors
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
  18. mmdetection.png
    MMDetection: Open MMLab Detection Toolbox and Benchmark
    Kai Chen, Jiaqi Wang*, Jiangmiao Pang*, and 22 more authors
    arXiv preprint arXiv:1906.07155, 2019
  19. iccv2019_CARAFE.png
    CARAFE: Content-Aware ReAssembly of FEatures
    Jiaqi Wang, Kai Chen, Rui Xu, and 3 more authors
    In Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2019
  20. cvpr2020_PISA.png
    Prime sample attention in object detection
    Yuhang Cao, Kai Chen, Chen Change Loy, and 1 more author
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020
  21. cvpr2018_ST-Lattice.png
    Optimizing Video Object Detection via a Scale-Time Lattice
    Kai Chen, Jiaqi Wang, Shuo Yang, and 4 more authors
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
  22. cvpr2017_documentary.png
    Discover and Learn New Objects from Documentaries
    Kai Chen, Hang Song, Chen Change Loy, and 1 more author
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017