Xu Sun (Pronunciation of Xu: shoo[ʃuː])   Associate Professor Director of Language Computing and Machine Learning Group, Department of Computer Science, Peking University Email：xusun (AT) pku.edu.cn       Github     Google Scholar     Brief Bio: Xu Sun is Associate Professor (with tenure) in Department of Computer Science, Peking University. He got Ph.D from The University of Tokyo (2010), advised by Prof. Jun'ichi Tsujii. From 2010 to 2012, he worked at The University of Tokyo, Cornell University, and The Hong Kong Polytechnic University as research fellows. He has been a research intern at MSR-Redmond in 2009. His research focuses on natural language processing and machine learning, especially on natural language generation and deep learning for language. He received COLING Best Paper Award 2018.

中文简介

Our Research Group

• Language Computing and Machine Learning Group

Research Interests

• Natural language generation (how to generate meaningful texts given conditions)


• Deep learning for NLP (theory and methods of DNN for NLP problems)


• Multi-modal NLP (especially on vision-language problems)


• Knowledge extraction (how to extract knowledge for language understanding)

Our Github Tools

• AdaBound (An optimizer that trains as fast as Adam and as good as SGD, ICLR 2019)
• pkuseg (A multi-domain Chinese word segmentation toolkit，arXiv 2019)

Publications

• Paper list


• Selected papers


• Prophet Attention: Predicting Attention with Future Attention for Improved Image Captioning F.Liu, X.Ren, X.Wu, S.Ge, W.Fan, Y.Zou, X.Sun
  In Proceedings of the Thirty-Fourth Annual Conference on Neural Information Processing Systems (NeurIPS), 2020
  
  
• Exploring the Vulnerability of Deep Neural Networks: A Study of Parameter Corruption X.Sun^#, Z.Zhang^#, X.Ren, R.Luo, L.Li
  
  
• Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological View D.Chen, Y.Lin, W.Li, P.Li, J.Zhou, X.Sun
  The Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI), 2020
  
  
• Understanding and Improving Layer Normalization. J.Xu, X.Sun, Z.Zhang, G.Zhao, J.Lin.
  In Proceedings of the Thirty-Third Annual Conference on Neural Information Processing Systems (NeurIPS), 2019
  
  
• Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations. F.Liu^#, Y.Liu^#, X.Ren^#, X.He, K.Lei, X.Sun.
  In Proceedings of the Thirty-Second Annual Conference on Neural Information Processing Systems (NeurIPS), 2019
  
  
• Adaptive Gradient Methods with Dynamic Bound of Learning Rate. L.Luo^#, Y.Xiong^#, Y.Liu, X.Sun.
  In Proceedings of the International Conference on Learning Representations (ICLR), 2019
  
  
• Global Encoding for Abstractive Summarization. J.Lin, X.Sun, S.Ma, Q.Su.
  In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2018
  
  
• Unpaired Sentiment-to-Sentiment Translation: A Cycled Reinforcement Learning Approach. J.Xu, X.Sun,Q.Zeng, X.Zhang, X.Ren, H.Wang, W.Li.
  In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2018
  
  
• DP-GAN: A Diversity-Promoting Generative Adversarial Network for Generating Informative and Diversified Text. J.Xu, X.Ren, J.Lin, X.Sun.
  In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2018
  
  
• SGM: Sequence Generation Model for Multi-label Classification. P.Yang, X.Sun, W.Li, S.Ma, W.Wu, H.Wang.
  The 27th International Conference on Computational Linguistics (COLING), 2018
  
  
• meProp: Sparsified Back Propagation for Accelerated Deep Learning with Reduced Overfitting. X.Sun, X.Ren, S.Ma, H.Wang.
  The Thirty-fourth International Conference on Machine Learning (ICML), 2017
  
  

Awards

• COLING 2018 Best Paper Award, 2018


• Distinguished Senior Program Committee Member, IJCAI 2018


• 1st Rank Prize, Science and Technology Prize of CIE (Chinese Institute of Electronics), 2018 (中国电子学会科学技术奖一等奖)


• Architecture Innovation Award, JD Dialogue Challenge, 2018


• CCF NLPCC Distinguished Young Scientist Award, 2018


• Okawa Research Award, Japan, 2017


• Qiu Shi Outstanding Young Scholar Award (求是杰出青年学者奖), Qiu Shi Foundation, 2015

Academic Activities

• Senior Area Chair(SAC) / Area Chair(AC) / Senior Program Committee (SPC): ACL 2021(SAC), EMNLP 2020(AC), EMNLP 2015(AC), AAAI 2020(SPC), IJCAI 2020(SPC), IJCAI 2018(SPC), NLPCC 2018(AC), IJCNLP 2017(AC), YCCL 2012(AC)


• Associate Editor: International Journal of Asian Language Prcoessing, COLIPS


• Standing Review Committee： TACL


• Tutorial Co-chair: CCL 2017


• Student Workshop Co-chair: NLPCC 2017


• Program committee member: ACL, ICML, NIPS, IJCAI, AAAI, EMNLP, COLING, NAACL, ACML, PAKDD, CCL, NLPCC, LREC


• Journal reviewer: IEEE TPAMI, IEEE TNNLS, IEEE TKDE, Computational Linguistics, TACL, IEEE TASLP, Information Processing and Management, ACM TALIP, KAIS

Work Experience

• Tenured Associate Professor and PhD Supervisor, Peking University, 2019-now


• Tenure-Track Faculty and PhD Supervisor, Peking University, 2012-2018


• Researcher, The Hong Kong Polytechnic University, 2012


• Researcher, Cornell University, 2011


• Researcher, The University of Tokyo, 2010 - 2011

Students

Teaching

Patents