Bing Liu (刘冰) Tech Lead, ML & NLP Facebook AI San Francisco Bay Area Ph.D. Carnegie Mellon University Email: hadoopit [at] gmail dot com [Publications] [Work Experiences] [Education] [Awards] [CV] My Github @hadoopit

I am a Research Scientist at Facebook AI, working on machine learning for spoken language processing, natural language understanding, and dialog systems. I build large scale conversational AI systems that can learn continuously from user interactions with little human supervision via deep and reinforcement learning.

I hold a Ph.D. degree from the Department of Electrical and Computer Engineering at Carnegie Mellon University (CMU), where I worked with Ian Lane on deep learning and reinforcement learning for spoken dialog systems.

I received my Bachelor degree in Electrical Engineering from Nanyang Technological University (NTU) in Singapore.

• 2020/11: Invited talk at Seminar in Natural Language Processing at UC Santa Cruz on "Advancing Spoken Dialog System with Deep Neural Networks"
• 2020/01: Invited talk at RE•WORK AI Assistant Summit on "Towards Interactive Learning of Spoken Dialog Systems".
• 2019/09: Invited talk at Rasa Developer Summit on "Interactive Learning of Task-Oriented Dialog Systems"[video].
• 2018/11: Invited talk at Uber Science Symposium on "Interactive Learning of Neural Dialog Models".
• 2018/08: Successfully defended my PhD thesis on "Learning Task-Oriented Dialog with Neural Network Methods"!

• Continual Learning in Task-Oriented Dialogue Systems
  Andrea Madotto, Zhaojiang Lin, Zhenpeng Zhou, Seungwhan Moon, Paul Crook, Bing Liu, Zhou Yu, Eunjoon Cho, Zhiguang Wang
  In arXiv

  @article{madotto2020continual,
    title={Continual Learning in Task-Oriented Dialogue Systems},
    author={Madotto, Andrea and Lin, Zhaojiang and Zhou, Zhenpeng and Moon, Seungwhan and Crook, Paul and Liu, Bing and Yu, Zhou and Cho, Eunjoon and Wang, Zhiguang},
    journal={arXiv preprint arXiv:2012.15504},
    year={2020}
  }
  

[bib] [paper]


• Analyzing the Forgetting Problem in the Pretrain-Finetuning of Dialogue Response Models
  Tianxing He, Jun Liu, Kyunghyun Cho, Myle Ott, Bing Liu, James Glass, Fuchun Peng
  In EACL 2021

  @inproceedings{he2021mix,
    title={Mix-review: Alleviate Forgetting in the Pretrain-Finetune Framework for Neural Language Generation Models},
    author={He, Tianxing and Liu, Jun and Cho, Kyunghyun and Ott, Myle and Liu, Bing and Glass, James and Peng, Fuchun},
    booktitle={Proceedings of EACL 2021},
    year={2021}
  }
  

[bib] [paper]


• Adding Chit-Chats to Enhance Task-Oriented Dialogues
  Kai Sun, Seungwhan Moon, Paul Crook, Stephen Roller, Becka Silvert, Bing Liu, Zhiguang Wang, Honglei Liu, Eunjoon Cho, and Claire Cardie
  In arXiv

  @article{sun2020adding,
    title={Adding Chit-Chats to Enhance Task-Oriented Dialogues},
    author={Sun, Kai and Moon, Seungwhan and Crook, Paul and Roller, Stephen and Silvert, Becka and Liu, Bing and Wang, Zhiguang and Liu, Honglei and Cho, Eunjoon and Cardie, Claire},
    journal={arXiv preprint arXiv:2010.12757},
    year={2020}
  }
  

[bib] [paper]


• NUANCED: Natural Utterance Annotation for Nuanced Conversation with Estimated Distributions
  Zhiyu Chen, Honglei Liu, Hu Xu, Seungwhan Moon, Hao Zhou, Bing Liu
  In arXiv

  @article{chen2020nuanced,
    title={NUANCED: Natural Utterance Annotation for Nuanced Conversation with Estimated Distributions},
    author={Chen, Zhiyu and Liu, Honglei and Xu, Hu and Moon, Seungwhan and Zhou, Hao and Liu, Bing},
    journal={arXiv preprint arXiv:2010.12758},
    year={2020}
  }
  

[bib] [paper]


• User Memory Reasoning for Conversational Recommendation
  Hu Xu, Seungwhan Moon, Honglei Liu, Bing Liu, Pararth Shah, Bing Liu, Philip S Yu
  In COLING 2020

  @inproceedings{xu2020user,
    title={User Memory Reasoning for Conversational Recommendation},
    author={Xu, Hu and Moon, Seungwhan and Liu, Honglei and Liu, Bing and Shah, Pararth and Yu, Philip S},
    booktitle={Proceedings of the 28th International Conference on Computational Linguistics},
    year={2020}
  }
  

[bib] [paper]


• Reinforcement Learning of Multi-Domain Dialog Policies Via Action Embeddings
  Jorge A. Mendez, Alborz Geramifard, Mohammad Ghavamzadeh, Bing Liu
  In NeurIPS 2019 Workshop on Conversational AI.

  @inproceedings{mendez2019reinforcement,
    title={Reinforcement Learning of Multi-Domain Dialog Policies Via Action Embeddings},
    author={Mendez, Jorge A and Geramifard, Alborz and Ghavamzadeh, Mohammad and Liu, Bing},
    booktitle={3rd Workshop on Conversational AI, NeurIPS},
    year={2019}
  }
  

[bib] [paper]


• Learning Task-Oriented Dialog with Neural Network Methods
  Bing Liu
  PhD Thesis

  @phdthesis{liu2018learning,
    title={Learning Task-Oriented Dialog with Neural Network Methods},
    author={Liu, Bing},
    year={2018},
    school={Carnegie Mellon University}
  }
  

[bib] [thesis]


• Adversarial Learning of Task-Oriented Neural Dialog Models
  Bing Liu, Ian Lane.
  In SIGDIAL 2018.

  @inproceedings{liu2018adversarial,
    author    = {Bing Liu and Ian Lane},
    title     = {Adversarial Learning of Task-Oriented Neural Dialog Models},
    booktitle = {SIGDIAL},
    year      = {2018}
  }
  

[bib] [paper]


• Dialogue Learning with Human Teaching and Feedback in End-To-End Trainable Task-Oriented Dialogue Systems
  Bing Liu, Gokhan Tur, Dilek Hakkani-Tur, Pararth Shah, and Larry Heck
  In NAACL 2018.

  @inproceedings{liu2018dialogue,
    author={Liu, Bing and Tur, Gokhan and Hakkani-Tur, Dilek and Shah, Pararth and Heck, Larry}, 
    title     = {Dialogue Learning with Human Teaching and Feedback in End-To-End Trainable Task-Oriented Dialogue Systems},
    booktitle = {NAACL},
    year      = {2018}
  }
  

[bib] [paper] [poster]


• Bootstrapping a Neural Conversational Agent with Dialogue Self-Play, Crowdsourcing and On-Line Reinforcement Learning
  Pararth Shah, Dilek Hakkani-Tur, Bing Liu, and Gokhan Tur
  In NAACL 2018.

  @inproceedings{shah2018bootstrapping,
    author={Shah, Pararth and Hakkani-Tur, Dilek and Liu, Bing and Tur, Gokhan}, 
    title     = {Bootstrapping a Neural Conversational Agent with Dialogue Self-Play, Crowdsourcing and On-Line Reinforcement Learning},
    booktitle = {NAACL},
    year      = {2018}
  }
  

[bib] [paper]


• End-to-End Learning of Task-Oriented Dialogs
  Bing Liu, Ian Lane.
  In NAACL 2018 SRW (thesis proposal paper).

  @inproceedings{liu2018e2e,
    author={Liu, Bing and Lane, Ian}, 
    title     = {End-to-End Learning of Task-Oriented Dialogs},
    booktitle = {NAACL Student Research Workshop},
    year      = {2018}
  }
  

[bib] [paper] [slides] [video]


• Customized Nonlinear Bandits for Online Response Selection in Neural Conversation Models
  Bing Liu, Tong Yu, Ian Lane, and Ole Mengshoel.
  In AAAI 2018.

  @inproceedings{liu2018customized,
    author    = {Liu, Bing and Yu, Tong and Lane, Ian and Mengshoel, Ole},
    title     = {Customized Nonlinear Bandits for Online Response Selection in Neural Conversation Models},
    booktitle = {AAAI},
    year      = {2018}
  }
  

[bib] [paper]


• Iterative Policy Learning in End-to-End Trainable Task-Oriented Neural Dialog Models
  Bing Liu, Ian Lane.
  In ASRU 2017.

  @inproceedings{liu2017iterative,
    author    = {Bing Liu and Ian Lane},
    title     = {Iterative Policy Learning in End-to-End Trainable Task-Oriented Neural Dialog Models},
    booktitle = {Proceedings of 2017 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU)},
    year      = {2017}
  }
  

[bib] [paper]


• End-to-End Optimization of Task-Oriented Dialogue Model with Deep Reinforcement Learning
  Bing Liu, Gokhan Tur, Dilek Hakkani-Tur, Pararth Shah, and Larry Heck
  In NIPS 2017 Workshop on Conversational AI.

  @inproceedings{liu2017e2e,
    title={End-to-End Optimization of Task-Oriented Dialogue Model with Deep Reinforcement Learning},
    author={Liu, Bing and Tur, Gokhan and Hakkani-Tur, Dilek and Shah, Pararth and Heck, Larry}, 
    booktitle={NIPS Workshop on Conversational AI},
    year={2017}
  }
  

[bib] [paper]


• Multi-Domain Adversarial Learning for Slot Filling in Spoken Language Understanding
  Bing Liu, Ian Lane.
  In NIPS 2017 Workshop on Conversational AI.

  @inproceedings{liu2017multi,
    title={Multi-Domain Adversarial Learning for Slot Filling in Spoken Language Understanding},
    author={Liu, Bing and Lane, Ian},
    booktitle={NIPS Workshop on Conversational AI},
    year={2017}
  }
  

[bib] [paper] [slides]


• An End-to-End Trainable Neural Network Model with Belief Tracking for Task-Oriented Dialog
  Bing Liu, Ian Lane.
  In Interspeech 2017.

  @inproceedings{Liu2017,
    author={Bing Liu and Ian Lane},
    title={An End-to-End Trainable Neural Network Model with Belief Tracking for Task-Oriented Dialog},
    year={2017},
    booktitle={Interspeech 2017}
  }
  

[bib] [paper] [slides]


• Dialog Context Language Modeling with Recurrent Neural Networks
  Bing Liu, Ian Lane.
  In ICASSP 2017.

  @inproceedings{liu-lane:2017:ICASSP,
    title={Dialog Context Language Modeling with Recurrent Neural Networks},
    author={Liu, Bing  and  Lane, Ian},
    booktitle={Acoustics, Speech and Signal Processing (ICASSP), 2017 IEEE International Conference on},
    year={2017},
    organization={IEEE}
  }
  

[bib] [paper]


• Joint Online Spoken Language Understanding and Language Modeling With Recurrent Neural Networks
  Bing Liu, Ian Lane.
  In SIGDIAL 2016.

  @InProceedings{liu-lane:2016:SIGDIAL,
    author    = {Liu, Bing  and  Lane, Ian},
    title     = {Joint Online Spoken Language Understanding and Language Modeling With Recurrent Neural Networks},
    booktitle = {Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue},
    year      = {2016}
  }
  

[bib] [paper] [slides] [video] [code]


• Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling
  Bing Liu, Ian Lane.
  In Interspeech 2016.

  @inproceedings{Liu+2016,
    author={Bing Liu and Ian Lane},
    title={Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling},
    year=2016,
    booktitle={Interspeech 2016}
  }
  

[bib] [paper] [code]


• Recurrent Neural Network Structured Output Prediction for Spoken Language Understanding
  Bing Liu, Ian Lane.
  In NIPS Workshop 2015.

  @inproceedings{liu2015recurrent,
    title={Recurrent Neural Network Structured Output Prediction for Spoken Language Understanding},
    author={Liu, Bing and Lane, Ian},
    booktitle={Proc. NIPS Workshop on Machine Learning for Spoken Language Understanding and Interactions},
    year={2015}
  }
  

[bib] [paper]

• Facebook, Conversational AI
Tech Lead, Staff ML Engineer (2018 - present)

• Building the next generation natural language understanding and conversational AI system for Facebook's digital voice Assistant.


• Google Research
Software Engineer (internship) (2017)

• Designed and developed an end-to-end trainable neural network model for task-oriented dialogs that shows robust performance in natural language understanding, dialog state tracking, and dialog policy learning


• Capio.ai (Acq. by Twilio)
Software Engineer (part time) (2014 - 2015)

• Developed contextual language modeling and language understanding systems
• Built the 1st version of Capio’s cloud infrastructure and Speech (ASR) APIs


• Oracle, Singapore
Member of Technical Staff (2011 - 2013)

• Worked closely with client, pre-sale consultants, and technical staff to deliver the first successful Oracle Big Data Appliance project in Oracle APAC

• Carnegie Mellon University
• Ph.D. in Electrical and Computer Engineering (2013 - 2018)
• Research Area: Machine Learning, Deep Learning, Natural Language Understanding, Spoken Dialog Systems.
• Thesis Committee: Ian Lane, John Paul Shen, Alexander Rudnicky, Dilek Hakkani-Tür, Antoine Raux

• Nanyang Technological University, Singapore
• B.Eng in Electrical and Electronic Engineering (2007 - 2011)
• Minor Degree: Business
• GPA 4.87/5.0 (Top 2%)

• KTH Royal Institute of Technology, Sweden
• Exchange student in school of Information and Communication Technology (2010)

• Google ASRU Travel Grant (2017.10)
• Leo Finzi Memorial Fellowship, CMU ECE (2017/18)
• Outstanding Entry Award - CMU Silicon Valley Annual Tech Showcase (2014.08)
• Carnegie Institute of Technology Dean’s Fellowship (2013.08)
• Oracle Consulting Services ASEAN - Consultant of the Month (2012.05)
• NTU Industrial Attachment Book Prize (Best Overall Performance) (2010.12)
• NTU EEE Dean’s List and President Research Scholar (2008/09/10/11)

Last updated: February, 2021