Tutorial: Multimodal Machine Learning

Louis-Philippe Morency

Louis-Philippe Morency

Language Technologies Institute, Carnegie Mellon University

Louis-Philippe Morency is an Associate Professor at CMU LTI where he leads the Multimodal Communication and Machine Learning Laboratory. He was formerly research faculty at USC and received his Ph.D. degree from MIT CSAIL. His research focuses on building the computational foundations to enable computers with the abilities to analyze, recognize and predict subtle human communicative behaviors during social interactions. He received diverse awards including AI’s 10 to Watch by IEEE Intelligent Systems, NetExplo Award in partnership with UNESCO and 10 best paper awards at IEEE and ACM conferences.

Paul Pu Liang

Paul Pu Liang

Machine Learning Department, Carnegie Mellon University

Paul Liang is a Ph.D. student in Machine Learning at CMU. His research lies in multimodal machine learning with applications in socially intelligent AI. His research is supported by a Facebook PhD Fellowship and a Center for Machine Learning and Health Fellowship, and has been recognized by awards at the NeurIPS 2019 workshop on federated learning and ICMI 2017. He regularly organizes courses, workshops, and tutorials on multimodal learning.

Amir Zadeh

Amir Zadeh

Language Technologies Institute, Carnegie Mellon University

Amir Zadeh is a Postdoctoral Associate at CMU. Prior to that, he received his Ph.D. from Language Technologies Institute, CMU. His work is focused on multimodal learning, especially modeling multimodal language. He is the creator of several resources in this area including CMU-MOSEAS, CMU-MOSEI, and CMU-MOSI datasets. He has organized workshops on multimodal language and published in ACL, EMNLP, NAACL, CVPR, and ICLR.