2024

Matthew Marge, Carol Y. Espy-Wilson, Nigel G. Ward, Abeer Alwan, Yoav Artzi, Mohit Bansal, Gilmer L. Blankenship, Joyce Y. Chai, Hal Daumé III, Debadeepta Dey, Mary P. Harper, Thomas Howard, Casey Kennington, Ivana Kruijff-Korbayová, Dinesh Manocha, Cynthia Matuszek, Ross Mead, Raymond Mooney, Roger K. Moore, Mari Ostendorf, Heather Pon-Barry, Alexander I. Rudnicky, Matthias Scheutz, Robert St. Amant, Tong Sun, Stefanie Tellex, David R. Traum, Zhou Yu

2021

MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks

EMNLP (Outstanding Paper Award), 2021

Cristian-Paul Bara, Sky CH. Wang, Joyce Y. Chai

Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding

Findings of EMNLP, 2021

Shane Storks, Qiaozi Gao, Yichi Zhang, Joyce Y. Chai

Beyond the Tip of the Iceberg: Assessing Coherence of Text Classifiers

Findings of EMNLP, 2021

Shane Storks, Joyce Y. Chai

CX-ToM: Counterfactual Explanations with Theory-of-Mind for Enhancing Human Trust in Image Recognition Models

iScience Cell Press Journal, 2021

Arjun R. Akula, Keze Wang, Changsong Liu, Sari Saba-Sadiya, Hongjing Lu, Sinisa Todorovic, Joyce Y. Chai, Song-Chun Zhu

Hierarchical Task Learning from Language Instructions with Unified Transformers and Self-Monitoring

Findings of the Association for Computational Linguistics (ACL-IJCNLP), 2021

Yichi Zhang, Joyce Y. Chai

Zero-Shot Compositional Concept Learning

ACL workshop on MetaNLP (MetaNLP @ ACL), 2021

Guangyue Xu, Parisa Kordjamshidi, Joyce Y. Chai

Are We There Yet? Learning to Localize in Embodied Instruction Following

AAAI Workshop on Hybrid Artificial Intelligence (HAI @ AAAI), 2021

Shane Storks, Qiaozi Gao, Govind Thattai, Gokhan Tur

2020

Experience Grounds Language

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020

Yonatan Bisk, Ari Holtzman, Jesse Thomason, Jacob Andreas, Yoshua Bengio, Joyce Y. Chai, Mirella Lapata, Angeliki Lazaridou, Jonathan May, Aleksandr Nisnevich, Nicolas Pinto, Joseph P. Turian

2019

X-ToM: Explaining with Theory-of-Mind for Gaining Justified Human Trust

Arxiv, 2019

Arjun R. Akula, Changsong Liu, Sari Saba-Sadiya, Hongjing Lu, Sinisa Todorovic, Joyce Y. Chai, Song-Chun Zhu

Teaching Robots New Tasks through Natural Interaction

Teaching Robots New Tasks through Natural Interaction, 2019

Joyce Y. Chai, Maya Cakmak, Candy Sidner

Report of 2017 NSF Workshop on Multimedia Challenges, Opportunities and Research Roadmaps

NSF Workshop on Multimedia Challenges, Opportunities and Research Roadmaps, 2019

Shih-Fu Chang, Alexander G. Hauptmann, Louis-Philippe Morency, Sameer K. Antani, Dick C. A. Bulterman, Carlos Busso, Joyce Yue Chai, Julia Hirschberg, Ramesh C. Jain, Ketan Mayer-Patel, Reuven Meth, Raymond Mooney, Klara Nahrstedt, Shrikanth S. Narayanan, Prem Natarajan, Sharon L. Oviatt, Balakrishnan Prabhakaran, Arnold W. M. Smeulders, Hari Sundaram, Zhengyou Zhang, Michelle X. Zhou

Natural Language Interaction with Explainable AI Models

Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2019

Arjun R. Akula, Sinisa Todorovic, Joyce Y. Chai, Song-Chun Zhu

Explainable AI as Collaborative Task Solving

Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2019

Arjun R. Akula, Changsong Liu, Sinisa Todorovic, Joyce Y. Chai, Song-Chun Zhu

Commonsense Reasoning for Natural Language Understanding: A Survey of Benchmarks, Resources, and Approaches

Arxiv, 2019

Shane Storks, Qiaozi Gao, Joyce Y. Chai

2018

What Action Causes This? Towards Naive Physical Action-Effect Prediction

Annual Meeting of the Association for Computational Linguistics (ACL), 2018

Qiaozi Gao, Shaohua Yang, Joyce Yue Chai, Lucy Vanderwende

Language to Action: Towards Interactive Task Learning with Physical Agents (Keynote Presentation)

Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS), 2018

Joyce Y. Chai

Language to Action: Towards Interactive Task Learning with Physical Agents

International Joint Conferences on Artificial Intelligence (IJCAI), 2018

Joyce Y. Chai, Qiaozi Gao, Lanbo She, Shaohua Yang, Sari Saba-Sadiya, Guangyue Xu

Commonsense Justification for Action Explanation

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2018

Shaohua Yang, Qiaozi Gao, Sari Saba-Sadiya, Joyce Yue Chai

2017

Interactive Learning of Grounded Verb Semantics towards Human-Robot Communication

Annual Meeting of the Association for Computational Linguistics (ACL), 2017

Lanbo She, Joyce Yue Chai

Detecting Clinically Related Content in Online Patient Posts

Journal of Biomedical Informatics (JBI), 2017

Courtland VanDam, Shaheen Kanthawala, Wanda Pratt, Joyce Y. Chai, Jina Huh

2016

What's Hot in Human Language Technology: Highlights from NAACL HLT 2015

AAAI Conference on Artificial Intelligence (AAAI), 2016

Joyce Yue Chai, Anoop Sarkar, Rada Mihalcea

Task Learning through Visual Demonstration and Situated Dialogue

AAAI Workshop on Symbiotic Cognitive Systems, 2016

Changsong Liu, Joyce Y. Chai, Nishant Shukla, Song-Chun Zhu

Program Robots Manufacturing Tasks by Natural Language Instructions

IEEE International Conference on Automation Science and Engineering (CASE), 2016

Yunyi Jia, Lanbo She, Yu Cheng, Jiatong Bao, Joyce Yue Chai, Ning Xi

Physical Causality of Action Verbs in Grounded Language Understanding

Annual Meeting of the Association for Computational Linguistics (ACL), 2016

Qiaozi Gao, Malcolm Doering, Shaohua Yang, Joyce Yue Chai

Jointly Learning Grounded Task Structures from Language Instruction and Visual Demonstration

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2016

Changsong Liu, Shaohua Yang, Sari Saba-Sadiya, Nishant Shukla, Yunzhong He, Song-Chun Zhu, Joyce Yue Chai

Incremental Acquisition of Verb Hypothesis Space towards Physical World Interaction

Annual Meeting of the Association for Computational Linguistics (ACL), 2016

Lanbo She, Joyce Yue Chai

Grounded Semantic Role Labeling

North American Chapter of the Association for Computational Linguistics: Human Language Technologies (HLT-NAACL), 2016

Shaohua Yang, Qiaozi Gao, Changsong Liu, Caiming Xiong, Song-Chun Zhu, Joyce Y. Chai

Collaborative Language Grounding Toward Situated Human-Robot Dialogue

AI Magazine, 2016

Joyce Y. Chai, Rui Fang, Changsong Liu, Lanbo She

2015

Question Types in Online Health Communities

American Medical Informatics Association Annual Symposium (AMIA), 2015

Shaheen Kanthawala, Courtland VanDam, Barbara Given, Joyce Y. Chai, Amber Vermeesch, Marianne Huebner, John Crowley, Jina Huh

Learning to Mediate Perceptual Differences in Situated Human-Robot Dialogue

AAAI Conference on Artificial Intelligence (AAAI), 2015

Changsong Liu, Joyce Yue Chai

Exception Handling for Natural Language Control of Robots

ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2015

Lanbo She, Yunyi Jia, Ning Xi, Joyce Yue Chai

Embodied Collaborative Referring Expression Generation in Situated Human-Robot Interaction

ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2015

Rui Fang, Malcolm Doering, Joyce Yue Chai

2014

Teaching Robots New Actions through Natural Language Instructions

IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), 2014

Lanbo She, Yu Cheng, Joyce Yue Chai, Yunyi Jia, Shaohua Yang, Ning Xi

Proceedings of the 19th International Conference on Intelligent User Interfaces

International Conference on Intelligent User Interfaces (IUI), 2014

Tsvi Kuflik, Oliviero Stock, Joyce Yue Chai, Antonio Krüger

Probabilistic Labeling for Efficient Referential Grounding based on Collaborative Discourse

Annual Meeting of the Association for Computational Linguistics (ACL), 2014

Changsong Liu, Lanbo She, Rui Fang, Joyce Y. Chai

Perceptive feedback for natural language control of robotic operations

International Conference on Robotics and Automation (ICRA), 2014

Yunyi Jia, Ning Xi, Joyce Yue Chai, Yu Cheng, Rui Fang, Lanbo She

Context-based Word Acquisition for Situated Dialogue in a Virtual World

Journal of Artificial Intelligence Research (JAIR), 2014

Shaolin Qu, Joyce Y. Chai

Collaborative Models for Referring Expression Generation in Situated Dialogue

AAAI Conference on Artificial Intelligence (AAAI), 2014

Rui Fang, Malcolm Doering, Joyce Y. Chai

Collaborative effort towards common ground in situated human-robot dialogue

ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2014

Joyce Y. Chai, Lanbo She, Rui Fang, Spencer Ottarson, Cody Littley, Changsong Liu, Kenneth Hanson

Back to the Blocks World: Learning New Actions through Situated Human-Robot Dialogue

Special Interest Group on Discourse and Dialogue (SIGDIAL), 2014

Lanbo She, Shaohua Yang, Yu Cheng, Yunyi Jia, Joyce Yue Chai, Ning Xi

2013

Towards Situated Dialogue: Revisiting Referring Expression Generation

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2013

Rui Fang, Changsong Liu, Lanbo She, Joyce Y. Chai

Shared Gaze in Situated Referential Grounding: An Empirical Study

Eye Gaze in Intelligent User Interfaces, 2013

Changsong Liu, Rui Fang, Joyce Y. Chai

Modeling Collaborative Referring for Situated Referential Grounding

Special Interest Group on Discourse and Dialogue (SIGDIAL), 2013

Changsong Liu, Rui Fang, Lanbo She, Joyce Yue Chai

Introduction to the special section on eye gaze and conversation

ACM Transactions on Interactive Intelligent Systems (TiiS), 2013

Elisabeth André, Joyce Yue Chai

2012

Towards online adaptation and personalization of key-target resizing for mobile devices

International Conference on Intelligent User Interfaces (IUI), 2012

Tyler Baldwin, Joyce Yue Chai

Towards Mediating Shared Perceptual Basis in Situated Dialogue

Special Interest Group on Discourse and Dialogue (SIGDIAL), Best Paper Nominee, 2012

Changsong Liu, Rui Fang, Joyce Yue Chai

Semantic Role Labeling of Implicit Arguments for Nominal Predicates

Computational Linguistics, 2012

Matthew Gerber, Joyce Y. Chai

Introduction to the Special Issue on Eye Gaze in Intelligent Human-machine Interaction

ACM Transactions on Interactive Intelligent Systems (TiiS), 2012

Elisabeth André, Joyce Y. Chai

Integrating word acquisition and referential grounding towards physical world interaction

*International Conference on Multimodal Interaction (ICMI), 2012

Rui Fang, Changsong Liu, Joyce Yue Chai

Autonomous Self-Assessment of Autocorrections: Exploring Text Message Dialogues

North American Chapter of the Association for Computational Linguistics: Human Language Technologies (HLT-NAACL), 2012

Tyler Baldwin, Joyce Yue Chai

2011

Cognitive Principles in Robust Multimodal Interpretation

Journal of Artificial Intelligence Research (JAIR), 2011

Joyce Yue Chai, Zahar Prasov, Shaolin Qu

Beyond Normalization: Pragmatics of Word Form in Text Messages

International Joint Conference on Natural Language Processing (IJCNLP), 2011

Tyler Baldwin, Joyce Y. Chai

A Joint Model of Implicit Arguments for Nominal Predicates

ACL Workshop on Relational Models of Semantics, 2011

Matthew Gerber, Joyce Yue Chai, Robert Bart

2010

Workshop: Eye Gaze in Intelligent Human Machine Interaction

International Conference on Intelligent User Interfaces (IUI), 2010

Elisabeth André, Joyce Y. Chai

Towards Conversation Entailment: An Empirical Investigation

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2010

Chen Zhang, Joyce Yue Chai

Hand Gestures in Disambiguating Types of You Expressions in Multiparty Meetings

Special Interest Group on Discourse and Dialogue (SIGDIAL), 2010

Tyler Baldwin, Joyce Yue Chai, Katrin Kirchhoff

Fusing Eye Gaze with Speech Recognition Hypotheses to Resolve Exophoric References in Situated Dialogue

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2010

Zahar Prasov, Joyce Yue Chai

Context-based Word Acquisition for Situated Dialogue in a Virtual World

Journal of Artificial Intelligence Research (JAIR), 2010

Shaolin Qu, Joyce Yue Chai

Beyond NomBank: A Study of Implicit Arguments for Nominal Predicates

Annual Meeting of the Association for Computational Linguistics (ACL), Best Long Paper Award, 2010

Matthew Gerber, Joyce Yue Chai

Ambiguities in Spatial Language Understanding in Situated Human Robot Dialogue

2010 AAAI Fall Symposium Series, 2010

Changsong Liu, Jacob Walker, Joyce Y. Chai

2009

What do We Know about Conversation Participants: Experiments on Conversation Entailment

Special Interest Group on Discourse and Dialogue (SIGDIAL), 2009

Chen Zhang, Joyce Yue Chai

The Role of Interactivity in Human-Machine Conversation for Automatic Word Acquisition

Special Interest Group on Discourse and Dialogue (SIGDIAL), 2009

Shaolin Qu, Joyce Yue Chai

The Role of Implicit Argumentation in Nominal SRL

North American Chapter of the Association for Computational Linguistics: Human Language Technologies (HLT-NAACL), 2009

Matthew Gerber, Joyce Yue Chai, Adam Meyers

Communicative gestures in coreference identification in multiparty meetings

International Conference on Multimodal Interfaces (ICMI), 2009

Tyler Baldwin, Joyce Y. Chai, Katrin Kirchhoff

Between linguistic attention and gaze fixations inmultimodal conversational interfaces

International Conference on Multimodal Interfaces (ICMI), 2009

Rui Fang, Joyce Y. Chai, Fernanda Ferreira

2008

What's in a gaze?: the role of eye-gaze in reference resolution in multimodal conversational interfaces

International Conference on Intelligent User Interfaces (IUI), 2008

Zahar Prasov, Joyce Yue Chai

Incorporating Temporal and Semantic Information with Eye Gaze for Automatic Word Acquisition in Multimodal Conversational Systems

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2008

Shaolin Qu, Joyce Yue Chai

Beyond attention: the role of deictic gesture in intention recognition in multimodal conversational interfaces

International Conference on Intelligent User Interfaces (IUI), 2008

Shaolin Qu, Joyce Yue Chai

2007

Michigan State University at the 2007 TREC ciQA Task

Text REtrieval Conference (TREC), 2007

Chen Zhang, Matthew Gerber, Tyler Baldwin, Steve Emelander, Joyce Yue Chai, Rong Jin

Eye Gaze for Attention Prediction in Multimodal Human-Machine Conversation

2007 AAAI Spring Symposium: Interaction Challenges for Intelligent Assistants, 2007

Zahar Prasov, Joyce Yue Chai, Hogyeong Jeong

Eye Gaze for Attention Prediction in Multimodal Human-Machine Conversation

2007 AAAI Spring Symposium, 2007

Zahar Prasov, Joyce Y. Chai, Hogyeong Jeong

Discourse Processing for Context Question Answering Based on Linguistic Knowledge

Knowledge-Based Systems, 2007

Mingyu Sun, Joyce Y. Chai

Automated Vocabulary Acquisition and Interpretation in Multimodal Conversational Systems

Annual Meeting of the Association for Computational Linguistics (ACL), 2007

Yi Liu, Joyce Yue Chai, Rong Jin

An Exploration of Eye Gaze in Spoken Language Processing for Multimodal Conversational Interfaces

North American Chapter of the Association for Computational Linguistics: Human Language Technologies (HLT-NAACL), 2007

Shaolin Qu, Joyce Yue Chai

An Empirical Investigation of User Term Feedback in Text-based Targeted Image Search

ACM Transactions on Interactive Intelligent Systems (TiiS), 2007

Joyce Y. Chai, Chen Zhang, Rong Jin

2006

Towards intelligent QA interfaces: discourse processing for context questions

International Conference on Intelligent User Interfaces (IUI), 2006

Mingyu Sun, Joyce Y. Chai

Towards Conversational QA: Automatic Identification of Problematic Situations and User Intent

Annual Meeting of the Association for Computational Linguistics (ACL), 2006

Joyce Y. Chai, Chen Zhang, Tyler Baldwin

Salience modeling based on non-verbal modalities for spoken language understanding

International Conference on Multimodal Interfaces (ICMI), 2006

Shaolin Qu, Joyce Y. Chai

Cognitive Principles in Robust Multimodal Interpretation

Journal of Artificial Intelligence Research (JAIR), 2006

Joyce Yue Chai, Zahar Prasov, Shaolin Qu

Automated performance assessment in interactive QA

International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2006

Joyce Y. Chai, Tyler Baldwin, Chen Zhang

A Statistical Framework for Query Translation Disambiguation

ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP), 2006

Yi Liu, Rong Jin, Joyce Y. Chai

2005

User term feedback in interactive text-based image retrieval

International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2005

Chen Zhang, Joyce Y. Chai, Rong Jin

Study of cross lingual information retrieval using on-line translation systems

International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2005

Rong Jin, Joyce Y. Chai

Linguistic theories in efficient multimodal reference resolution: an empirical investigation

International Conference on Intelligent User Interfaces (IUI), 2005

Joyce Y. Chai, Zahar Prasov, Joseph Blaim, Rong Jin

Learn to weight terms in information retrieval using category information

International Conference on Machine Learning (ICML), 2005

Rong Jin, Joyce Y. Chai, Luo Si

A Salience Driven Approach to Robust Input Interpretation in Multimodal Conversational Systems

Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT-EMNLP), 2005

Joyce Y. Chai, Shaolin Qu

A maximum coherence model for dictionary-based cross-language information retrieval

International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2005

Yi Liu, Rong Jin, Joyce Y. Chai

Publications

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004