About me

Greetings! I am a PhD student at the Cognitive Computation Group at UPenn, following Prof. Dan Roth. Currently, I am also a student researcher at Google DeepMind, hosted by Dr. Yang Li, with a focus on building web agents. My research at UPenn mainly focuses on LLM reasoning and planning, and Event-Centric NLU. During my undergrad years at Shanghai Jiao Tong University (上海交通大学), I worked on pose estimation and tracking in Computer Vision, under the supervision of Prof. Cewu Lu.

Experience

Academic Services

Publications

Recent preprints

[19] Haoyu Wang, Tao Li, Zhiwei Deng, Dan Roth, Yang Li. "Devil's Advocate: Anticipatory Reflection for LLM Agents", under review, 2024.

[18] Haoyu Wang, Fengze Liu, Jiayao Zhang, Dan Roth, Kyle Richardson. "Event Causality Identification with Synthetic Control", under review, 2024.

Peer-reviewed

[17] Xingyu Fu, Yushi Hu, Bangzheng Li, Yu Feng, Haoyu Wang, Xudong Lin, Dan Roth, Noah A Smith, Wei-Chiu Ma, Ranjay Krishna. "BLINK: Multimodal Large Language Models Can See but Not Perceive", European Conference on Computer Vision (ECCV), 2024.

[16] Haoyu Wang, Hongming Zhang, Kaiqiang Song, Dan Roth, Dong Yu. "Event Semantic Classification in Context", Conference of the European Chapter of the Association for Computational Linguistics (EACL) - Findings, 2024.

[15] Haoyu Wang, Hongming Zhang, Yueguan Wang, Yuqian Deng, Muhao Chen, Dan Roth. "Are All Steps Equally Important? Benchmarking Essentiality Detection of Events", Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023.

[14] Yu Feng, Ben Zhou, Haoyu Wang, Helen Jin, Dan Roth. "Generic Temporal Reasoning with Differential Analysis and Explanation", Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL), 2023.

[13] Haoyu Wang, Hongming Zhang, Yuqian Deng, Jacob R. Gardner, Dan Roth, Muhao Chen. "Extracting or Guessing? Improving Faithfulness of Event Temporal Relation Extraction", Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023.

[12] Rotem Dror *, Haoyu Wang *, Dan Roth. "Zero-Shot On-the-Fly Event Schema Induction", Conference of the European Chapter of the Association for Computational Linguistics (EACL) - Findings, 2023.

[11] Zheng Qi, Elior Sulem, Haoyu Wang, Xiaodong Yu, Dan Roth. "Capturing the Content of a Document through Complex Event Identification", Proceedings of the 11th Joint Conference on Lexical and Computational Semantics (*SEM), 2022.

[10] Xinya Du, Zixuan Zhang, Sha Li, Ziqi Wang, Pengfei Yu, Hongwei Wang, Tuan Manh Lai, Xudong Lin, Iris Liu, Ben Zhou, Haoyang Wen, Manling Li, Darryl Hannan, Jie Lei, Hyounghun Kim, Rotem Dror, Haoyu Wang, Michael Regan, Qi Zeng, Qing Lyu, Charles Yu, Carl Edwards, Xiaomeng Jin, Yizhu Jiao, Ghazaleh Kazeminejad, Zhenhailong Wang, Chris Callison-Burch, Carl Vondrick, Mohit Bansal, Dan Roth, Jiawei Han, Shih-Fu Chang, Martha Palmer, Heng Ji. "RESIN-11: Schema-guided Event Prediction for 11 Newsworthy Scenarios", Conference of the North American Chapter of the Association for Computational Linguistics (NAACL) - Demo Track, 2022.

[9] Haoyu Wang, Hongming Zhang, Muhao Chen, Dan Roth. "Learning Constraints and Descriptive Segmentation for Subevent Detection", Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021.

[8] Hongming Zhang, Haoyu Wang, and Dan Roth. "Zero-shot Label-Aware Event Trigger and Argument Classification", The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP) - Findings, 2021.

[7] Haoyang Wen, Ying Lin, Tuan M. Lai, Xiaoman Pan, Sha Li, Xudong Lin, Ben Zhou, Manling Li, Haoyu Wang, Hongming Zhang, Xiaodong Yu, Alexander Dong, Zhenhailong Wang, Yi R. Fung, Piyush Mishra, Qing Lyu, Dídac Surís, Brian Chen, Susan W. Brown, Martha Palmer, Chris Callison-Burch, Carl Vondrick, Jiawei Han, Dan Roth, Shih-Fu Chang, Heng Ji. "RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System", Conference of the North American Chapter of the Association for Computational Linguistics (NAACL) - Demo Track, 2021.

[6] Muhao Chen, Hongming Zhang, Haoyu Wang, Dan Roth. "What Are You Trying to Do? Semantic Typing of Event Processes", The SIGNLL Conference on Computational Natural Language Learning (CoNLL), 2020. [Demo] [Code]

[5] Haoyu Wang, Muhao Chen, Hongming Zhang, Dan Roth. "Joint Constrained Learning for Event-Event Relation Extraction", Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020. [Video] [Code]

[4] Hongming Zhang, Muhao Chen, Haoyu Wang, Yangqiu Song, Dan Roth. "Analogous Process Structure Induction for Sub-event Sequence Prediction", Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020. [Code]

[3] Haoyu Wang, Vivek Kulkarni, William Yang Wang. "DOLORES: Deep Contextualized Knowledge Graph Embeddings", Automated Knowledge Base Construction (AKBC), 2020. [Code]

[2] Yuliang Xiu *, Jiefeng Li *, Haoyu Wang, Yinghong Fang, Cewu Lu. "Pose Flow: Efficient Online Pose Tracking", British Machine Vision Conference (BMVC), 2018. [Code]

Others

[1] Zelin Zhao, Haoyu Wang *, Gao Peng *, Haoshu Fang, Chengkun Li, Cewu Lu. "Estimating 6D Pose From Localizing Designated Surface Keypoints", arXiv preprint, 2018. [Code]

Research Projects

Short-term Programs

Recreations