About me
Greetings! I am a PhD student at the Cognitive Computation Group at UPenn, following Prof. Dan Roth. Currently, I am also a student researcher at Google DeepMind, hosted by Dr. Yang Li, with a focus on building web agents. My research at UPenn mainly focuses on LLM reasoning and planning, and Event-Centric NLU. During my undergrad years at Shanghai Jiao Tong University (上海交通大学), I worked on pose estimation and tracking in Computer Vision, under the supervision of Prof. Cewu Lu.
Experience
- Research Assistant at UPenn (Sep 2019 - Present) - Event-Centric NLP / NLU; LLM Reasoning.
- Student Researcher at Google DeepMind (Feb 2024 - May 2024) - Anticipatory Reflection for LLM Agents.
- Research Intern at AI2 (Sep 2022 - Apr 2023) - Event Causality Identification with Synthetic Control and LM Inversion.
- Research Intern at Tencent AI Lab (May 2022 - Aug 2022) - Event Semantic Classification in Context.
- Research Assistant at SJTU (Dec 2017 - May 2019) - Pose Estimation and Tracking.
Academic Services
- 2024: PC Member of ACL Rolling Review, ACL, NAACL, COLM.
- 2023: PC Member of ACL Rolling Review, LAK, AAAI, EACL, ACL, NeurIPS, NLPCC, EMNLP.
- 2022: PC Member of ACL Rolling Review, NAACL, EMNLP, AACL-IJCNLP, ICDM.
- 2021: PC Member of WWW.
Publications
Recent preprints
[19] Haoyu Wang, Tao Li, Zhiwei Deng, Dan Roth, Yang Li. "Devil's Advocate: Anticipatory Reflection for LLM Agents", under review, 2024.
[18] Haoyu Wang, Fengze Liu, Jiayao Zhang, Dan Roth, Kyle Richardson. "Event Causality Identification with Synthetic Control", under review, 2024.
Peer-reviewed
[17] Xingyu Fu, Yushi Hu, Bangzheng Li, Yu Feng, Haoyu Wang, Xudong Lin, Dan Roth, Noah A Smith, Wei-Chiu Ma, Ranjay Krishna. "BLINK: Multimodal Large Language Models Can See but Not Perceive", European Conference on Computer Vision (ECCV), 2024.
[16] Haoyu Wang, Hongming Zhang, Kaiqiang Song, Dan Roth, Dong Yu. "Event Semantic Classification in Context", Conference of the European Chapter of the Association for Computational Linguistics (EACL) - Findings, 2024.
[15] Haoyu Wang, Hongming Zhang, Yueguan Wang, Yuqian Deng, Muhao Chen, Dan Roth. "Are All Steps Equally Important? Benchmarking Essentiality Detection of Events", Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023.
[14] Yu Feng, Ben Zhou, Haoyu Wang, Helen Jin, Dan Roth. "Generic Temporal Reasoning with Differential Analysis and Explanation", Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL), 2023.
[13] Haoyu Wang, Hongming Zhang, Yuqian Deng, Jacob R. Gardner, Dan Roth, Muhao Chen. "Extracting or Guessing? Improving Faithfulness of Event Temporal Relation Extraction", Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023.
[12] Rotem Dror *, Haoyu Wang *, Dan Roth. "Zero-Shot On-the-Fly Event Schema Induction", Conference of the European Chapter of the Association for Computational Linguistics (EACL) - Findings, 2023.
[11] Zheng Qi, Elior Sulem, Haoyu Wang, Xiaodong Yu, Dan Roth. "Capturing the Content of a Document through Complex Event Identification", Proceedings of the 11th Joint Conference on Lexical and Computational Semantics (*SEM), 2022.
[10] Xinya Du, Zixuan Zhang, Sha Li, Ziqi Wang, Pengfei Yu, Hongwei Wang, Tuan Manh Lai, Xudong Lin, Iris Liu, Ben Zhou, Haoyang Wen, Manling Li, Darryl Hannan, Jie Lei, Hyounghun Kim, Rotem Dror, Haoyu Wang, Michael Regan, Qi Zeng, Qing Lyu, Charles Yu, Carl Edwards, Xiaomeng Jin, Yizhu Jiao, Ghazaleh Kazeminejad, Zhenhailong Wang, Chris Callison-Burch, Carl Vondrick, Mohit Bansal, Dan Roth, Jiawei Han, Shih-Fu Chang, Martha Palmer, Heng Ji. "RESIN-11: Schema-guided Event Prediction for 11 Newsworthy Scenarios", Conference of the North American Chapter of the Association for Computational Linguistics (NAACL) - Demo Track, 2022.
[9] Haoyu Wang, Hongming Zhang, Muhao Chen, Dan Roth. "Learning Constraints and Descriptive Segmentation for Subevent Detection", Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021.
[8] Hongming Zhang, Haoyu Wang, and Dan Roth. "Zero-shot Label-Aware Event Trigger and Argument Classification", The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP) - Findings, 2021.
[7] Haoyang Wen, Ying Lin, Tuan M. Lai, Xiaoman Pan, Sha Li, Xudong Lin, Ben Zhou, Manling Li, Haoyu Wang, Hongming Zhang, Xiaodong Yu, Alexander Dong, Zhenhailong Wang, Yi R. Fung, Piyush Mishra, Qing Lyu, Dídac Surís, Brian Chen, Susan W. Brown, Martha Palmer, Chris Callison-Burch, Carl Vondrick, Jiawei Han, Dan Roth, Shih-Fu Chang, Heng Ji. "RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System", Conference of the North American Chapter of the Association for Computational Linguistics (NAACL) - Demo Track, 2021.
[6] Muhao Chen, Hongming Zhang, Haoyu Wang, Dan Roth. "What Are You Trying to Do? Semantic Typing of Event Processes", The SIGNLL Conference on Computational Natural Language Learning (CoNLL), 2020. [Demo] [Code]
[5] Haoyu Wang, Muhao Chen, Hongming Zhang, Dan Roth. "Joint Constrained Learning for Event-Event Relation Extraction", Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020. [Video] [Code]
[4] Hongming Zhang, Muhao Chen, Haoyu Wang, Yangqiu Song, Dan Roth. "Analogous Process Structure Induction for Sub-event Sequence Prediction", Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020. [Code]
[3] Haoyu Wang, Vivek Kulkarni, William Yang Wang. "DOLORES: Deep Contextualized Knowledge Graph Embeddings", Automated Knowledge Base Construction (AKBC), 2020. [Code]
[2] Yuliang Xiu *, Jiefeng Li *, Haoyu Wang, Yinghong Fang, Cewu Lu. "Pose Flow: Efficient Online Pose Tracking", British Machine Vision Conference (BMVC), 2018. [Code]
Others
[1] Zelin Zhao, Haoyu Wang *, Gao Peng *, Haoshu Fang, Chengkun Li, Cewu Lu. "Estimating 6D Pose From Localizing Designated Surface Keypoints", arXiv preprint, 2018. [Code]
Research Projects
-
A joint constrained learning framework for event temporal, subevent, and coreferential relation extraction.
-
Unsupervised event extraction
-
Event process typing and subevent sequence prediction
-
A knowledge graph embedding algorithm that captures contextual cues and dependencies among entities and relations.
-
Human pose tracking: a new method for multi-person pose tracking with spatio-temporal information.
-
6D object pose estimation: a novel architecture of detecting 3D model instances and estimating 6D pose under occlusion.
-
Traffic optimization with deep reinforcement learning: a hierarchical architecture for load balancing and flow scheduling in datacenter networks.
Short-term Programs
-
EE Summer Intensive Program, University of Washington, Seattle, USA, 2016.6
-
Winter International Student Experience, Sungkyunkwan University (성균관대학교), Seoul, South Korea, 2019.1
Recreations
-
Piano: started to play at the age of 4
-
Tennis: served as President of SJTU Tennis Association from 2016.6 to 2017.6