Publications
* and ^ represent equal-contribution groups.
Non-Archival Tech Reports
-
π₯ LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
βοΈγChengsong Huang*, Qian Liu*, Bill Yuchen Lin*, Tianyu Pang, Chao Du, Min Lin
π’γarXiv
[πΎ Demo] [πΎ Github] [π¦ Tweet] -
π₯ Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning
βοΈγXiming Lu, Faeze Brahman, Peter West, Jaehun Jang, Khyathi Chandu, Abhilasha Ravichander, Lianhui Qin, Prithviraj Ammanabrolu,
Liwei Jiang, Sahana Ramnath, Nouha Dziri, Jillian Fisher, Bill Yuchen Lin, Skyler Hallinan, Xiang Ren, Sean Welleck, Yejin Choi
π’γarXiv
2023
-
π₯ SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks
βοΈγBill Yuchen Lin, Yicheng Fu, Karina Yang, Prithviraj Ammanabrolu, Faeze Brahman, Shiyu Huang, Chandra Bhagavatula, Yejin Choi, Xiang Ren
π’γNeurIPS 2023 (spotlight)
[π Project Page] [πΎ Github] [π¦ Tweet] [π° Blog] -
π₯ Faith and Fate: Limits of Transformers on Compositionality
βοΈγNouha Dziri*, Ximing Lu*, Melanie Sclar*, Xiang Lorraine Li^, Liwei Jiang^, Bill Yuchen Lin^,
Peter West, Chandra Bhagavatula, Ronan Le Bras,Jena Hwang,Soumya Sanyal,Sean Welleck,Xiang Ren, Allyson Ettinger, Zaid Harchaoui, Yejin Choi
π’γNeurIPS 2023 (spotlight)
[π¦ Tweet] -
π₯ LLM-Blender: Ensembling Large Language Models with Pairwise Comparison and Generative Fusion
βοΈγDongfu Jiang, Xiang Ren, Bill Yuchen Lin
π’γto appear in Proc. of ACL 2023
[π Project Page] [πΎ Github] [π¦ Tweet]
Media coverage : MarkTechPost -
On Grounded Planning for Embodied Tasks with Language Models
βοΈγBill Yuchen Lin*, Chengsong Huang*, Qian Liu, Wenda Gu, Sam Sommerer, Xiang Ren
π’γin Proc. of AAAI 2023
[π Project Page] [πΎ Github] [π€ Data]
Media coverage : USC Viterbi News -
AutoTriggER: Named Entity Recognition with Auxiliary Trigger Extraction
βοΈγDong-Ho Lee, Ravi Kiran Selvam, Sheikh Muhammad Sarwar, Bill Yuchen Lin,
Mahak Agarwal, Fred Morstatter, Jay Pujara, Elizabeth Boschee, James Allan, Xiang Ren
π’γin Proc. of EACL 2023, also presented at TrustNLP @ NAACL 2021 (best paper award) -
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
βοΈγ442 authors including Bill Yuchen Lin
Β [πΎ Github]
π’γin TMLR
2022
-
Reflect, Not Reflex: Inference-Based Common Ground Improves Dialogue Response Quality
βοΈγPei Zhou, Hyundong J. Cho, Pegah Jandaghi, Dong-Ho Lee, Bill Yuchen Lin, Jay Pujara, Xiang Ren
π’γin Proc. of EMNLP 2022
[π¦ Tweet] -
Unsupervised Cross-Task Generalization via Retrieval Augmentation
βοΈγBill Yuchen Lin, Kangmin Tan, Chris Miller, Beiwen Tian, Xiang Ren
π’γin Proc. of NeurIPS 2022
Β [π Project Page] Β [πΎ Github] [πΌοΈ Slides] Β [π¦ Video] [π¦ Tweet] -
On Continual Model Refinement in Out-of-Distribution Data Streams
βοΈγBill Yuchen Lin, Sida Wang, Xi Victoria Lin, Robin Jia, Lin Xiao, Xiang Ren, Scott Yih
π’γin Proc. of ACL 2022
Β [π Project Page] Β [πΎ Github] [πΌοΈ Slides] Β [π¦ Video] [π¦ Tweet] -
FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Tasks
βοΈγBill Yuchen Lin*, Chaoyang He*, Zihang Zeng, Hulin Wang, Yufen Huang, Mahdi Soltanolkotabi, Xiang Ren^, Salman Avestimehr^
π’γin Proc. of NAACL 2022 Findings
[πΎ Github] [π¦ Tweet] -
On the Robustness of Reading Comprehension Models to Entity Renaming
βοΈγJun Yan, Yang Xiao, Sagnik Mukherjee, Bill Yuchen Lin, Robin Jia, Xiang Ren
π’γin Proc. of NAACL 2022
2021
-
CrossFit: A Few-shot Learning Challenge for Cross-Task Generalization in NLP
βοΈγQinyuan Ye, Bill Yuchen Lin, Xiang Ren
π’γin Proc. of EMNLP 2021
[πΎ Github] [π¦ Tweet] -
Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning
βοΈγXisen Jin, Bill Yuchen Lin, Mohammad Rostami, Xiang Ren
π’γin Proc. of EMNLP 2021 Findings
[πΎ Github] -
RockNER: A Simple Method to Create Adversarial Examples for Evaluating the Robustness of NER Models
βοΈγBill Yuchen Lin, Wenyang Gao, Jun Yan, Ryan Moreno, Xiang Ren
π’γin Proc. of EMNLP 2021 (short)
Β [π Project Page] -
RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms
βοΈγPei Zhou, Rahul Khanna, Seyeon Lee, Bill Yuchen Lin, Daniel Ho, Jay Pujara, Xiang Ren
π’γin Proc. of EMNLP 2021
Β [π Project Page] -
Probing Commonsense Explanation in Dialogue Response Generation
βοΈγPei Zhou, Pegah Jandaghi, Hyundong Cho, Bill Yuchen Lin, Jay Pujara, Xiang Ren
π’γin Proc. of EMNLP 2021 Findings -
Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoning
βοΈγBill Yuchen Lin, Seyeon Lee, Xiaoyang Qiao, Xiang Ren
π’γin Proc. of ACL 2021
[πΎ Github] Β Β [π Project Page] -
RiddleSense: Reasoning about Riddle Questions Featuring Linguistic Creativity and Commonsense Knowledge
βοΈγBill Yuchen Lin, Ziyi Wu, Yichi Yang, Dong-Ho Lee, Xiang Ren
π’γin Proc. of ACL 2021 Findings
[πΎ Github] Β Β [π Project Page] -
Differentiable Open-Ended Commonsense Reasoning
βοΈγBill Yuchen Lin, Haitian Sun, Bhuwan Dhingra, Manzil Zaheer, Xiang Ren, William W. Cohen
π’γin Proc. of NAACL 2021
[πΌοΈ Slides] Β Β [π¦ Video] Β Β [πΎ Github] Β Β [π Project Page] -
Pre-training Text-to-Text Transformers for Concept-Centric Common Sense
βοΈγWangchunshu Zhou, Dong-Ho Lee, Ravi Kiran Selvam, Seyeon Lee, Bill Yuchen Lin, Xiang Ren
π’γin Proc. of ICLR 2021 Β
[πΎ Github] -
IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization
βοΈγWenxuan Zhou, Bill Yuchen Lin, Xiang Ren
π’γin Proc. of AAAI 2021
2020
-
CommonGen: A Constrained Text Generation Challenge for Generative Commonsense Reasoning
βοΈγBill Yuchen Lin, Wangchunshu Zhou, Ming Shen, Pei Zhou, Chandra Bhagavatula, Yejin Choi, Xiang Ren
π’γin Proc. of EMNLP 2020 Findings Β Β (presented at AKBC 2020 as a non-archival paper.)
[π Project Page]
Media coverage : The Register , Tech Xplore , Techzine , Radio.com , ScienceDaily , USC Viterbi -
Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Models
βοΈγBill Yuchen Lin, Seyeon Lee, Rahul Khanna, Xiang Ren
π’γin Proc. of EMNLP 2020 (short)
[π Project Page] -
Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering
βοΈγYanlin Feng*, Xinyue Chen*, Bill Yuchen Lin, Peifeng Wang, Jun Yan, Xiang Ren
π’γin Proc. of EMNLP 2020
[πΎ Github] - FreeDOM: A Transferable Neural Architecture for Structured Information Extraction on Web Documents
βοΈγBill Yuchen Lin, Ying Sheng, Nguyen Vo and Sandeep Tata
π’γin Proc. of KDD 2020 (Research Track)
[πΌοΈ Slides] [π¦ Video] -
TriggerNER: Learning with Entity Triggers as Explanations for Named Entity Recognition
βοΈγBill Yuchen Lin*, Dongho Lee*, Ming Shen, Ryan Moreno, Xiao Huang, Prashant Shiralkar, Xiang Ren
π’γin Proc. of ACL 2020 (short)
[πΌοΈ Slides] Β Β [π¦ Video] Β Β [πΎ Github] Β Β [π Project Page] -
Learning to Contextually Aggregate Multi-Source Supervision for Sequence Labeling.
βοΈγOuyu Lan, Xiao Huang, Bill Yuchen Lin, He Jiang, Liyuan Liu, Xiang Ren
π’γin Proc. of ACL 2020
[πΎ Github] -
LEAN-LIFE: A Label-Efficient Annotation Framework Towards Learning from Explanation
βοΈγDong-Ho Lee, Rahul Khanna, Bill Yuchen Lin, Jamin Chen, Seyeon Lee, Qinyuan Ye, Elizabeth Boschee, Leonardo Neves, Xiang Ren
π’γin Proc. of ACL 2020 (Demo Track)
[π Project Page] - NERO: A Neural Rule Grounding Framework for Label-Efficient Relation Extraction.
βοΈγWenxuan Zhou, Hongtao Lin, Bill Yuchen Lin, Ziqi Wang, Junyi Du, Leonardo Neves, Xiang Ren
π’γin Proc. of TheWebConf (WWW) 2020
Best Paper Runner-up (2/1500+) Β Β [πΎ Github]
2019
- KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoning.
βοΈγBill Yuchen Lin, Xinyue Chen, Jamin Chen, Xiang Ren
π’γin Proc. of EMNLP-IJCNLP 2019
[πΎ Github] - AlpacaTag: An Active Learning-based Crowd Annotation Framework for Sequence Tagging.
βοΈγBill Yuchen Lin*, Dongho Lee*, Frank F. Xu, Ouyu Lan, Xiang Ren
π’γin Proc. of ACL 2019 (Demo Track)
[π Project Page]
2018
- Neural Adaptation Layers for Cross-domain Named Entity Recognition.
βοΈγBill Yuchen Lin, Wei Lu
π’γin Proc. of EMNLP 2018
[πΎ Github] - ExtRA: Extracting Prominent Review Aspects from Customer Feedback.
βοΈγZhiyi Luo, Shanshan Huang, Frank F. Xu, Bill Yuchen Lin, Hanyuan Shi, Kenny Q. Zhu
π’γin Proc. of EMNLP 2018
[πΎ Github] - Mining Cross-Cultural Differences and Similarities in Social Media.
βοΈγBill Yuchen Lin*, Frank F. Xu*, Kenny Q. Zhu, Seung-won Hwang
π’γin Proc. of ACL 2018
[πΎ Github] - Automatic Extraction of Commonsense LocatedNear Knowledge.
βοΈγFrank F. Xu*, Bill Yuchen Lin*, Kenny Q. Zhu
π’γin Proc. of ACL 2018 (short)
[πΎ Github]
2017
- Multi-channel BiLSTM-CRF Model for Emerging Named Entity Recognition in Social Media.
βοΈγBill Y. Lin*, Frank F. Xu*, Zhiyi Luo, Kenny Q. Zhu
π’γin Proc. of EMNLP 2017, Workshop on Noisy User-generated Text
[πΎ Github]