Peter West
he/him | github | LinkedIn | Google Scholar | pawest at cs dot washington dot edu
→ I am currently on the academic job market (2023/2024) ←
Hi! I’m Peter West, a PhD candidate working on Natural Language Processing and AI at the University of Washington (UW). I work with Yejin Choi on generative models, unsupervised methods, and generation techniques. My broad goal is reducing the capability gap between small to medium-scale language models and extreme scale frontier models. I tend to approach this problem by designing learning and inference algorithms to unlock capabilities in smaller models, often with themes of dataset generation and information theory. In parallel, I study these capabilities and their limits, particularly in how frontier models diverge from human expectations.
Previously, I received a Bachelor of Science (Honours Computer Science) from the University of British Columbia in 2017. I have been an intern at the Allen Institute for AI on the Mosaic team and Microsoft Research in the Natural Language Processing Group
Outside of research, I love cooking, making bread, pasta, or ice cream. Also cocktails. I love movies of all kinds, and music.
Publications
Recent Preprints
The Generative AI Paradox: "What It Can Create, It May Not Understand"
arXiv.2311.00059
Peter West, Ximing Lu, Nouha Dziri, Faeze Brahman, Linjie Li, Jena D. Hwang, Liwei Jiang, Jillian Fisher, Abhilasha Ravichander, Khyathi Chandu, Benjamin Newman, Pang Wei Koh, Allyson Ettinger, Yejin Choi
[paper]
Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties
arXiv.2309.00779
Taylor Sorensen, Liwei Jiang, Jena Hwang, Sydney Levine, Valentina Pyatkin, Peter West, Nouha Dziri, Ximing Lu, Kavel Rao, Chandra Bhagavatula, Maarten Sap, John Tasioulas, Yejin Choi
[paper]
Generative Models as a Complex Systems Science: How can we make sense of large language model behavior?
arXiv:2308.00189
Ari Holtzman, Peter West, Luke Zettlemoyer
[paper]
Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasing
arXiv:2305.16635
Jaehun Jung, Peter West, Liwei Jiang, Faeze Brahman, Ximing Lu, Jillian Fisher, Taylor Sorensen, Yejin Choi
[paper]
Recent Publications
Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning
EMNLP 2023
Ximing Lu, Faeze Brahman, Peter West, Jaehun Jung, Khyathi Chandu, Abhilasha Ravichander, Lianhui Qin, Prithviraj Ammanabrolu, Liwei Jiang, Sahana Ramnath, Nouha Dziri, Jillian Fisher, Bill Yuchen Lin, Skyler Hallinan, Xiang Ren, Sean Welleck, Yejin Choi
[paper]
We're Afraid Language Models Aren't Modeling Ambiguity
EMNLP 2023
Alisa Liu, Zhaofeng Wu, Julian Michael, Alane Suhr, Peter West, Alexander Koller, Swabha Swayamdipta, Noah A Smith, Yejin Choi
[paper]
NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation
Findings of EMNLP 2023
Peter_West, Ronan Le Bras, Taylor Sorensen, Bill Yuchen Lin, Liwei Jiang, Ximing Lu, Khyathi Chandu, Jack Hessel, Ashutosh Baheti, Chandra Bhagavatula, Yejin Choi
Faith and Fate: Limits of Transformers on Compositionality
Neurips 2023 (Spotlight)
Nouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li, Liwei Jiang, Bill Yuchen Lin, Peter West, Chandra Bhagavatula, Ronan Le Bras, Jena D. Hwang, Soumya Sanyal, Sean Welleck, Xiang Ren, Allyson Ettinger, Zaid Harchaoui, Yejin Choi
[paper]
Minding Language Models'(Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Tracker
ACL 2023 Outstanding Paper Award!
Melanie Sclar, Sachin Kumar, Peter West, Alane Suhr, Yejin Choi, Yulia Tsvetkov
[paper]
I2D2: Inductive Knowledge Distillation with NeuroLogic and Self-Imitation
ACL 2023
Chandra Bhagavatula, Jena D. Hwang, Doug Downey, Ronan Le Bras, Ximing Lu, Lianhui Qin, Keisuke Sakaguchi, Swabha Swayamdipta, Peter West, Yejin Choi
[paper]
Generating Sequences by Learning to Self-Correct
ICLR 2023
=Sean Welleck, =Ximing Lu, ♡Peter West, ♡Faeze Brahman, Tianxiao Shen, Daniel Khashabi, Yejin Choi
= co-second author
♡ co-second author
[paper]
Quark: Controllable Text Generation with Reinforced Unlearning
Neurips 2022
Ximing Lu, Sean Welleck, Jack Hessel, Liwei Jiang, Lianhui Qin, Peter West, Prithviraj Ammanabrolu, Yejin Choi
[paper]
Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillation
EMNLP 2022
Melanie Sclar, Peter West, Sachin Kumar, Yulia Tsvetkov, Yejin Choi
[paper]
Symbolic knowledge distillation: from general language models to commonsense models
NAACL 2022
Peter West, Chandra Bhagavatula, Jack Hessel, Jena D Hwang, Liwei Jiang, Ronan Le Bras, Ximing Lu, Sean Welleck, Yejin Choi
[paper] [code and data]
NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics
NAACL 2022 Best Paper Award!
Ximing Lu, ♡Sean Welleck, ♡Peter West, Liwei Jiang, Jungo Kasai, Daniel Khashabi, Ronan Le Bras, Lianhui Qin, Youngjae Yu, Rowan Zellers, Noah A Smith, Yejin Choi
♡ co-second author
[paper]
Generated Knowledge Prompting for Commonsense Reasoning
ACL 2022
Jiacheng Liu, Alisa Liu, Ximing Lu, Sean Welleck, Peter West, Ronan Le Bras, Yejin Choi, Hannaneh Hajishirzi
[paper]
Symbolic Brittleness in Sequence Models: on Systematic Generalization in Symbolic Mathematics
AAAI 2021
Sean Welleck, Peter West, Jize Cao, Yejin Choi
[paper]
Surface Form Competition: Why the Highest Probability Answer Isn’t Always Right
EMNLP 2021
=Ari Holtzman, =Peter West, Vered Shwartz, Yejin Choi, and Luke Zettlemoyer
= equal contribution
[paper]
Reflective Decoding: Unsupervised Paraphrasing and Abductive Reasoning
ACL 2021
Peter West, Ximing Lu, Ari Holtzman, Chandra Bhagavatula, Jena Hwang, and Yejin Choi
[paper]
Neurologic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraints
NAACL 2021
Ximing Lu, Peter West, Rowan Zellers, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi
[paper]
Unsupervised Commonsense Question Answering with Self-Talk
EMNLP 2020
Vered Shwartz, Peter West, Ronan Le Bras, Chandra Bhagavatula, Yejin Choi
[paper]
Back to the Future: Unsupervised Backprop-based Decoding for Counterfactual and Abductive Commonsense Reasoning
EMNLP 2020
Lianhui Qin, Vered Shwartz, Peter West, Chandra Bhagavatula, Jena Hwang, Ronan Le Bras, Antoine Bosselut, Yejin Choi
[paper]
BottleSum: Self-Supervised and Unsupervised Sentence Summarization using the Information Bottleneck Principle
EMNLP 2019
Peter West, Ari Holtzman, Jan Buys, Yejin Choi
[paper]
Other Work
Adjusting for Confounders with Text: Challenges and an Empirical Evaluation Framework for Causal Inference 2020
Galen Weld, Peter West, Maria Glenski, David Arbour, Ryan Rossi, Tim Althoff
[paper]
PLink: Discovering and Exploiting Datacenter Network Locality for Efficient Cloud-based Distributed Training MLSYS 2020
Liang Luo, Peter West, Arvind Krishnamurthy, Luis Ceze, Jacob Nelson
[paper]
Refractometric micro-sensor using a mirrored capillary resonator Optics Express 2016
William Morrish, Peter West, Nathan Orlando, Elizaveta Klantsataya, Kirsty Gardner, Stephen Lane, Raymond Decorby, Alexandre François, Alkiviathes Meldrum
[paper]
Protein biosensing with fluorescent microcapillaries Optics Express 2015
Stephen Lane, Peter West, Alexandre François, Alkiviathes Meldrum
[paper]