Home

Papers

Refereed Conference Publications

Selective Annotation Makes Language Models Better Few-Shot Learners
Hongjin Su, Jungo Kasai, Chen Henry Wu, Weijia Shi, Tianlu Wang, Jiayi Xin, Rui Zhang, Mari Ostendorf, Luke Zettlemoyer, Noah A. Smith, and Tao Yu.
In Proceedings of the International Conference on Learning Representations (ICLR), 2023.   PDF Code
Twist Decoding: Diverse Generators Guide Each Other
Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Hao Peng, Ximing Lu, Dragomir Radev, Yejin Choi, and Noah A. Smith.
In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022.   PDF Code
GENIE: A Leaderboard for Human-in-the-Loop Evaluation of Text Generation
Daniel Khashabi, Gabriel Stanovsky, Jonathan Bragg, Nicholas Lourie, Jungo Kasai, Yejin Choi, Noah A. Smith, and Daniel S. Weld.
In Proceedings of the Conference on Empirical Methods in 5 Natural Language Processing (EMNLP), 2022.   PDF
How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers
Daniel Khashabi, Gabriel Stanovsky, Jonathan Bragg, Nicholas Lourie, Jungo Kasai, Yejin Choi, Noah A. Smith, and Daniel S. Weld.
In Findings of the Association for Computational Linguistics: EMNLP 2022, 2022.   PDF Code
Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand
Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Lavinia Dunagan, Jacob Morrison, Alexander R. Fabbri, Yejin Choi, and Noah A. Smith.
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistic (NAACL), 2022.   PDF Website
Transparent Human Evaluation for Image Captioning
Jungo Kasai, Keisuke Sakaguchi, Lavinia Dunagan, Jacob Morrison, Ronan Le Bras, Yejin Choi, and Noah A. Smith.
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistic (NAACL), 2022.   PDF Website
NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics
Ximing Lu, Sean Welleck, Peter West, Liwei Jiang, Jungo Kasai, Daniel Khashabi, Ronan Le Bras, Lianhui Qin, Youngjae Yu, Rowan Zellers, Noah A. Smith, and Yejin Choi.
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistic (NAACL), 2022.   PDF
Best Paper Award
ABC: Attention with Bounded-memory Control
Hao Peng, Jungo Kasai, Nikolaos Pappas, Dani Yogatama, Zhaofeng Wu, Lingpeng Kong, Roy Schwartz, and Noah A. Smith.
In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2022.   PDF
Finetuning Pretrained Transformers into RNNs
Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, and Noah A. Smith.
In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021.   PDF
Probing across Time: What does RoBERTa know and when?
Leo Z. Liu,* Yizhong Wang,* Jungo Kasai, Hannaneh Hajishirzi, and Noah A. Smith.
In Findings of the Association for Computational Linguistics: EMNLP 2021, 2021.   PDF
One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrieval
Akari Asai, Xinyan Yu, Jungo Kasai, and Hannaneh Hajishirzi.
In Proceedings of Advances in Neural Information Processing Systems (NeurIPS), 2021.   PDF
Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation
Jungo Kasai, Nikolaos Pappas, Hao Peng, James Cross, and Noah A. Smith.
In Proceedings of the Conference of the International Conference on Learning Representations (ICLR), 2021.   PDF
XOR QA: Cross-lingual Open-Retrieval Question Answering
Akari Asai, Jungo Kasai, Jonathan H. Clark, Kenton Lee, Eunsol Choi, and Hannaneh Hajishirzi.
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistic (NAACL), 2021.   PDF
Findings of the 2021 Conference on Machine Translation (WMT21)
Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska, Ondřej Bojar, Rajen Chatterjee, Vishrav Chaudhary, Marta R. Costa-jussa, Cristina España-Bonet, Angela Fan, Christian Federmann, Markus Freitag, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Leonie Harter, Kenneth Heafield, Christopher Homan, Matthias Huck, Kwabena Amponsah-Kaakyire, Jungo Kasai, Daniel Khashabi, Kevin Knight, Tom Kocmi, Philipp Koehn, Nicholas Lourie, Christof Monz, Makoto Morishita, Masaaki Nagata, Ajay Nagesh, Toshiaki Nakazawa, Matteo Negri, Santanu Pal, Allahsera Auguste Tapo, Marco Turchi, Valentin Vydrin, and Marcos Zampieri.
In Proceedings of the Conference on Machine Translation (WMT), 2021.   PDF
Non-autoregressive Machine Translation with Disentangled Context Transformer
Jungo Kasai, James Cross, Marjan Ghazvininejad, and Jiatao Gu.
In Proceedings of the International Conference on Machine Learning (ICML), 2020.   PDF Code
Low-resource Parsing with Crosslingual Contextualized Representations
Phoebe Mulcaire,* Jungo Kasai,* and Noah A. Smith.
In Proceedings of the Conference on Computational Natural Language Learning (CoNLL), 2019.   PDF Code
Low-resource Deep Entity Resolution with Transfer and Active Learning
Jungo Kasai, Kun Qian, Sairam Gurajada, Yunyao Li, and Lucian Popa.
In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2019.   PDF
Syntax-aware Neural Semantic Role Labeling with Supertags
Jungo Kasai, Dan Friedman, Robert Frank, Dragomir Radev, and Owen Rambow.
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistic (NAACL), 2019.   PDF BibTex
Polyglot Contextual Representations Improve Crosslingual Transfer
Phoebe Mulcaire, Jungo Kasai, and Noah A. Smith.
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistic (NAACL), 2019.   PDF Code
ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networks
Michihiro Yasunaga, Jungo Kasai, Rui Zhang, Alexander Fabbri, Irene Li, Dan Friedman, and Dragomir Radev.
In Proceedings of the Conference of the Conference on Artificial Intelligence (AAAI), 2019.   PDF BibTex
Jabberwocky Parsing: Dependency Parsing with Lexical Noise
Jungo Kasai and Robert Frank.
In Proceedings of the Society for Computation in Linguistics (SCiL), 2019.   PDF BibTex Code
End-to-end Graph-based TAG Parsing with Neural Networks
Jungo Kasai, Robert Frank, Pauli Xu, William Merrill, and Owen Rambow.
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistic (NAACL), 2018.   PDF BibTex Code
Robust Multilingual Part-of-Speech Tagging via Adversarial Training
Michihiro Yasunaga, Jungo Kasai, and Dragomir Radev.
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistic (NAACL), 2018.   PDF BibTex Code
TAG Parsing with Neural Networks and Vector Representations of Supertags
Jungo Kasai, Robert Frank, R. Thomas McCoy, Owen Rambow, and Alexis Nasr.
In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2017.   PDF BibTex Code

Preprints

NarrowBERT: Accelerating Masked Language Model Pretraining and Inference
Haoxin Li, Phillip Keung, Daniel Cheng, Jungo Kasai, and Noah A. Smith. Preprint 2023.   PDF
RealTime QA: What's the Answer Right Now?
Jungo Kasai, Keisuke Sakaguchi, Yoichi Takahashi, Ronan Le Bras, Akari Asai, Xinyan Yu, Dragomir Radev, Noah A. Smith, Yejin Choi, and Kentaro Inui. Preprint 2022.   PDF Code Website
Beam Decoding with Controlled Patience
Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Dragomir Radev, Yejin Choi, and Noah A. Smith. Preprint 2022.   PDF Code
FOLIO: Natural Language Reasoning with First-Order Logic.
Simeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi, Martin Riddell, Luke Benson, Lucy Sun, Ekaterina Zubova, Yujie Qiao, Matthew Burtell, David Peng, Jonathan Fan, Yixin Liu, Brian Wong, Malcolm Sailor, Ansong Ni, Linyong Nan, Jungo Kasai, Tao Yu, Rui Zhang, Shafiq Joty, Alexander R. Fabbri, Wojciech Kryscinski, Xi Victoria Lin, Caiming Xiong, and Dragomir Radev. Preprint 2022.   PDF Code

Refereed Workshop Publications

MIA 2022 Shared Task: Evaluating Cross-lingual Open-Retrieval Question Answering for 16 Diverse Languages
Akari Asai, Shayne Longpre, Jungo Kasai, Chia-Hsuan Lee, Rui Zhang, Junjie Hu, Ikuya Yamada, Jonathan H Clark, and Eunsol Choi.
In Proceedings the Workshop on Multilingual Information Access (MIA), 2022.   PDF
Cracking the Contextual Commonsense Code: Understanding Commonsense Reasoning Aptitude of Deep Contextual Representations
Jeff Da and Jungo Kasai.
In Proceedings the Workshop on Commonsense Inference in Natural Language Processing (COIN), 2019.   PDF
Linguistically Rich Vector Representations of Supertags for TAG Parsing
Dan Friedman,* Jungo Kasai,* R. Thomas McCoy,* Robert Frank, Owen Rambow, and Forrest Davis.
In Proceedings of the Workshop on Tree Adjoining Grammars and Related Formalisms (TAG+), 2017.   PDF BibTex
TAG Parsing Evaluation using Textual Entailments
Pauli Xu, Robert Frank, Jungo Kasai, and Owen Rambow.
In Proceedings of the Workshop on Tree Adjoining Grammars and Related Formalisms (TAG+), 2017.   PDF BibTex

Other Publications

Mediastinal hematoma associated with radiofrequency catheter ablation of atrial fibrillation
Takayuki Kitai, Yuhei Kasai, Jungo Kasai, Junji Morita, and Tsutomu Fujita.
Circulation Journal, 2022.   PDF
Removing pericardial drainage tube for acute cardiac tamponade associated with catheter ablation of atrial fibrillation can trigger hemoperitoneum from severe liver bleeding
Yuhei Kasai, Jungo Kasai, So Asano, Takahiko Nagase, Yukio Sekiguchi, and Junichi Nitt.
Heart Rhythm Case Reports, 2022.   PDF
Revisiting where to apply preimplant mapping to improve P-wave sensing of insertable cardiac monitors
Yuhei Kasai, Jungo Kasai, Syuichi Sahashi, Sandeep Shakya, Hiroki Kuji, Naoki Hayakawa, Kotaro Miyaji, and Junji Kanda.
Journal of Arrhythmia, 2022.   PDF
Idiopathic premature ventricular contractions originating from the distal Purkinje fiber network of the right bundle branch
Yuhei Kasai, Jungo Kasai, Yukio Sekiguchi, Takahiko Nagase, and Junichi Nitta.
Journal of Arrhythmia, 2022.   PDF
Apple Watch facilitates single-session catheter ablation of coexisting atrioventricular nodal reentrant tachycardia and atrioventricular reentrant tachycardia
Yuhei Kasai, Jungo Kasai, Yukio Sekiguchi, So Asano, Hiroshi Fukunaga, Takahiko Nagase, and Junichi Nitta.
Clinical Case Reports, 2021.   PDF

* Equal Contribution.