Jae Sung Park

Jae Sung (James) Park

I am a PhD student at University of Washington in Computer Science and Engineering advised by Yejin Choi and Ali Farhadi. Previously, I received my B.S. degree in EECS at University of California, Berkeley, where I worked closely with Anna Rohrbach and Trevor Darrell .

I am interested in how machines use visual perception and language understanding to reason about the visual world in a way humans do. Specifically, my research projects have been focused on:

Empowering Visual Commonsense Reasoning of AI models
Grounding Objects, Concepts, Actions to Images and Videos
Evaluation of Multimodal Language Models

Email / Google Scholar / Github

Experience

Internship @ Microsoft Research Deep Learning Team in Spring 2022 - Summer 2023.
Internship @ Amazon Alexa AI Team in Winter 2022.
Internship @ AI2 Mosaic Team in Winter 2020.
Co-organized Large Scale Movie Description Challenge 2019 appeared in ICCV19 CLVL workshop.
Started PhD at University of Washington in Fall 2019 - Present.

Publications

Localized Symbolic Knowledge Distillation for Visual Commonsense Models
Jae Sung Park, Jack Hessel, Khyathi Chandu, Paul Pu Liang, Ximing Lu, Peter West, Youngjae Yu, Qiuyuan Huang, Jianfeng Gao, Ali Farhadi, Yejin Choi
Neurips, 2023
arXiv

Multimodal knowledge alignment with reinforcement learning
Youngjae Yu, Jiwan Chung, Heeseung Yun, Jack Hessel, Jae Sung Park, Ximing Lu, Prithviraj Ammanabrolu, Rowan Zellers, Ronan Le Bras, Gunhee Kim, Yejin Choi
CVPR, 2023
arXiv

Exposing the limits of video-text models through contrast sets
Jae Sung Park, Sheng Shen, Ali Farhadi, Trevor Darrell, Yejin Choi, Anna Rohrbach
NAACL (short), 2022
arXiv / code

Merlot: Multimodal neural script knowledge models
Rowan Zellers, Ximing Lu, Jack Hessel, Youngjae Yu, Jae Sung Park, Jize Cao, Ali Farhadi, Yejin Choi
Neurips, 2021
arXiv

LLC: Accurate, multi-purpose learnt low-dimensional binary codes
Aditya Kusupati, Matthew Wallingford, Vivek Ramanujan, Raghav Somani, Jae Sung Park, Krishna Pillutla, Prateek Jain, Sham Kakade, Ali Farhadi
Neurips, 2021
arXiv

Natural language rationales with full-stack visual reasoning: From pixels to semantic frames to commonsense graphs
Ana Marasović, Chandra Bhagavatula, Jae Sung Park, Ronan Le Bras, Noah A Smith, Yejin Choi
Findings of EMNLP, 2020
arXiv

VisualCOMET: Reasoning about the Dynamic Context of a Still Image
Jae Sung Park, Chandra Bhagavatula, Roozbeh Mottaghi, Ali Farhadi, Yejin Choi
ECCV, 2020 (Spotlight)
project page / arXiv / code

Identity Aware Multi-Sentence Video Description
Jae Sung Park, Trevor Darrell, Anna Rohrbach
ECCV, 2020
project page / arXiv

Adversarial Inference for Multi-Sentence Video Description
Jae Sung Park, Marcus Rohrbach, Trevor Darrell, Anna Rohrbach
CVPR, 2019 (Oral)
arxiv / code

Service

	Large Scale Movie Description Challenge 2019 Co-organizer
	CSE 599/G1: Intro to Deep Learning, Fall 2019 Teaching Assistant

Website template from here and here.