Andrew Wagenmaker

Andrew Wagenmaker 

Andrew Wagenmaker
Paul G. Allen School of Computer Science & Engineering
University of Washington

ajwagen@cs.washington.edu
Office: CSE2 231
Gates Center for Computer Science & Engineering
University of Washington
Seattle, WA 98195


I am a sixth-year PhD student in Computer Science at the University of Washington working with Kevin Jamieson. I have also spent time at Microsoft Research, mentored by Dylan Foster, as well as the Simons Institute, and my work has been supported by an NSF Graduate Research Fellowship. Previously, I completed a master's and bachelor's degree at the University of Michigan, both in Electrical Engineering. While at the University of Michigan, I worked with Raj Rao Nadakuditi and Necmiye Ozay.

My research centers on developing learning-based algorithms for decision-making in sequential environments. In particular, much of my work has focused on obtaining better-than-worst-case guarantees for reinforcement learning and learning in dynamical systems, and algorithms which provably adapt to the difficulty of, and perform optimally on, each particular problem instance.

Publications

Optimal Exploration for Model-Based RL in Nonlinear Systems
Andrew Wagenmaker, Guanya Shi, and Kevin Jamieson
NeurIPS, 2023 (Spotlight)

Instance-Optimality in Interactive Decision Making: Toward a Non-Asymptotic Theory
Andrew Wagenmaker and Dylan Foster
COLT, 2023 [Talk]

Leveraging Offline Data in Online Reinforcement Learning
Andrew Wagenmaker and Aldo Pacchiano
ICML, 2023

Instance-Dependent Near-Optimal Policy Identification in Linear MDPs via Online Experiment Design
Andrew Wagenmaker and Kevin Jamieson
NeurIPS, 2022

Active Learning with Safety Constraints
Romain Camilleri, Andrew Wagenmaker, Jamie Morgenstern, Lalit Jain, and Kevin Jamieson
NeurIPS, 2022

Reward-Free RL is No Harder Than Reward-Aware RL in Linear Markov Decision Processes
Andrew Wagenmaker, Yifang Chen, Max Simchowitz, Simon S. Du, and Kevin Jamieson
ICML, 2022

First-Order Regret in Reinforcement Learning with Linear Function Approximation: A Robust Estimation Approach
Andrew Wagenmaker, Yifang Chen, Max Simchowitz, Simon S. Du, and Kevin Jamieson
ICML, 2022 (Long Talk) [Talk]

Beyond No Regret: Instance-Dependent PAC Reinforcement Learning
Andrew Wagenmaker, Max Simchowitz, and Kevin Jamieson
COLT, 2022 [Talk]

Best Arm Identification with Safety Constraints
Zhenlin Wang, Andrew Wagenmaker, and Kevin Jamieson
AISTATS, 2022

Task-Optimal Exploration in Linear Dynamical Systems
Andrew Wagenmaker, Max Simchowitz, and Kevin Jamieson
ICML, 2021 (Long Talk)

Experimental Design for Regret Minimization in Linear Bandits
Andrew Wagenmaker*, Julian Katz-Samuels*, and Kevin Jamieson
AISTATS, 2021

Active Learning for Identification of Linear Dynamical Systems
Andrew Wagenmaker and Kevin Jamieson
COLT, 2020 [Talk]

Robust Photometric Stereo via Dictionary Learning
Andrew Wagenmaker, Brian Moore, and Raj Rao Nadakuditi
IEEE Transactions on Computational Imaging, 2018

Robust Photometric Stereo Using Learned Image and Gradient Dictionaries
Andrew Wagenmaker, Brian Moore, and Raj Rao Nadakuditi 
ICIP, 2017

Robust Surface Reconstruction from Gradients via Adaptive Dictionary Regularization
Andrew Wagenmaker, Brian Moore, and Raj Rao Nadakuditi
ICIP, 2017

A Bisimulation-Like Algorithm for Abstracting Control Systems
Andrew Wagenmaker and Necmiye Ozay
Allerton, 2016

Preprints

Fair Active Learning in Low-Data Regimes
Romain Camilleri, Andrew Wagenmaker, Jamie Morgenstern, Lalit Jain, and Kevin Jamieson
Preprint, 2023