I'm an second year Master's of Language Technologies student at Carnegie Mellon University graduating in August 2022 seeking full-time research engineer and machine learning engineer positions in computer vision, robotics, or NLP. I graduated B.S. in Computer Science with a minor in Machine Learning from Carnegie Mellon University in May 2020.
I'm broadly interested in leveraging structure to tackle tough problems, such as learning visual representations from embodied interaction, robotic control in deep reinforcement learning, and learning control from language.
In my spare time, I love hiking, biking, running, and the great outdoors. I also play board games and tabletop RPGs.
Saurabh Garg, Joshua Zhanson, Emilio Parisotto, Adarsh Prasad, J. Zico Kolter, Zachary C. Lipton, Sivaraman Balakrishnan, Ruslan Salakhutdinov, Pradeep Ravikumar
Proximal Policy Optimization, a policy gradient optimization algorithm commonly used in deep reinforcement learning, relies on an arsenal of heuristics to offset significant heavy-tailedness in its gradients, which we can elide with Geometric Median-of-Means, a high-dimensional estimator from robust statistics.
Joshua Zhanson, Emilio Parisotto, Ruslan Salakhutdinov
Workshop on Structure and Priors in Reinforcement Learning (SPiRL) at ICLR 2019
A body-space state representation that implicitly encodes relative positional information by mapping sensor readings onto a spatial grid over the robot’s body facilitates learning of a general locomotion policy transferable across many randomized body configurations with different balances and requiring different walking gaits.
TA, Fall 2020
TA, Summer 2020
I led development of new lecture activities and porting existing lecture activities to a virtual format. I also proposed and implemented a remote active learning lecture format and schedule, and coordinated staff attendance at virtual active learning lectures.
TA, Fall 2019
I updated and released homeworks on policy gradient methods and other topics, held office hours, and wrote in quiz and exam questions.
TA, Fall 2019
I help equip students with the tools needed to get involved in and effectively carry out undergraduate research. I also provide mentorship and support during undergraduate research projects and coaching on topics such as academic writing and presenting research to an academic and non-academic audience.
TA, Summer 2019
I developed active learning lecture activities on system-level I/O, network protocols, and participated in development for activities on bit-level representations, machine programming, and exceptional control flow (processes and signals). I also scaled and benchmarked memory access traces to evaluate student dynamic memory allocator submissions.
With Joshua Kalapos.
We built an Unix-like operating system kernel with support for tasks and threads, paging and multiple virtual memory address spaces, scheduling and sleeping, and context switching and preemptive multitasking to run on real x86 IA-32 Intel hardware.
With Eric Nie.
Final project for 15-418 Parallel Computer Architecture and Programming, Spring 2019
We implemented and benchmarked a leaf-parallelized, root-parallelized, and tree-parallelized Monte Carlo Tree Search agent to play the fantasy board game Tak.
With Shreyan Bakshi and Eric Nie.
Final project for 10-703 Deep Reinforcement Learning and Control, Spring 2018
We implemented Snake in Python as a single-agent and multi-agent OpenAI Gym environment and successfully trained DDQN and A2C on both environments. Then, we patched up the abandoned OpenAI Universe and trained A2C on the online multiplayer game slither.io against real humans.
Former Director of Events
It's my fourth year organizing CMU's largest annual hackathon TartanHacks. I gave a tech talk on Git and using the Bash terminal at tech talk event Crash Course. Later, I organized and mentored other speakers for tech talk events Web Dev Weekend and Crash Course.
Previously, I volunteered at Issaquah, WA's annual Salmon Days festival celebrating the return of almost two tons of salmon as a general-purpose can-do problem solver on the legendary "Ofishal XStream Team."