Joshua Zhanson

Mount Washington Trail, WA

Email: joshspam at jzhanson dot com

Resume, CV (under construction)

I'm an incoming Master's of Language Technologies student at Carnegie Mellon University. I graduated B.S. in Computer Science with a minor in Machine Learning from Carnegie Mellon University in May 2020.

I'm broadly interested in leveraging structure to tackle tough problems, such as robotic control in deep reinforcement learning and learning control from language.

I'm passionate about teaching and undergraduate research. I have fun organizing events. I also occasionally write instructive blog posts.

In my spare time, I love hiking, biking, running, and the great outdoors. I also board games and playing tabletop RPGs.



Proprioceptive Spatial Representations for Generalized Locomotion

Joshua Zhanson, Emilio Parisotto, Ruslan Salakhutdinov

pdf, video, website, code (coming soon)

Workshop on Structure and Priors in Reinforcement Learning (SPiRL) at ICLR 2019

A body-space state representation that implicitly encodes relative positional information by mapping sensor readings onto a spatial grid over the robot’s body facilitates learning of a general locomotion policy transferable across many randomized body configurations with different balances and requiring different walking gaits.


15-213 Introduction to Computer Systems

TA, Summer 2020

10-703 Deep Reinforcement Learning and Control

TA, Fall 2019

I updated and released homeworks on policy gradient methods and other topics, held office hours, and wrote in quiz and exam questions.

15-300 Research and Innovation in Computer Science

TA, Fall 2019

I help equip students with the tools needed to get involved in and effectively carry out undergraduate research. I also provide mentorship and support during undergraduate research projects and coaching on topics such as academic writing and presenting research to an academic and non-academic audience.

15-213 Introduction to Computer Systems

TA, Summer 2019

I developed active learning lecture activities on system-level I/O, network protocols, and participated in development for activities on bit-level representations, machine programming, and exceptional control flow (processes and signals). I also scaled and benchmarked memory access traces to evaluate student dynamic memory allocator submissions.



15-410 Pebbles Kernel "jOSh"

With Joshua Kalapos.

For 15-410 Operating System Design and Implementation, Spring 2020

We built an Unix-like operating system kernel with support for tasks and threads, paging and multiple virtual memory address spaces, scheduling and sleeping, and context switching and preemptive multitasking to run on real x86 IA-32 Intel hardware.


Parallel Monte Carlo Tree Search for Tak

With Eric Nie.

Final project for 15-418 Parallel Computer Architecture and Programming, Spring 2019

We implemented and benchmarked a leaf-parallelized, root-parallelized, and tree-parallelized Monte Carlo Tree Search agent to play the fantasy board game Tak.



I implemented and trained Advantage Actor-Critic agent to reach 200+ average reward per episode over 100 episodes and max reward of 428 on OpenAI Gym Breakout-v0 environment. I also wrote a blog post about it.



With Shreyan Bakshi and Eric Nie.

Final project for 10-703 Deep Reinforcement Learning and Control, Spring 2018

We implemented Snake in Python as a single-agent and multi-agent OpenAI Gym environment and successfully trained DDQN and A2C on both environments. Then, we patched up the abandoned OpenAI Universe and trained A2C on the online multiplayer game against real humans.



Former Director of Events

It's my fourth year organizing CMU's largest annual hackathon TartanHacks. I gave a tech talk on Git and using the Bash terminal at tech talk event Crash Course. Later, I organized and mentored other speakers for tech talk events Web Dev Weekend and Crash Course.

Salmon Days

Previously, I volunteered at Issaquah, WA's annual Salmon Days festival celebrating the return of almost two tons of salmon as a general-purpose can-do problem solver on the legendary "Ofishal XStream Team."