I am interested in model-based hierarchical reinforcement learning and monte-carlo search methods. My goal is to design learning algorithms that allow agents to balance intrinsic and extrinsic rewards in large or infinite environments with complex action dynamics. My current work seeks to do this in the context of an expansive world filled with skills, resources, and adversaries, similar to Ultima Online.