Bold titles indicate strongly peer-reviewed conference papers.
Red titles indicate journal articles.


Importance Sampling Policy Evaluation with an Estimated Behavior Policy
Josiah P. Hanna, Scott Niekum, Peter Stone.
arXiv Pre-print, June 2018.
Abstract     BibTeX     Download: [arXiv]

Towards a Data Efficient Off-Policy Policy Gradient
Josiah P. Hanna, Peter Stone.
In AAAI Spring Symposium on Data Efficient Reinforcement Learning, March 2018.
Abstract     BibTeX     Download: [pdf] (2.5MB )

DyETC: Dynamic Electronic Toll Collection for Traffic Congestion Alleviation.
Haipeng Chen, Bo An, Guni Sharon, Josiah P. Hanna, Peter Stone, Chunyan Miao, and Yeng Chai Soh.
In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI-18), February 2018.
Abstract     BibTeX     Download: [pdf] (2.5MB )


Data-efficient Policy Evaluation through Behavior Policy Search.
Josiah P. Hanna, Phil Thomas, Peter Stone, and Scott Niekum.
In Proceedings of the 34th International Conference on Machine Learning (ICML 2017), August 2017.
Abstract     BibTeX     Download: [pdf] (1.2MB )

Fast and Precise Black and White Ball Detection for RoboCup Soccer.
Jacob Menashe, Josh Kelle, Katie Genter, Josiah P. Hanna, Elad Liebman, Sanmit Narvekar, Ruohan Zhang, and Peter Stone.
In RoboCup-2017: Robot Soccer World Cup XXI, July 2017.
Abstract     BibTeX     Download: [pdf] (260kB )

Bootstrapping with Models: Confidence Intervals for Off-Policy Evaluation.
Josiah P. Hanna, Peter Stone, and Scott Niekum.
In Proceedings of the 16th Conference on Autonomous Agents and Multi-Agent Sytems (AAMAS 2017), May 2017.
Abstract     BibTeX     Download: [pdf] (663.8kB )

Network-wide Adaptive Tolling for Connected and Automated vehicles.
Guni Sharon, Michael W. Levin, Josiah P. Hanna, Tarun Rambha, Stephen D. Boyles, and Peter Stone.
Transportation Research Part C 84:142-157, September 2017
This article contains material that was previously published in an AAMAS-17 paper.
Abstract     BibTeX     Download: [pdf] (2.9MB )

Grounded Action Transformation for Robot Learning in Simulation.
Josiah Hanna and Peter Stone.
In Proceedings of the 31st AAAI Conference on Artificial Intelligence (AAAI-17), February 2017.
Abstract     BibTeX     Download: [pdf] (1.3MB )


Minimum Cost Matching for Autonomous Carsharing.
Josiah P. Hanna, Michael Albert, Donna Chen, and Peter Stone
In Proceedings of the 9th IFAC Symposium on Intelligent and Autonomous Vehicles 2016 (IAV 2016), June 2016.
Abstract     BibTeX     Download: [pdf] (117.5kB)

Operations of a shared, autonomous, electric vehicle fleet: Implications of vehicle & charging infrastructure decisions.
Donna Chen, Kara M Kockelman, Josiah Hanna.
Transportation Research Part A: Policy and Practice 94, 243-254
Abstract     BibTeX     Article


UT Austin Villa: RoboCup 2015 3D Simulation League Competition and Technical Challenges Champions.
Patrick MacAlpine, Josiah Hanna, Jason Liang, and Peter Stone.
In Luis Almeida, Jianmin Ji, Gerald Steinbauer, and Sean Luke, editors, RoboCup-2015: Robot Soccer World Cup XIX, Lecture Notes in Artificial Intelligence, Springer Verlag, Berlin, 2016.
Accompanying videos at
Abstract -->    BibTeX     Download: [pdf] (790.2kB )  


Approximation of Lorenz-optimal Solutions in Multi-objective Markov Decision Processes.
P Perny, P Weng, J Goldsmith, and Josiah Hanna
In Proceedings of the International Conference on Uncertainty in Artificial Intelligence (UAI), July 2013.
Abstract     BibTeX     Download: [pdf] (424kB)


The Academic Advising Planning Domain.
JT Guerin, Josiah Hanna, L Ferland, N Mattei, J Goldsmith.
In Proceedings of the 3rd Workshop on the International Planning Competition at the International Conference on Automated Planning and Scheduling, July 2012.
Abstract     BibTeX     Download: [pdf] (1.2MB)