Generating Animated Videos of Human Activities from Natural Language Descriptions (2018)
Angela S. Lin, Lemeng Wu, Rodolfo Corona , Kevin Tai , Qixing Huang , Raymond J. Mooney
Generating realistic character animations is of great importance in computer graphics and related domains. Existing approaches for this application involve a significant amount of human interaction. In this paper, we introduce a system that maps a natural language description to an animation of a humanoid skeleton. Our system is a sequence-to-sequence model that is pretrained with an autoencoder objective and then trained end-to-end.
In Proceedings of the Visually Grounded Interaction and Language Workshop at NeurIPS 2018, December 2018.

Rodolfo Corona Undergraduate Alumni rud721 [at] gmail com
Angela S. Lin Masters Alumni alin [at] cs utexas edu
Raymond J. Mooney Faculty mooney [at] cs utexas edu