Text to Animation Reading Group

[ Meeting Schedule | Previous Discussions | Subscribe to Email List ]

The goal of the Text to Animation project is to connect natural language processing and graphics. The current focus of the project is on generating human motion animations from natural language descriptions. As a result, we read papers in the following topic areas: sequence-to-sequence modeling, motion modeling, text-to-pixels, and motion controller learning for animated characters.

Spring 2019 Meeting Time & Place

• Biweekly meetings in GDC 3.816 on Fridays from 3 p.m. to 4 p.m.

Scheduled Meetings

Date	Time	Place	Paper
05/03/19	3PM	GDC 3.816	Wenhao Yu, Greg Turk, and C.Karen Liu Learning Symmetric and Low-energy Locomotion, ACM Transactions on Graphics (SIGGRAPH), 2018 Demo video

* Future meetings subject to rearrangement.

* Please send in suggestions for new papers to discuss, or vote for a paper from the currently proposed papers.

Past Meetings

Date	Time	Place	Paper
04/19/19	3PM	GDC 3.816	Josh Merel, Leonard Hasenclever, Alexandre Galashov, Arun Ahuja, Vu Pham, Greg Wayne, Yee Whye Teh, and Nicolas Heess Neural Probabilistic Motor Primitives for Humanoid Control, ICLR, 2019 ICLR OpenReview Demo Video
04/05/19	3PM	GDC 3.816	Angjoo Kanazawa*, Jason Y. Zhang*, Panna Felsen*, and Jitendra Malik (* Joint first authors) Learning 3D Human Dynamics from Video, CVPR, 2019 Project Website Demo Video
03/15/19	3PM	GDC 3.816	Alexander Sasha Vezhnevets, Simon Osindero, Tom Schaul, Nicolas Heess, Max Jaderberg, David Silver, and Koray Kavukcuoglu FeUdal Networks for Hierarchical Reinforcement Learning, arXiv, 2017
03/01/19	3PM	GDC 3.816	Xiao Lin, and Mohamed R. Amer Human Motion Modeling using DVGANs, arXiv, 2018
02/15/19	3PM	GDC 3.816	Chung-Yi Weng, Brian Curless, and Ira Kemelmacher-Shlizerman Photo Wake-Up: 3D Character Animation from a Single Photo, arXiv, 2018 Project website (with demo video)
02/01/19	3PM	GDC 3.816	Rui Ma, Akshay Gadi Patil, Matthew Fisher, Manyi Li, Sören Pirk, Binh-Son Hua, Sai-Kit Yeung, Xin Tong, Leonidas Guibas, and Hao Zhang Language-Driven Synthesis of 3D Scenes from Scene Databases, SIGGRAPH Asia, 2018 Project website (with demo video)
12/11/18	11AM	GDC 3.816	Manolis Savva, Angel X. Chang, Pat Hanrahan, Matthew Fisher, and Matthias Nießner PiGraphs: Learning Interaction Snapshots from Observations, SIGGRAPH, 2016 Project website (includes demos)
11/27/18	11AM	GDC 3.816	Tanmay Gupta, Dustin Schwenk, Ali Farhadi, Derek Hoiem, and Aniruddha Kembhavi Imagine This! Scripts to Compositions to Videos, ECCV, 2018 Project Website (includes videos)
11/13/18	11AM	GDC 3.816	Mir Rayat Imtiaz Hossain, and James J. Little Exploiting temporal information for 3D human pose estimation, ECCV, 2018 Project Website (Includes Code and Videos)
10/30/18	11AM	GDC 3.816	Xue Bin Peng, Angjoo Kanazawa, Jitendra Malik, Pieter Abbeel, and Sergey Levine SFV: Reinforcement Learning of Physical Skills from Videos, ACM Transactions on Graphics (SIGGRAPH Asia), 2018 Project Website (Includes Videos)
10/16/18	11AM	GDC 3.816	Kevin Chen, Christopher B. Choy, Manolis Savva, Angel Chang, Thomas Funkhouser, and Silvio Savarese Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddings, arXiV, 2018 Project website (Includes videos)
10/02/18	11AM	GDC 3.816	Glen Berseth(*), Cheng Xie(*), Paul Cernek, and Michiel van de Panne Note: (*) denotes co-first authorship Progressive Reinforcement Learning with Distillation for Multi-Skilled Motion Control, International Conference on Learning Representations (ICLR), 2018 Project website (Includes videos)
09/18/18	11AM	GDC 3.816	Huseyin Coskun, David Joseph Tan, Sailesh Conjeti, Nassir Navab, and Federico Tombari Human Motion Analysis with Deep Metric Learning, ECCV, 2018
05/07/18	1PM	GDC 3.816	Xue Bin Peng, Pieter Abbeel, Sergey Levine, Michiel van de Panne DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills, ACM Transactions on Graphics, 2018 Project website (Includes videos)
04/23/18	1PM	GDC 3.816	Daniel Holden, Taku Komura, and Jun Saito Phase-Functioned Neural Networks for Character Control, ACM Transactions on Graphics (TOG), 2017 Project website (includes videos)
04/09/18	1PM	GDC 3.816	Yitong Li, Martin Renqiang Min, Dinghan Shen, David Carlson, and Lawrence Carin Video Generation from Text, Proc. American Association of Artificial Intelligence (AAAI), 2018
03/26/18	1PM	GDC 3.816	Ziyu Wang*, Josh Merel*, Scott Reed, Greg Wayne, Nando de Freitas, Nicolas Heess (* Joint First Authors) Robust Imitation of Diverse Behaviors, NIPS, 2017 Project website (Supplemental material includes videos)
03/05/18	1PM	GDC 3.816	Partha Ghosh, Jie Song, Emre Aksan, and Otmar Hilliges Learning Human Motion Models for Long-term Predictions, International Conference on 3D Vision, 2017 (Received Best Paper Award) Project website (Includes videos)
02/19/18	1PM	GDC 3.816	Zimo Li, Yi Zhou, Shuangjiu Xiao, Chong He, and Hao Li Auto-Conditioned Recurrent Networks for Extended Complex Human Motion Synthesis, arXiv, 2018
02/05/18	1PM	GDC 3.816	Junyoung Chung, Sungjin Ahn, and Yoshua Bengio Hierarchical Multiscale Recurrent Neural Networks, ICLR, 2017
01/22/18	1PM	GDC 3.816	Xue Bin Peng, Glen Berseth, Kangkang Yin, and Michiel van de Panne DeepLoco: Dynamic Locomotion Skills Using Hierarchical Deep Reinforcement Learning, ACM Transactions on Graphics, 2017 Project website (Includes videos)
01/10/18	11AM	GDC 5.816	Julieta Martinez, Michael J. Black, and Javier Romero On human motion prediction using recurrent neural networks, CVPR, 2017
12/11/17	12PM	GDC 3.816	Ikhsanul Habibie, Daniel Holden, Jonathan Schwarz, Joe Yearsley, and Taku Komura A Recurrent Variational Autoencoder for Human Motion Synthesis, British Machine Vision Conference, 2017
12/04/17	2PM	GDC 5.816	Daniel Holden, Jun Saito, and Taku Komura A Deep Learning Framework for Character Motion Synthesis and Editing, SIGGRAPH, 2016
11/13/17	2PM	GDC 5.816	Yang Li, Nan Du, and Sammy Bengio Time-Dependent Representation for Neural Event Sequence Prediction, arXiv
10/30/17	2PM	GDC 5.816	Josh Merel, Yuval Tassa, Dhruva TB, Sriram Srinivasan, Jay Lemmon, Ziyu Wang, Greg Wayne, and Nicolas Heess Learning Human Behaviors from Motion Capture by Adversarial Imitation, arXiv
10/16/17	2PM	GDC 5.816	Han Zhang, Tao Xu, Hongshen Li, Shaoting Zhang, Xiaogang Wang, Xiaolei Huang, and Dimitris Metaxas StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks, ICCV, 2017
10/02/17	2PM	GDC 5.816	Prajit Ramachandran, Peter J. Liu, and Quoc V. Le Unsupervised Pretraining for Sequence to Sequence Learning, ACL, 2017
09/18/17	2PM	GDC 5.816	Cihan Halit and Tolga Capin Multiscale motion saliency for keyframe extraction from motion capture sequences, Computer Animation and Virtual Worlds Journal, January 2011
08/29/17	2PM	GDC 5.816	Matthias Plappert, Christian Mandery, and Tamim Asfour Learning a bidirectional mapping between human whole-body motion and natural language using deep recurrent neural networks, arXiv, 2017