At AI SF, Danny Lange presented how to train puppies: “On the road to artificial general intelligence” — game simulations Unity3D plus reinforcement learning used to train virtual puppies to play “fetch” and other skills. Building on this, Danny described several forms of learning inspired by biology, which go beyond deep learning. He showed examples of virtual puppies for:
Imitation Learning: e.g., see https://bit.ly/2zvYH51 (start 0:15)
Curriculum Learning: start with an easy problem, then make learning challenges progressively harder
Curiosity-driven Exploration: gets beyond problems which random exploration would never reach, i.e., agents don’t get stuck in a room (saddle points) because they want to explore other rooms