User:Martijho

From Robin

Revision as of 13:11, 6 November 2017

PathNet

• Super neural network
• Evolved sub-models from a larger set of parameters
• Multitask learning
• No catastrophic forgetting
• Embedded transfer learning

Who cites PathNet?

Born to Learn

EPANN - Evolved Plastic Artificial Neural Networks Mentions Pathnet as an example of where evolution where used to train a network on multiple tasks. "While these results were only possible through significant computational resources, they demonstrate the potential of combining evolution and deep learning approaches.

• Learning time-efficient deep architectures with budgeted super networks

Mentions PathNet as a predecessor in the super neural network family

• Deep Learning for video game playing

Reviewing recent deep learning advances in the context of how they have been applied to play different types of video games

• Evolutive deep models for online learning on data streams with no storage

Pathnet is proposed alongside PNNS as a way to deal with changing environments. It is mentioned that both PathNet and progressive networks show good results on sequences of tasks and are a good alternative to fine-tuning to accelerate learning.

• Online multi-task learning using active sampling