Problems with MLP

• Representational capacity

• Catastrophic forgetting

• Occurs when a trained network is further trained on new data

• Network forgets what it learned about the old data

• Only knows about the new data