Fall of the Western Roman Empire. Problems in the Empire The Empire was too big to control Germanic warriors (barbarians) continued to attack Roman territories.