The static toy environments are not suitable for training an agent for generalization. The chainpattern is solvable with a trivial strategy, which is not enough to demonstrate that a certain method is good enough.
The random environment in cyberbattle.simulation.generate_network is not realistic and deep enough. In a random network of 50 nodes, only 1 or 2 are actually hackable.
The random environment in cyberbattle.simulation.environment_generation seem to be very limited as well (usually, no other nodes discovered).
To train generalizing agents, a more complex, dynamic and realistic environment generation is needed.
The static toy environments are not suitable for training an agent for generalization. The chainpattern is solvable with a trivial strategy, which is not enough to demonstrate that a certain method is good enough.
The random environment in
cyberbattle.simulation.generate_networkis not realistic and deep enough. In a random network of 50 nodes, only 1 or 2 are actually hackable.The random environment in
cyberbattle.simulation.environment_generationseem to be very limited as well (usually, no other nodes discovered).To train generalizing agents, a more complex, dynamic and realistic environment generation is needed.