Dumped graphs for Entangle project. Note that we only put graphs from open-sourced models/framworks.
The directories below are for verification purpose:
- aws_llama
- gpt
- qwen2
And the directories below are for bug detection:
- bug_grad_accumulation (Bug 6 in paper)
- bug_missing_allreduce_under_wrong_config (Bug 7 in paper)
- bug_missing_swtichmlp_allreduce (Bug 8 in paper)
- bug_missing_layernorm_allreduce (Bug 9 in paper)