ASTRA-sim Tutorial @ ASPLOS 2023
We successfully delivered the ASTRA-sim tutorial at ASPLOS 2023.
Mar 26, 2023
Vancouver, Canada.
Tutorials
2023
2022
Overview
This is the ASTRA-sim distributed Deep Learning Training simulator, developed in collaboration between Georgia Tech, Meta and Intel.
An overview is presented here:
The full description of the tool and its strength can be found in these papers.
ASTRA-sim2.0 (ISPASS 2023)
William Won*, Taekyung Heo*, Saeed Rashidi*, Srinivas Sridharan, Sudarshan Srinivasan, and Tushar Krishna,
“ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale,”
In Proc. of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 2023.
* These authors contributed equally to this work.
@inproceedings{astrasim2,
author={William Won and
Taekyung Heo and
Saeed Rashidi and
Srinivas Sridharan and
Sudarshan Srinivasan and
Tushar Krishna},
title={{ASTRA-sim2.0}: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale},
booktitle={IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)},
year={2023}
}
ASTRA-sim (ISPASS 2020)
Saeed Rashidi, Srinivas Sridharan, Sudarshan Srinivasan, and Tushar Krishna, “ASTRA-SIM: Enabling SW/HW Co-Design Exploration for Distributed DL Training Platforms,” In Proc. of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 2020.
@inproceedings{astrasim,
author={Saeed Rashidi and
Srinivas Sridharan and
Sudarshan Srinivasan and
Tushar Krishna},
title={{ASTRA-SIM}: Enabling SW/HW Co-Design Exploration for Distributed DL Training Platforms},
booktitle={IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)},
year={2020}
}
Contact
Please email the core developers below or Tushar Krishna (tushar@ece.gatech.edu) if you have any questions.
Core Developers
- Saeed Rashidi (Georgia Tech) Email
- Srinivas Sridharan (Meta) Email
- William Won (Georgia Tech) Email
- Taekyung Heo (Georgia Tech) Email
Additional Contributors
- Jiayi Huang (University of California, Santa Barbara)
- Apurve Chawde (Georgia Tech)
- Santosh Kumar Elangoven (Georgia Tech)
- Tushar Krishna (Georgia Tech)
- Greg Steinbrecher (Meta)
- Sudarshan Srinivasan (Intel)