ASTRA-sim Tutorial @ ASPLOS 2023

We’re running an ASTRA-sim tutorial at ASPLOS 2023.
Mar 26, 2023
Vancouver, Canada.

Read More

Tutorials

2023

2022



Overview

This is the ASTRA-sim distributed Deep Learning Training simulator, developed in collaboration between Georgia Tech, Meta and Intel.

An overview is presented here:

The full description of the tool and its strength can be found in these papers.

ASTRA-sim2.0 (ISPASS 2023)

pdf slides pdf

William Won*, Taekyung Heo*, Saeed Rashidi*, Srinivas Sridharan, Sudarshan Srinivasan, and Tushar Krishna, “ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale,” In Proc. of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 2023.
* These authors contributed equally to this work.

@inproceedings{astrasim2,
  author={William Won and 
          Taekyung Heo and 
          Saeed Rashidi and 
          Srinivas Sridharan and
          Sudarshan Srinivasan and
          Tushar Krishna},    
  title={{ASTRA-sim2.0}: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale},
  booktitle={IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)},
  year={2023}
}

ASTRA-sim (ISPASS 2020)

pdf slides video

Saeed Rashidi, Srinivas Sridharan, Sudarshan Srinivasan, and Tushar Krishna, “ASTRA-SIM: Enabling SW/HW Co-Design Exploration for Distributed DL Training Platforms,” In Proc. of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 2020.

@inproceedings{astrasim,
  author={Saeed Rashidi and
          Srinivas Sridharan and
          Sudarshan Srinivasan and
          Tushar Krishna},
  title={{ASTRA-SIM}: Enabling SW/HW Co-Design Exploration for Distributed DL Training Platforms},
  booktitle={IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)},
  year={2020}
}

Contact

Please email the core developers below or Tushar Krishna (tushar@ece.gatech.edu) if you have any questions.

Core Developers

  • Saeed Rashidi (Georgia Tech) Email
  • Srinivas Sridharan (Meta) Email
  • William Won (Georgia Tech) Email
  • Taekyung Heo (Georgia Tech) Email

Additional Contributors

  • Jiayi Huang (University of California, Santa Barbara)
  • Apurve Chawde (Georgia Tech)
  • Santosh Kumar Elangoven (Georgia Tech)
  • Tushar Krishna (Georgia Tech)
  • Greg Steinbrecher (Meta)
  • Sudarshan Srinivasan (Intel)

Hits