Argument ${MEMORY_CONFIG}

--memory-configuration: path to the memory configuration file

Analytical Memory Config

Example memory configurations can be found at

$ ${ASTRA_SIM}/inputs/remote_memory/analytical

  • memory-type: (string) memory type (“NO_MEMORY_EXPANSION”, “PER_NODE_MEMORY_EXPANSION”, “PER_NPU_MEMORY_EXPANSION”, or “MEMORY_POOL”)

  • remote-mem-latency: (uint) remote memory latency (ns)

  • remote-mem-bw: (uint) remote memory bandwidth (GB/s or B/ns)

  • num-nodes: (int) number of nodes (only valid with “PER_NODE_MEMORY_EXPANSION”)

  • num-npus-per-node: (int) number of NPUs per node (only valid with “PER_NODE_MEMORY_EXPANSION”)