Repository navigation

Merge latest changes - #17

Open

gkarfakis19 wants to merge 77 commits into

masterfrom

llm-dev

Open

Merge latest changes#17
gkarfakis19 wants to merge 77 commits into
masterfrom
llm-dev

Commits on Nov 1, 2025
- init llm astra
  gkarfakis19
  committed
  f560256
Commits on Nov 2, 2025
- fix submodule
  gkarfakis19
  committed
  d6d7893
- updated astra ver
  gkarfakis19
  committed
  629c02b
- updated config to handle new astra ver
  gkarfakis19
  committed
  7b019de
- Some cleanup and fixed major network double counting flattened bug
  gkarfakis19
  committed
  9b324a5
- time calc refactor stage 1
  gkarfakis19
  committed
  75c2ee4
- first stage config update. Astrasim integration missing, everything else supported.
  gkarfakis19
  committed
  4f0a3c4
- minor fix
  gkarfakis19
  committed
  b79cf26
- small config cleanup
  gkarfakis19
  committed
  f8834f8
Commits on Nov 3, 2025
- Major reformat of network configs to enable N-dimensional astrasim exec.. Includes some flattener bug fixes, cleanup and documentation in executor.py
  gkarfakis19
  committed
  9dc7656
- enabled multi dim network for non-flattened exec modes
  gkarfakis19
  committed
  fd1a137
Commits on Nov 4, 2025
- added network prints, fixed hierarchical context parallelism
  gkarfakis19
  committed
  88eba5b
- remap send and recv nodes for more astrasim stability
  gkarfakis19
  committed
  bfdd900
- bugfix
  gkarfakis19
  committed
  3557dcf
- faulty links enabled w/ new astra ver
  gkarfakis19
  committed
  35eb723
- memory estimation enabled and flash attention supported
  
  NanoMembers
  authored and
  bingluc
  committed
  62aa31c
Commits on Nov 5, 2025
- sweep updates
  gkarfakis19
  committed
  03b505e
- small fix
  gkarfakis19
  committed
  a222bd1
- synthetic duplication fix
  gkarfakis19
  committed
  1543389
- mem awareness
  gkarfakis19
  committed
  13fc174
Commits on Nov 6, 2025
- modified memory estimation to pipedream style and microbatch 1 assumption
  NanoMembers
  committed
  fae70d5
- enabled memory estimation with gradient accumulation considered
  
  NanoMembers
  authored and
  bingluc
  committed
  7173632
- bug fix for hybrid mode
  NanoMembers
  committed
  864d1d5
- added many tools + step 1 of 'proper' faulty link support.
  gkarfakis19
  committed
  d733edb
Commits on Nov 7, 2025
- hierarchical mode faults enabled after large reorganization of transformer graphs (now we make many graphs). DP Still doesnt work fully (WIP). Also added print logging system
  gkarfakis19
  committed
  bf3c073
- Support no-DP graph generation for gradient-accumulation timing
  
  NanoMembers
  authored and
  bingluc
  committed
  99681a6
Commits on Nov 8, 2025
- implemented DP faults (harder than I thought)
  gkarfakis19
  committed
  a661557
- gmap optimize 2D topologies implemented (not tested)
  gkarfakis19
  committed
  10d4ac1
Commits on Nov 9, 2025
Commits on Nov 11, 2025
- added pytest, fixed hybrid/hierarchical bug
  gkarfakis19
  committed
  b9cd28d
- small fix
  gkarfakis19
  committed
  b4f75d7
- implemented expert parallelism
  NanoMembers
  committed
  65de98a
- flash attention forward and backward implemented
  NanoMembers
  committed
  6139dea
- minor clean up and fix
  NanoMembers
  committed
  7c57274
Commits on Nov 16, 2025
- attempt to add CI
  gkarfakis19
  committed
  7db2824
- minor fix
  gkarfakis19
  committed
  02abd95
- dependencies for CI
  gkarfakis19
  committed
  65bdd6c
- test if CI fails
  gkarfakis19
  committed
  acd157d
- revert test if CI fails
  gkarfakis19
  committed
  72ff52e
Commits on Nov 18, 2025
- Add NVIDIA validation tests and update validation helpers for inference time parsing
  
  NanoMembers
  authored and
  eyao600
  committed
  a359b16
- Fix L2 capacity assignment in TiledGEMM class
  
  NanoMembers
  authored and
  eyao600
  committed
  6c387cd
- Add AccessBytes class and update memory access calculations in TimeCalculation
  
  NanoMembers
  authored and
  eyao600
  committed
  2460968
- Consider SM utilization based on wave calculation method
  
  NanoMembers
  authored and
  eyao600
  committed
  dcdf1ec
- Adjust inference run checks in TimeCalculation
  
  NanoMembers
  authored and
  eyao600
  committed
  432c9e9
- Split validation tests into A100 and H100 devices and update data handling
  NanoMembers
  committed
  afdb731
- Mark IMEC H100 test for failure
  NanoMembers
  committed
  6e65787
Commits on Nov 21, 2025
- multithreaded and cleaner per device-model tests
  gkarfakis19
  committed
  7ce961a
- doubled num tests
  gkarfakis19
  committed
  0796c9b
- separated val configs
  gkarfakis19
  committed
  5fbb468
- WIP train test
  gkarfakis19
  committed
  0e88891
Commits on Nov 22, 2025
- added full train validation script based on IMEC data. Test is commented out.
  gkarfakis19
  committed
  22bef8f
Commits on Nov 23, 2025
- added optimizer FLOPS to bwd pass, big cleanup of timing and comm rules and apply grad
  gkarfakis19
  committed
  b87b2ec
- minor fix
  gkarfakis19
  committed
  0d065cd
- removed vestigial code
  gkarfakis19
  committed
  e5e023c
- minor weird bug fix with wrong network analyitc gen
  gkarfakis19
  committed
  82351da
Commits on Nov 24, 2025
- implemented full recomputation for hybrid/hierachical mode
  
  NanoMembers
  authored and
  bingluc
  committed
  6591357
- Revert "implemented full recomputation for hybrid/hierachical mode"
  bingluc
  committed
  0ce7b9d
Commits on Nov 25, 2025
- new style astrasim config gen by Faraz
  gkarfakis19
  committed
  9d1105c
- disaggregated MHA always. needed for next hidden comm refinements
  gkarfakis19
  committed
  4360457
- added zero 3 inference check
  gkarfakis19
  committed
  9b96b87
- first attempt at split comm/comp. passes all tests, reduces worst case error around ~2%
  gkarfakis19
  committed
  d1a55b5
- implemented full recomputation for hybrid/hierachical mode
  
  NanoMembers
  authored and
  bingluc
  committed
  ccb03eb
Commits on Nov 26, 2025
- implemented full-recomputation for all modes with pipeline style recompute block
  NanoMembers
  committed
  7a11378
- small update to faraz config parser
  gkarfakis19
  committed
  bc2fee5
- updated astrasim??
  gkarfakis19
  committed
  1ec4310
- annoying error. hopefully this fixes it.
  gkarfakis19
  committed
  536b764
Commits on Dec 5, 2025
- added dp microbatch sync option to fix selene tests. nvidia train tests in much better shape now.
  gkarfakis19
  committed
  8988127
- added scotchpy to reqs txt
  gkarfakis19
  committed
  0a2a12f
- Plot GEMM operation comparison
  NanoMembers
  committed
  e593045
- added uci train tests validation
  gkarfakis19
  committed
  2c63cff
- Disable SM util for flash attention
  NanoMembers
  committed
  90b562c
Commits on Dec 6, 2025
- fixed mapping
  gkarfakis19
  committed
  980dad0
Commits on Dec 15, 2025
- gitignore up
  gkarfakis19
  committed
  d4977ad
- changed configs for 2d topo
  gkarfakis19
  committed
  0acc83c
- fix
  gkarfakis19
  committed
  7fcca22

Commits

Commits on Nov 1, 2025

Commits on Nov 2, 2025

Commits on Nov 3, 2025

Commits on Nov 4, 2025

Commits on Nov 5, 2025

Commits on Nov 6, 2025

Commits on Nov 7, 2025

Commits on Nov 8, 2025

Commits on Nov 9, 2025

Commits on Nov 11, 2025

Commits on Nov 16, 2025

Commits on Nov 18, 2025

Commits on Nov 21, 2025

Commits on Nov 22, 2025

Commits on Nov 23, 2025

Commits on Nov 24, 2025

Commits on Nov 25, 2025

Commits on Nov 26, 2025

Commits on Dec 5, 2025

Commits on Dec 6, 2025

Commits on Dec 15, 2025