Matej Sirovatka
|
46a4b7c909
|
Feat: save_pretrained for tensor parallel (and other parallelisms) models (#37919)
* tmp: initial save pretrained with dtensors
* Feat: add correctness tests
* Refactor: version checks
* Temp: 1:1 checkpoint llama4
* refactor
* Tests
* Feat: works
* Style
* Feat: version checks + minor fixes
* Style
* Fix: version checks in tests
* Feat: move more stuff into tensor_parallel.py
|
2025-05-19 18:16:21 +00:00 |
|
jiqing-feng
|
286393fbb1
|
enable tp on CPU (#36299)
* enable tp on CPU
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* get rank from cpu
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* update
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* enable TP tests
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* fix comment
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* em print
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* fix model id
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* fix conflict
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* fix index and add doc
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
---------
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
|
2025-03-31 10:55:47 +02:00 |
|
Afanti
|
7f5077e536
|
fix typos in the tests directory (#36717)
|
2025-03-17 17:45:57 +00:00 |
|
Arthur
|
1c4b62b219
|
Refactor some core stuff (#36539)
* some config changes
* update
* current state
* update
* update
* updates and cleanup
* something that works
* fixup
* fixes
* nits
* nit
* nits and fix
* Update src/transformers/integrations/tensor_parallel.py
Co-authored-by: Lysandre Debut <hi@lysand.re>
* Update src/transformers/integrations/tensor_parallel.py
Co-authored-by: Lysandre Debut <hi@lysand.re>
* cleanup
* style
* safe import
* fix
* updates
* rename stuff an clean
* style
* small updates
* ups
* oups
* nit
* protect imports
* update tp
* rodfl
* arf
* turbo nit on init
* fix import error
* frumble gumbgle
* try to fix the import error
* should fix the non model test
* update keep in float32
* update
* fix
* nits
* fix subvconfigs
* test was weird
* nit
* fix failing test
* fix instruct blip
* fixes
* style
* x.com
* fix overwrite
* ok last bit of failing test
---------
Co-authored-by: Lysandre Debut <hi@lysand.re>
|
2025-03-11 09:26:28 +01:00 |
|