Yao Matrix
3bd1c20149
enable misc cases on XPU & use device agnostic APIs for cases in tests ( #38192 )
...
* use device agnostic APIs in tests
Signed-off-by: Matrix Yao <matrix.yao@intel.com>
* more
Signed-off-by: Matrix Yao <matrix.yao@intel.com>
* fix style
Signed-off-by: Matrix Yao <matrix.yao@intel.com>
* add reset_peak_memory_stats API
Signed-off-by: YAO Matrix <matrix.yao@intel.com>
* update
---------
Signed-off-by: Matrix Yao <matrix.yao@intel.com>
Signed-off-by: YAO Matrix <matrix.yao@intel.com>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2025-05-20 10:09:01 +02:00
Matej Sirovatka
46a4b7c909
Feat: save_pretrained for tensor parallel (and other parallelisms) models ( #37919 )
...
* tmp: initial save pretrained with dtensors
* Feat: add correctness tests
* Refactor: version checks
* Temp: 1:1 checkpoint llama4
* refactor
* Tests
* Feat: works
* Style
* Feat: version checks + minor fixes
* Style
* Fix: version checks in tests
* Feat: move more stuff into tensor_parallel.py
2025-05-19 18:16:21 +00:00
jiqing-feng
286393fbb1
enable tp on CPU ( #36299 )
...
* enable tp on CPU
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* get rank from cpu
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* update
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* enable TP tests
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* fix comment
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* em print
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* fix model id
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* fix conflict
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* fix index and add doc
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
---------
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
2025-03-31 10:55:47 +02:00
Afanti
7f5077e536
fix typos in the tests directory ( #36717 )
2025-03-17 17:45:57 +00:00
Arthur
1c4b62b219
Refactor some core stuff ( #36539 )
...
* some config changes
* update
* current state
* update
* update
* updates and cleanup
* something that works
* fixup
* fixes
* nits
* nit
* nits and fix
* Update src/transformers/integrations/tensor_parallel.py
Co-authored-by: Lysandre Debut <hi@lysand.re>
* Update src/transformers/integrations/tensor_parallel.py
Co-authored-by: Lysandre Debut <hi@lysand.re>
* cleanup
* style
* safe import
* fix
* updates
* rename stuff an clean
* style
* small updates
* ups
* oups
* nit
* protect imports
* update tp
* rodfl
* arf
* turbo nit on init
* fix import error
* frumble gumbgle
* try to fix the import error
* should fix the non model test
* update keep in float32
* update
* fix
* nits
* fix subvconfigs
* test was weird
* nit
* fix failing test
* fix instruct blip
* fixes
* style
* x.com
* fix overwrite
* ok last bit of failing test
---------
Co-authored-by: Lysandre Debut <hi@lysand.re>
2025-03-11 09:26:28 +01:00
