Joao Gante
5275ef6f3d
[XGLM] tag tests as slow ( #36592 )
...
these tests should be slow
2025-03-06 17:54:41 +00:00
Joao Gante
c1b24c0b73
[bark] fix loading of generation config ( #36587 )
2025-03-06 16:55:19 +00:00
Shaohon Chen
0440dbc0e1
Integrate SwanLab for offline/online experiment tracking and local visualization ( #36433 )
...
* add swanlab integration
* feat(integrate): add SwanLab as an optional experiment tracking tool in transformers
- Integrated SwanLab into the transformers library as an alternative for experiment tracking.
- Users can now log training metrics, hyperparameters, and other experiment details to SwanLab by setting `report_to="swanlab"` in the `TrainingArguments`.
- Added necessary dependencies and documentation for SwanLab integration.
* Fix the spelling error of SwanLabCallback in callback.md
* Apply suggestions from code review
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
* Fix typo in comment
* Fix typo in comment
* Fix typos and update comments
* fix annotation
* chore: opt some comments
---------
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
Co-authored-by: AAssets <20010618@qq.com>
Co-authored-by: ZeYi Lin <944270057@qq.com>
Co-authored-by: KAAANG <79990647+SAKURA-CAT@users.noreply.github.com>
2025-03-06 17:35:30 +01:00
hlky
bc30dd1efb
Modular Conversion --fix_and_overwrite on Windows ( #36583 )
...
* Modular Conversion --fix_and_overwrite on Windows
* -newline on read
2025-03-06 13:12:30 +00:00
湛露先生
9e385109cf
Delete redundancy if case in model_utils ( #36559 )
...
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
2025-03-06 11:36:11 +00:00
dependabot[bot]
acc49e390d
Bump transformers from 4.38.0 to 4.48.0 in /examples/research_projects/pplm ( #36540 )
...
Bump transformers in /examples/research_projects/pplm
Bumps [transformers](https://github.com/huggingface/transformers ) from 4.38.0 to 4.48.0.
- [Release notes](https://github.com/huggingface/transformers/releases )
- [Commits](https://github.com/huggingface/transformers/compare/v4.38.0...v4.48.0 )
---
updated-dependencies:
- dependency-name: transformers
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-03-06 11:35:47 +00:00
Afanti
9e84b38135
chore: enhance message descriptions in parameters,comments,logs and docstrings ( #36554 )
...
* chore: enhance message descriptons in parameters,comments,logs and docstrings
* chore: enhance message descriptons in parameters,comments,logs and docstrings
* Update src/transformers/hf_argparser.py
* Update src/transformers/keras_callbacks.py
---------
Co-authored-by: Matt <Rocketknight1@users.noreply.github.com>
2025-03-06 11:02:35 +00:00
湛露先生
6966fa1901
Fix typos . ( #36551 )
...
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
2025-03-05 16:31:43 -08:00
co63oc
996f512d52
Fix typos in tests ( #36547 )
...
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
2025-03-05 15:04:06 -08:00
Marc Sun
752ef3fd4e
guard torch version for uint16 ( #36520 )
...
* u16
* style
* fix
2025-03-05 11:27:01 +01:00
Afanti
66f29aaaf5
chore: enhance messages in docstrings ( #36525 )
...
chore: enhance the message in docstrings
2025-03-04 16:31:20 +00:00
Mohamed Mekkouri
89d27fa6ff
Fix links in quantization doc ( #36528 )
...
fix quantization doc
2025-03-04 16:43:03 +01:00
ivarflakstad
c0c5acff07
Fix bamba tests amd ( #36535 )
2025-03-04 15:24:27 +01:00
co63oc
37508816d6
chore: Fix typos in docs and examples ( #36524 )
...
Fix typos in docs and examples
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
2025-03-04 13:47:41 +00:00
Arthur
84f0186e89
Add aya ( #36521 )
...
* initial commit
* small fix
* move stuff to image processing file
* remove stuff in validate turn and fix return tensor
* remove liquid stuff
* in the process of addressing comments
* changes to get the right tokenization
* new __init__ works
* fixing defulat std and mean
* works
* small testing scipt -- to be deleted before merge
* remove redundant code
* addressing comments
* fix inits, add docs templates
* refactor processor, switch to gotocr image processor
* remove image proc from init
* refactor to working llava-style architecture
* Change AyaVisionModel to AyaVisionForConditionalGeneration
* add tests
* fixups
* update doc
* Adding logits_to_keep explicitly in ayavision forward to enable compatibility with cohere model
* better variable names + remove code paths
* Updates to aya_vision.md
* address comments
* adding copied from
* make style and remove unused projector_hidden_act from config
* sort init
* include usage of fast image proc and proc on cuda in doc
* update checkpoint iin test processor
* update checkpoint in test processor 2
* remove test_model and update docstring
* skip failing tests
---------
Co-authored-by: Saurabh Dash <saurabh@cohere.com>
Co-authored-by: yonigozlan <yoni.gozlan@huggingface.co>
2025-03-04 12:24:33 +01:00
Steven Liu
c0f8d055ce
[docs] Redesign ( #31757 )
...
* toctree
* not-doctested.txt
* collapse sections
* feedback
* update
* rewrite get started sections
* fixes
* fix
* loading models
* fix
* customize models
* share
* fix link
* contribute part 1
* contribute pt 2
* fix toctree
* tokenization pt 1
* Add new model (#32615 )
* v1 - working version
* fix
* fix
* fix
* fix
* rename to correct name
* fix title
* fixup
* rename files
* fix
* add copied from on tests
* rename to `FalconMamba` everywhere and fix bugs
* fix quantization + accelerate
* fix copies
* add `torch.compile` support
* fix tests
* fix tests and add slow tests
* copies on config
* merge the latest changes
* fix tests
* add few lines about instruct
* Apply suggestions from code review
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
* fix
* fix tests
---------
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
* "to be not" -> "not to be" (#32636 )
* "to be not" -> "not to be"
* Update sam.md
* Update trainer.py
* Update modeling_utils.py
* Update test_modeling_utils.py
* Update test_modeling_utils.py
* fix hfoption tag
* tokenization pt. 2
* image processor
* fix toctree
* backbones
* feature extractor
* fix file name
* processor
* update not-doctested
* update
* make style
* fix toctree
* revision
* make fixup
* fix toctree
* fix
* make style
* fix hfoption tag
* pipeline
* pipeline gradio
* pipeline web server
* add pipeline
* fix toctree
* not-doctested
* prompting
* llm optims
* fix toctree
* fixes
* cache
* text generation
* fix
* chat pipeline
* chat stuff
* xla
* torch.compile
* cpu inference
* toctree
* gpu inference
* agents and tools
* gguf/tiktoken
* finetune
* toctree
* trainer
* trainer pt 2
* optims
* optimizers
* accelerate
* parallelism
* fsdp
* update
* distributed cpu
* hardware training
* gpu training
* gpu training 2
* peft
* distrib debug
* deepspeed 1
* deepspeed 2
* chat toctree
* quant pt 1
* quant pt 2
* fix toctree
* fix
* fix
* quant pt 3
* quant pt 4
* serialization
* torchscript
* scripts
* tpu
* review
* model addition timeline
* modular
* more reviews
* reviews
* fix toctree
* reviews reviews
* continue reviews
* more reviews
* modular transformers
* more review
* zamba2
* fix
* all frameworks
* pytorch
* supported model frameworks
* flashattention
* rm check_table
* not-doctested.txt
* rm check_support_list.py
* feedback
* updates/feedback
* review
* feedback
* fix
* update
* feedback
* updates
* update
---------
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Co-authored-by: Quentin Gallouédec <45557362+qgallouedec@users.noreply.github.com>
2025-03-03 10:33:46 -08:00
Matt
6aa9888463
Remove unused code ( #36459 )
2025-03-03 18:31:10 +00:00
Kashif Rasul
9fe82793ee
[Style] fix E721 warnings ( #36474 )
...
* fix E721 warnings
* config.hidden_size is not a tuple
* fix copies
* fix-copies
* not a tuple
* undo
* undo
2025-03-03 18:03:42 +00:00
Matt
1975be4d97
Fix edge case for continue_final_message ( #36404 )
...
* Fix edge case for continue_final_message
* lstrip() correctly
* Add regression test
* Add a clearer error message when the final message is not present
* Add a clearer error message when the final message is not present
* Fix massive bug!
2025-03-03 18:03:03 +00:00
Matt
2aff938992
Fix pipeline+peft interaction ( #36480 )
...
* Fix pipeline-peft interaction
* once again you have committed a debug breakpoint
* Remove extra testing line
* Add a test to check adapter loading
* Correct adapter path
* make fixup
* Remove unnecessary check
* Make check a little more stringent
2025-03-03 18:01:43 +00:00
Afanti
28159aee63
chore: fix message descriptions in arguments and comments ( #36504 )
...
chore: fix messagedescriptions in arguments and comments
2025-03-03 17:54:57 +00:00
co63oc
acb8586dd9
Fix some typos in docs ( #36502 )
...
Co-authored-by: Matt <Rocketknight1@users.noreply.github.com>
2025-03-03 17:53:53 +00:00
Marc Sun
0463901c92
fix torch_dtype, contiguous, and load_state_dict regression ( #36512 )
...
* fix regression
* fix param
* fix load_state_dict
* style
* better fix for module
* fix tests
* quick fix for now
* rm print
2025-03-03 18:35:37 +01:00
Marcel
3e83ee75ec
Fix kwargs UserWarning in SamImageProcessor ( #36479 )
...
transformers/image_processing_utils.py:41: UserWarning: The following named arguments are not valid for `SamImageProcessor.preprocess` and were ignored: 'point_pad_value'
2025-03-03 16:23:34 +00:00
Yih-Dar
9e3a1072c2
Check TRUST_REMOTE_CODE for RealmRetriever for security ( #36511 )
...
* fix
* repush
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2025-03-03 15:08:12 +01:00
Zach Mueller
4d8259d245
Fix loading zero3 weights ( #36455 )
...
* Check if fixes
* Fix zero3 loading
* Quality
* Fix marc nit
* Add fast tests
* Migrate to integrations.deepspeed rather than modeling_utils
* Style
2025-03-03 15:05:58 +01:00
hlky
dcbdf7e962
Fix _load_state_dict_into_meta_model with device_map=None ( #36488 )
...
* Fix _load_state_dict_into_meta_model with device_map=None
* Update src/transformers/modeling_utils.py
2025-03-02 08:33:36 +01:00
Marc Sun
a40f1ac602
Fix couples of issues from #36335 ( #36453 )
...
* fix
* style
* better allocation
* fix
* fix
* style
* revert disk
* exit
* style
* return if nothing to cache
* dtensor guard
* fix regressiion
* fix regression
* fix
* fix
2025-03-01 07:12:17 +01:00
Yoni Gozlan
2c5d038f92
Add Got-OCR 2 Fast image processor and refactor slow one ( #36185 )
...
* refactor image processor slow got ocr
* add working image processor fast
* fix fast image processor, update doc
* use one big loop for processing patches
2025-03-01 00:56:00 -05:00
Fanli Lin
51083d1bac
[docs] fix bug in deepspeed config ( #36081 )
...
bug fix
2025-02-28 07:09:54 -08:00
Pavel Iakubovskii
02776d2c6a
Fix loading models with mismatched sizes ( #36463 )
...
* Fix loading model with mismatched sizes
* trigger tests
2025-02-28 11:48:59 +01:00
Eduardo Pacheco
222505c7e4
[GroundingDino] Fix grounding dino loss 🚨 ( #31828 )
...
* Starting to fix GroundingDinoLoss and GroundingDinoHungarianMatcher
* More updates
* More updates
* fixed: GroundingDinoLoss
* fixed: failing tests
* Update src/transformers/models/grounding_dino/modeling_grounding_dino.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update tests/models/grounding_dino/test_modeling_grounding_dino.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/grounding_dino/modeling_grounding_dino.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/grounding_dino/modeling_grounding_dino.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/grounding_dino/modeling_grounding_dino.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/grounding_dino/modeling_grounding_dino.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/grounding_dino/modeling_grounding_dino.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/grounding_dino/modeling_grounding_dino.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/grounding_dino/modeling_grounding_dino.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/grounding_dino/modeling_grounding_dino.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Addressed comments
* Update src/transformers/models/grounding_dino/modeling_grounding_dino.py
Co-authored-by: Sangbum Daniel Choi <34004152+SangbumChoi@users.noreply.github.com>
* add: cardinality loss and make box loss as copy from
* change: default for reduction loss is sum
* fix: vectorized generate fake box
* fix copies
* Addressed comments
* addressed comments
* addressed one-hot
* Update tests/models/grounding_dino/test_modeling_grounding_dino.py
Co-authored-by: Sangbum Daniel Choi <34004152+SangbumChoi@users.noreply.github.com>
* Addressed comments
* fixed test
* Update src/transformers/models/grounding_dino/modeling_grounding_dino.py
* Update tests/models/grounding_dino/test_modeling_grounding_dino.py
Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>
* Starting to fix GroundingDinoLoss and GroundingDinoHungarianMatcher
* More updates
* More updates
* fixed: GroundingDinoLoss
* add: cardinality loss and make box loss as copy from
* fix copies
* Revert "Update tests/models/grounding_dino/test_modeling_grounding_dino.py"
This reverts commit aa74c4c57c430e54cc74c414d6269edb65c73e83.
* [run-slow] groundigdino
* remove nestedtensor
* [run-slow] groundig_dino
* [run-slow] grounding_dino
* [run-slow] grounding_dino
* [run-slow] grounding_dino
* check
* check
* add: enconder intermediate outputs to ImageLoss forward
* add: GroundingDinoForObjectDetectionLoss in the loss directory
* make style
* fix the loss function
* remove class_reduction since it sum is default
* remove class_reduction
* Update src/transformers/loss/loss_grounding_dino.py
Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>
* simple fix
* Update src/transformers/loss/loss_grounding_dino.py
Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>
* minor fix
* Update src/transformers/loss/loss_for_object_detection.py
---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
Co-authored-by: Sangbum Daniel Choi <34004152+SangbumChoi@users.noreply.github.com>
Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>
Co-authored-by: sangbumchoi <danielsejong55@gmail.com>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2025-02-27 19:15:58 +00:00
Yih-Dar
482d17be60
Fix hub_retry ( #36449 )
...
* cry
* trigger
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2025-02-27 14:38:25 +01:00
Harry Mellor
6a876462c3
Lazy import libraries in src/transformers/image_utils.py ( #36435 )
...
* Lazy import libraries in `src/transformers/image_utils.py`
* `make fixup`
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
* Protect imports
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
---------
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2025-02-27 12:53:42 +00:00
Joao Gante
8aed019764
[generate] torch.distributed-compatible DynamicCache ( #36373 )
...
* test
* docstring
* prepare distributed cache data
* fix cat dim
* test mvp
* add test checks
* like this?
* working test and solution
* nit
* nit
* add shape info
2025-02-27 11:48:57 +00:00
wejoncy
17792556b2
[save_pretrained ] Skip collecting duplicated weight ( #36409 )
...
* Skip collecting duplicated weight
* format
2025-02-27 10:57:11 +01:00
Yih-Dar
2d6cc0dfde
Add contents: write ( #36445 )
...
fix permission
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2025-02-27 10:55:37 +01:00
Yih-Dar
549db241e5
Fix another permission ( #36444 )
...
* fix permission
* fix permission
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2025-02-27 10:29:06 +01:00
Yih-Dar
a8e4fe45fd
Fix permission ( #36443 )
...
fix permission
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2025-02-27 10:08:31 +01:00
Yih-Dar
d0727d92cd
Change PR to draft when it is (re)opened ( #36417 )
...
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
* draft
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2025-02-27 09:44:33 +01:00
Marc Sun
8ede897c30
restrict cache allocator to non quantized model ( #36428 )
2025-02-26 22:16:15 +01:00
Mohamed Mekkouri
a7fbab33ae
Fix Expected output for compressed-tensors tests ( #36425 )
...
fix
2025-02-26 21:17:24 +01:00
Arthur
1603018e7a
Update form pretrained to make TP a first class citizen ( #36335 )
...
* clean code
* oups
* fix merge
* yups
* fix if
* now you can play
* fix shape issue
* try non blocking
* fix
* updates
* up
* updates
* fix most of thetests
* update
* update
* small updates
* up
* fix the remaining bug?
* update
* rename when you read from the file
* buffer issues
* current status
* cleanup
* properly allocate dumb memory
* update a small bug
* fix colwise rep issue
* fix keep in float 32 that was keeping everything in float 32
* typo
* more fixes with keep_in_fp32_modules as we use to serach on it
* fix ROPE dtype for TP
* remove what's breaking the tests
* updates
* update and fixes
* small cleanup after merging
* allocate 2x to be safe
* style, auto
* update
* yup nit
* fix
* remove slow as fuck torch api :(
* work
* fixup
* update
* brting the fix back
* fix and update
* fixes
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
* updates because some suggestions were wrong 👀
* update?
* fuck this bloated function
* typo
* fix the dumb prefix thing once and forall
* fixes here and there
* updates
* remove prints
* fix strict cases
* styel
* properly fix keys on load!
* update
* fix base model prefix issue
* style
* update
* fix all?
* remoce 1 print
* fix the final etsts
* fixup
* last nits
* fix the detach issue which cause a 2x slowdown
* fixup
* small fixes
* ultra nit
* fix
* fix
---------
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
2025-02-26 20:12:38 +01:00
Mohamed Mekkouri
981c276a02
Fix compressed tensors config ( #36421 )
...
* fix config
* update
---------
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
2025-02-26 17:56:15 +01:00
Nadav Timor
d18d9c3205
Universal Speculative Decoding CandidateGenerator ( #35029 )
...
* move `TestAssistedCandidateGeneratorDifferentTokenizers` into a new testing file
* refactor
* NOTHING. add space to rerun github actions tests
* remove it...
* `UniversalSpeculativeDecodingGenerator`
* Use `UniversalSpeculativeDecodingGenerator` when `generation_config.do_sample=True`
* assistant tokenizes only the target's new suffix
* formatting
* fix code
* fix code
* formatting
* add `TestGenerateWithDifferentModels`
* `TestGenerateWithDifferentModels` parameterize on `do_sample`
* `AssistantVocabMapping` & `AssistantVocabMappingCache`
* formatting
* `AssistantToTargetTranslator`: `get_target_input_ids` & `get_target_logits`
* improve `_get_assistant_to_target_input_ids` & formatting
* renaming
* WIP: debugging `min_new_tokens`
* fix get_target_ids
* `UniversalSpeculativeDecodingGenerator`
* assistant tokenizes only the target's new suffix
* formatting
* fix code
* fix code
* formatting
* `TestGenerateWithDifferentModels` parameterize on `do_sample`
* `AssistantVocabMapping` & `AssistantVocabMappingCache`
* formatting
* `AssistantToTargetTranslator`: `get_target_input_ids` & `get_target_logits`
* improve `_get_assistant_to_target_input_ids` & formatting
* renaming
* WIP: debugging `min_new_tokens`
* fix get_target_ids
* fix device issue
* fix get_assistant_input_ids
* add `TestAssistedCandidateGeneratorDifferentTokenizers`
* formatting
* `AssistantVocabTranslatorCache` refactor & tests
* revert changes in `src/transformers/generation/logits_process.py`
* refactor `AssistedCandidateGenerator`
* refactor `AssistedCandidateGeneratorDifferentTokenizers`
* formatting
* refactor `UniversalSpeculativeDecodingGenerator`
* fix negative value for max_new_tokens
* fix generation length target + attention_mask vs. assistant + attent
* fix device
* fix negative max_new_tokens bug
* fix UAG
* minor
* formatting
* `AssistedCandidateGeneratorDifferentTokenizers` `lookbehind`s init
* resolve conflict & formatting
* rerun CI tests
* remove space...
* remove old code
* fix candidate_input_ids device
* minor
* formatting
* Fix prepare + apply (#7 )
* fix prepare + apply
* move to cpu
* simplity suppress_tokens
* fix bugs and refacatoring
* device move
* handle self.config.vocab_size > len(target_tokenizer.get_vocab())
* no need to normalize in candidate_generator
* address Nadav's comments + minor
* optimize device move + SuppressTokensLogitsProcessor
* AssistantToTargetTranslator, SuppressTokensLogitsProcessor and tokenizers mapping improvements
* padding size
* padding improvement
* fix and simplify get_target_logits
* renaming in get_target_logits
* minor
* add filter_value and suppress_tokens_id
* style + rename
* remove TODO
* restore original SelectTokensLogitsProcessor with modification
* fix style
* fix _update_past_and_masks and optimize code
* remove assistant_vocab_size arg
* fix attention_mask
* call _prepare_attention_mask also if not has_past_key_values
* handling attention mask for first generation
* comment
* restore test
* remove SelectTokensLogitsProcessor
* _update_past_and_masks implementation for USD
* Add unittests for Universal Assisted generation
* fix style
* update tests
* Remove unused import and fix `test_speculation_depth` test
* exclude special and reserved tokens from tokenizer for UAG
* mv `test_universal_assisted_generation.py` to `generation/test_candidate_generator.py`
* Remove unused imports and fix style using `make style` (#9 )
* formatting
* Swap gated `meta-llama/llama-3.2` with `allenai/llama` (#10 )
* Fix space sign disagreement (#12 )
* default values for AssistantToTargetTranslator fileds
* fix space sign
* minor
* fix test + style
* Default values for some fields of assistant to target translator (#11 )
* default values for AssistantToTargetTranslator fileds
* fix
* add support to empty logit_processors
* Update candidate_generator.py (#15 )
fix typo
* BUG fix in _prepare_assistant_input_ids (#14 )
* fix _prepare_assistant_input_ids
* target_to_assistant_input_ids
* Update src/transformers/generation/candidate_generator.py
Co-authored-by: Nadav Timor <nadav.timor@weizmann.ac.il>
---------
Co-authored-by: Nadav Timor <nadav.timor@weizmann.ac.il>
* typo (`target_to_assistant_input_ids`)
* formatting
* merge upstream/main
* Fix minor review comments (#16 )
* Fix: `token_ids.to(torch.int64)` (#18 )
* tok ids to `torch.int64` (reference: https://huggingface.co/docs/transformers.js/en/api/tokenizers )
* `LongTensor`
* fix dtype
* `assistant_input_ids.to(dtype=torch.long)`
* Remove unused import from test_candidate_generator.py
* Remove unused import from test_candidate_generator.py
* Remove `numpy` import
* resolve pr comments (#19 )
* `AssistantToTargetTranslator` docstring
* (per gante's comment) `filter_value` and `suppress_tokens_id` to class constants
* update `AssistantToTargetTranslator` docstring
* (gante's comment) replace `match-case`
* formatting
* Fix Joao's comments (#21 )
* remove threading
* fix logits_processor
* fix test device
* fix style (#23 )
* Move atm (#24 )
* move AssistantToTargetTranslator
* fixup
* fix logit_processor
* add atm_translator test
* refactor test
* remove threading from test
* add require_torch in tests
* move AssistantVocabTranslatorCache + add tests
* ruff fix
---------
Co-authored-by: jmamou <jonathan.mamou@intel.com>
Co-authored-by: Gaurav <gauravj@d-matrix.ai>
Co-authored-by: Gaurav Jain <gaurjain14@gmail.com>
Co-authored-by: gauravjain14 <41287729+gauravjain14@users.noreply.github.com>
2025-02-26 16:14:02 +00:00
Manny Cortes
082834dd79
fix: prevent model access error during Optuna hyperparameter tuning ( #36395 )
...
* fix: prevent model access error during Optuna hyperparameter tuning
The `transformers.integrations.integration_utils.run_hp_search_optuna` function releases model memory and sets trainer.model to None after each trial. This causes an AttributeError when subsequent Trainer.train calls attempt to access the model before reinitialization. This is only an issue when `fp16_full_eval` or `bf16_full_eval` flags are enabled.
* Update src/transformers/trainer.py
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
---------
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
2025-02-26 17:06:48 +01:00
zheliuyu
6513e5e402
add recommendations for NPU using flash_attn ( #36383 )
...
* add recommendations for Ascend NPU using flash_attn
* update recommend_message_npu
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
---------
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
2025-02-26 14:51:08 +01:00
Nicolas Patry
b4965cecc5
Fixing the docs corresponding to the breaking change in torch 2.6. ( #36420 )
2025-02-26 14:11:52 +01:00
Aymeric Roucher
9a217fc327
Deprecate transformers.agents ( #36415 )
2025-02-26 11:38:47 +01:00
Zach Mueller
41925e4213
Add retry hf hub decorator ( #35213 )
...
* Add retry torch decorator
* New approach
* Empty commit
* Empty commit
* Style
* Use logger.error
* Add a test
* Update src/transformers/testing_utils.py
Co-authored-by: Lucain <lucainp@gmail.com>
* Fix err
* Update tests/utils/test_modeling_utils.py
---------
Co-authored-by: Lucain <lucainp@gmail.com>
Co-authored-by: Yih-Dar <2521628+ydshieh@users.noreply.github.com>
2025-02-25 20:53:11 +01:00
