transformers/tests
Lysandre Debut e8f90b5397
Split transformers chat and transformers serve (#38443)
* Next token

* Split chat and serve

* Support both generation methods

* Style

* Generation Config

* temp

* temp

* Finalize serving.py

Co-authored-by: =?UTF-8?q?c=C3=A9lina?= <hanouticelina@gmail.com>

* Finalize chat.py

* Update src/transformers/commands/serving.py

Co-authored-by: célina <hanouticelina@gmail.com>

* Lucain's comments

Co-authored-by: Lucain <lucain@huggingface.co>

* Update

* Last comments on PR

* Better error handling

* Better error handling

* CI errors

* CI errors

* Add tests

* Fix tests

* Fix tests

* [chat] Split chat/serve (built on top of lysandre's PR) (#39031)

* Next token

* Split chat and serve

* Support both generation methods

* Style

* Generation Config

* temp

* temp

* Finalize serving.py

Co-authored-by: =?UTF-8?q?c=C3=A9lina?= <hanouticelina@gmail.com>

* Finalize chat.py

* Update src/transformers/commands/serving.py

Co-authored-by: célina <hanouticelina@gmail.com>

* Lucain's comments

Co-authored-by: Lucain <lucain@huggingface.co>

* Update

* Last comments on PR

* Better error handling

* Better error handling

* CI errors

* CI errors

* Add tests

* Fix tests

* Fix tests

* streaming tool call

* abstract tool state; set tool start as eos

* todos

* server working on models without tools

* rm chat's deprecated flags

* chat defaults

* kv cache persists across calls

* add server docs

* link

* Update src/transformers/commands/serving.py

* Apply suggestions from code review

* i love merge conflicts

* solve multi turn with tiny-agents

* On the fly switching of the models

* Remove required positional arg

---------

Co-authored-by: Lysandre <hi@lysand.re>
Co-authored-by: =?UTF-8?q?c=C3=A9lina?= <hanouticelina@gmail.com>
Co-authored-by: Lucain <lucain@huggingface.co>

* Protect names

* Fix tests

---------

Co-authored-by: =?UTF-8?q?c=C3=A9lina?= <hanouticelina@gmail.com>
Co-authored-by: Lucain <lucain@huggingface.co>
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
2025-06-30 15:10:53 +02:00
..
bettertransformer Use Python 3.9 syntax in tests (#37343) 2025-04-08 14:12:08 +02:00
commands Split transformers chat and transformers serve (#38443) 2025-06-30 15:10:53 +02:00
deepspeed Remove script datasets in tests (#38940) 2025-06-25 14:31:20 +00:00
extended Add Optional to remaining types (#37808) 2025-04-28 14:20:45 +01:00
fixtures [tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051) 2025-06-26 16:25:00 +01:00
fsdp Gaudi3 CI (#38790) 2025-06-23 10:56:51 +02:00
generation fix test_compare_unprocessed_logit_scores (#39053) 2025-06-26 18:36:56 +02:00
models fix UT failures on XPU w/ stock PyTorch 2.7 & 2.8 (#39116) 2025-06-30 11:49:03 +02:00
optimization [tests] remove TF tests (uses of require_tf) (#38944) 2025-06-25 17:29:10 +00:00
peft_integration TST Fix PEFT integration test bitsandbytes config (#39082) 2025-06-27 18:33:11 +02:00
pipelines Fixes the failing test test_is_split_into_words in test_pipelines_token_classification.py (#39079) 2025-06-27 19:25:32 +01:00
quantization fix UT failures on XPU w/ stock PyTorch 2.7 & 2.8 (#39116) 2025-06-30 11:49:03 +02:00
repo_utils Use HF papers (#38184) 2025-06-13 11:07:09 +00:00
sagemaker Deprecate TF + JAX (#38758) 2025-06-11 17:28:06 +01:00
tensor_parallel fix UT failures on XPU w/ stock PyTorch 2.7 & 2.8 (#39116) 2025-06-30 11:49:03 +02:00
tokenization [tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051) 2025-06-26 16:25:00 +01:00
trainer [tests] remove TF tests (uses of require_tf) (#38944) 2025-06-25 17:29:10 +00:00
utils [tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051) 2025-06-26 16:25:00 +01:00
__init__.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
causal_lm_tester.py Refactor DBRX tests to use CausalLMModelTest base classes (#38475) 2025-06-13 16:22:12 +01:00
test_backbone_common.py Use Python 3.9 syntax in tests (#37343) 2025-04-08 14:12:08 +02:00
test_configuration_common.py Update composition flag usage (#36263) 2025-04-09 11:48:49 +02:00
test_feature_extraction_common.py Use Python 3.9 syntax in tests (#37343) 2025-04-08 14:12:08 +02:00
test_image_processing_common.py Add Idefics2/3 and SmolVLM Fast image processors + improvements for fast image processors (#38157) 2025-06-23 14:17:25 +00:00
test_image_transforms.py [tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051) 2025-06-26 16:25:00 +01:00
test_modeling_common.py skip some test_sdpa_can_dispatch_on_flash (#39092) 2025-06-27 23:08:14 +02:00
test_pipeline_mixin.py No more Tuple, List, Dict (#38797) 2025-06-17 19:37:18 +01:00
test_processing_common.py [video processors] support frame sampling within processors (#38105) 2025-06-12 09:34:30 +00:00
test_sequence_feature_extraction_common.py [tests] remove TF tests (uses of require_tf) (#38944) 2025-06-25 17:29:10 +00:00
test_tokenization_common.py [tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051) 2025-06-26 16:25:00 +01:00
test_training_args.py Fix TrainingArguments.torch_empty_cache_steps post_init check (#36734) 2025-03-17 16:09:46 +01:00
test_video_processing_common.py [video processors] support frame sampling within processors (#38105) 2025-06-12 09:34:30 +00:00