transformers/tests
Nicolas Patry a4562552eb
[DX fix] Fixing QA pipeline streaming a dataset. (#18516)
* [DX fix] Fixing QA pipeline streaming a dataset.

QuestionAnsweringArgumentHandler would iterate over the whole dataset
effectively killing all properties of the pipeline.
This restores nice properties when using `Dataset` or `Generator` since
those are meant to be consumed lazily.

* Handling TF better.
2022-08-08 14:25:56 +02:00
..
benchmark [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
deepspeed deprecate is_torch_bf16_available (#17738) 2022-06-20 08:40:11 -04:00
extended Update self-push workflow (#17177) 2022-05-13 16:28:00 +02:00
fixtures add a warning in SpmConverter for sentencepiece's model using the byte fallback feature (#16629) 2022-04-11 11:06:10 +02:00
generation Generate: deprecate default max_length (#18018) 2022-07-23 18:02:03 +01:00
models Add TF prefix to TF-Res test class (#18481) 2022-08-05 13:59:55 +02:00
onnx disable Onnx test for google/long-t5-tglobal-base (#18454) 2022-08-05 19:27:19 +02:00
optimization [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
pipelines [DX fix] Fixing QA pipeline streaming a dataset. (#18516) 2022-08-08 14:25:56 +02:00
sagemaker transformers-cli login => huggingface-cli login (#18490) 2022-08-06 09:42:55 +02:00
tokenization fix train_new_from_iterator in the case of byte-level tokenizers (#17549) 2022-06-08 15:30:41 +02:00
trainer Enable torchdynamo with torch_tensorrt(fx path) (#17765) 2022-07-13 12:43:28 -04:00
utils Update serving code to enable saved_model=True (#18153) 2022-07-22 18:05:38 +01:00
__init__.py
test_configuration_common.py Use new huggingface_hub tools for download models (#18438) 2022-08-05 10:12:40 -04:00
test_feature_extraction_common.py Use new huggingface_hub tools for download models (#18438) 2022-08-05 10:12:40 -04:00
test_modeling_common.py Use new huggingface_hub tools for download models (#18438) 2022-08-05 10:12:40 -04:00
test_modeling_flax_common.py Rewrite push_to_hub to use upload_files (#18366) 2022-08-01 12:07:30 -04:00
test_modeling_tf_common.py Use new huggingface_hub tools for download models (#18438) 2022-08-05 10:12:40 -04:00
test_sequence_feature_extraction_common.py Some tests misusing assertTrue for comparisons fix (#16771) 2022-04-19 14:44:08 +02:00
test_tokenization_common.py Use new huggingface_hub tools for download models (#18438) 2022-08-05 10:12:40 -04:00