transformers/docs/source
Nicolas Patry b058490ceb
ChunkPipeline (batch_size enabled on zero-cls and qa pipelines. (#14225)
* Pipeline chunks.

* Batching for Chunking pipelines ?

* Batching for `question-answering` and `zero-shot-cls`.

* Fixing for FNet.

* Making ASR a chunk pipeline.

* Chunking ASR API.

* doc style.

* Fixing ASR test.

* Fixing QA eror (p_mask, padding is 1, not 0).

* Enable both vad and simple chunking.

* Max length for vad.

* remove inference mode, crashing on s2t.

* Revert ChunkPipeline for ASRpipeline.

Too many knobs for simple integration within the pipeline, better stick
to external convenience functions instead, more control to be had,
simpler pipeline and also easier to replace with other things later.

* Drop necessity for PT for these.

* Enabling generators.

* Add mic + cleanup.

* Typo.

* Typo2.

* Remove ASR work, it does not belong in this PR anymore.

* Update src/transformers/pipelines/pt_utils.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/pipelines/zero_shot_classification.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Adding many comments.

* Doc quality.

* `hidden_states` handling.

* Adding doc.

* Bad rebase.

* Autofixing docs.

* Fixing CRITICAL bug in the new Zerocls pipeline.

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
2021-12-27 11:26:20 +01:00
..
internal Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
main_classes ChunkPipeline (batch_size enabled on zero-cls and qa pipelines. (#14225) 2021-12-27 11:26:20 +01:00
model_doc Add TFCLIPModel (#13967) 2021-12-23 11:19:44 -05:00
_config.py Prevent style_doc from tempering the config file 2021-12-10 15:31:43 -05:00
_toctree.yml Feature/fix slow test in mluke (#14749) 2021-12-22 06:35:59 -05:00
add_new_model.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
add_new_pipeline.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
benchmarks.mdx Fix dead link to benchmarks.ipynb (#14842) 2021-12-20 09:08:05 -05:00
bertology.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
community.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
contributing.md Update installation page and add contributing to the doc (#5084) 2020-06-17 14:01:10 -04:00
converting_tensorflow_models.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
custom_datasets.mdx Put back open in colab markers (#14684) 2021-12-09 12:00:06 -05:00
debugging.mdx [doc porting] several docs (#14858) 2021-12-21 09:55:25 -08:00
examples.md per_device instead of per_gpu/error thrown when argument unknown (#4618) 2020-05-27 11:36:55 -04:00
fast_tokenizers.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
glossary.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
index.mdx Add TFCLIPModel (#13967) 2021-12-23 11:19:44 -05:00
installation.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
migration.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
model_sharing.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
model_summary.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
multilingual.mdx Put back open in colab markers (#14684) 2021-12-09 12:00:06 -05:00
notebooks.md Update notebooks (#3620) 2020-04-06 14:32:39 -04:00
parallelism.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
performance.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
perplexity.mdx Removes images to put them in a dataset (#14781) 2021-12-16 04:42:02 -05:00
philosophy.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
pr_checks.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
preprocessing.mdx Put back open in colab markers (#14684) 2021-12-09 12:00:06 -05:00
quicktour.mdx Swap TF and PT code inside two blocks (#14742) 2021-12-13 10:31:11 -05:00
sagemaker.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
serialization.mdx Add ONNX support for MarianMT models (#14586) 2021-12-23 13:35:56 +01:00
task_summary.mdx Put back open in colab markers (#14684) 2021-12-09 12:00:06 -05:00
testing.mdx [doc porting] several docs (#14858) 2021-12-21 09:55:25 -08:00
tokenizer_summary.mdx Put back open in colab markers (#14684) 2021-12-09 12:00:06 -05:00
training.mdx Put back open in colab markers (#14684) 2021-12-09 12:00:06 -05:00
troubleshooting.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00