transformers/docs/source/main_classes
Nicolas Patry c63fcabfe9
[Large PR] Entire rework of pipelines. (#13308)
* Enabling dataset iteration on pipelines.

Enabling dataset iteration on pipelines.

Unifying parameters under `set_parameters` function.

Small fix.

Last fixes after rebase

Remove print.

Fixing text2text `generate_kwargs`

No more `self.max_length`.

Fixing tf only conversational.

Consistency in start/stop index over TF/PT.

Speeding up drastically on TF (nasty bug where max_length would increase
a ton.)

Adding test for support for non fast tokenizers.

Fixign GPU usage on zero-shot.

Fix working on Tf.

Update src/transformers/pipelines/base.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

Update src/transformers/pipelines/base.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

Small cleanup.

Remove all asserts + simple format.

* Fixing audio-classification for large PR.

* Overly explicity null checking.

* Encapsulating GPU/CPU pytorch manipulation directly within `base.py`.

* Removed internal state for parameters of the  pipeline.

Instead of overriding implicitly internal state, we moved
to real named arguments on every `preprocess`, `_forward`,
`postprocess` function.

Instead `_sanitize_parameters` will be used to split all kwargs
of both __init__ and __call__ into the 3 kinds of named parameters.

* Move import warnings.

* Small fixes.

* Quality.

* Another small fix, using the CI to debug faster.

* Last fixes.

* Last fix.

* Small cleanup of tensor moving.

* is not None.

* Adding a bunch of docs + a iteration test.

* Fixing doc style.

* KeyDataset = None guard.

* RRemoving the Cuda test for pipelines (was testing).

* Even more simple iteration test.

* Correct import .

* Long day.

* Fixes in docs.

* [WIP] migrating object detection.

* Fixed the target_size bug.

* Fixup.

* Bad variable name.

* Fixing `ensure_on_device` respects original ModelOutput.
2021-09-10 14:47:48 +02:00
..
callback.rst Add example for registering callbacks with trainers (#10928) 2021-04-05 12:27:23 -04:00
configuration.rst Update model configs - Allow setters for common properties (#13026) 2021-09-06 16:30:13 +02:00
data_collator.rst TF/Numpy variants for all DataCollator classes (#13105) 2021-08-31 13:06:48 +01:00
deepspeed.rst Fix typo in deepspeed documentation (#13482) 2021-09-08 11:24:10 -07:00
feature_extractor.rst Add ImageFeatureExtractionMixin (#10905) 2021-03-26 11:23:56 -04:00
logging.rst Logging propagation (#10092) 2021-02-09 10:27:49 -05:00
model.rst Fix push_to_hub docstring and make it appear in doc (#12770) 2021-07-17 15:52:33 +02:00
optimizer_schedules.rst Seq2seq trainer (#9241) 2020-12-22 11:33:44 -05:00
output.rst [Flax] Correct flax docs (#12782) 2021-08-04 16:31:23 +02:00
pipelines.rst [Large PR] Entire rework of pipelines. (#13308) 2021-09-10 14:47:48 +02:00
processors.rst Examples reorg (#11350) 2021-04-21 11:11:20 -04:00
tokenizer.rst Fix push_to_hub docstring and make it appear in doc (#12770) 2021-07-17 15:52:33 +02:00
trainer.rst fixed document (#13414) 2021-09-08 11:48:00 -04:00