transformers/docs/source
guillaume-be e642c78908
Addition of a DialoguePipeline (#5516)
* initial commit for pipeline implementation

Addition of input processing and history concatenation

* Conversation pipeline tested and working for single & multiple conversation inputs

* Added docstrings for dialogue pipeline

* Addition of dialogue pipeline integration tests

* Delete test_t5.py

* Fixed max code length

* Updated styling

* Fixed test broken by formatting tools

* Removed unused import

* Added unit test for DialoguePipeline

* Fixed Tensorflow compatibility

* Fixed multi-framework support using framework flag

* - Fixed docstring
- Added `min_length_for_response` as an initialization parameter
- Renamed `*args` to `conversations`, `conversations` being a `Conversation` or a `List[Conversation]`
- Updated truncation to truncate entire segments of conversations, instead of cutting in the middle of a user/bot input

* - renamed pipeline name from dialogue to conversational
- removed hardcoded default value of 1000 and use config.max_length instead
- added `append_response` and `set_history` method to the Conversation class to avoid direct fields mutation
- fixed bug in history truncation method

* - Updated ConversationalPipeline to accept only active conversations (otherwise a ValueError is raised)

* - Simplified input tensor conversion

* - Updated attention_mask value for Tensorflow compatibility

* - Updated last dialogue reference to conversational & fixed integration tests

* Fixed conflict with master

* Updates following review comments

* Updated formatting

* Added Conversation and ConversationalPipeline to the library __init__, addition of docstrings for Conversation, added both to the docs

* Update src/transformers/pipelines.py

Updated docsting following review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2020-07-30 14:11:39 -04:00
..
_static Add forum link in the docs (#5637) 2020-07-09 15:13:22 -04:00
imgs Guide to fixed-length model perplexity evaluation (#5449) 2020-07-07 16:04:15 -06:00
internal Model utils doc (#6005) 2020-07-24 09:16:28 -04:00
main_classes Addition of a DialoguePipeline (#5516) 2020-07-30 14:11:39 -04:00
model_doc Actually the extra_id are from 0-99 and not from 1-100 (#5967) 2020-07-30 06:13:29 -04:00
benchmarks.rst [Docs] Benchmark docs (#5360) 2020-06-29 16:08:57 +02:00
bertology.rst [doc] Fix broken links + remove crazy big notebook 2020-05-07 18:44:18 -04:00
conf.py Release: v3.0.2 2020-07-06 18:49:44 -04:00
contributing.md Update installation page and add contributing to the doc (#5084) 2020-06-17 14:01:10 -04:00
converting_tensorflow_models.rst Add ALBERT to the Tensorflow to Pytorch model conversion cli (#3933) 2020-05-11 13:10:00 -04:00
examples.md per_device instead of per_gpu/error thrown when argument unknown (#4618) 2020-05-27 11:36:55 -04:00
favicon.ico Adding usage examples for common tasks (#2850) 2020-02-25 13:48:24 -05:00
glossary.rst Fix typo in glossary (#5466) 2020-07-02 09:19:33 -04:00
index.rst ONNX documentation (#5992) 2020-07-29 11:02:35 +02:00
installation.md Update installation page and add contributing to the doc (#5084) 2020-06-17 14:01:10 -04:00
migration.md Add hugs (#5225) 2020-06-24 07:56:14 -04:00
model_sharing.rst How to share model cards with the CLI (#5374) 2020-06-30 08:59:32 -04:00
model_summary.rst Update model_summary.rst (#5737) 2020-07-27 05:34:02 -04:00
multilingual.rst Refactor Code samples; Test code samples (#5036) 2020-06-25 16:46:00 -04:00
notebooks.md Update notebooks (#3620) 2020-04-06 14:32:39 -04:00
perplexity.rst tiny ppl doc typo fix (#5751) 2020-07-14 10:39:44 -06:00
philosophy.rst Add hugs (#5225) 2020-06-24 07:56:14 -04:00
preprocessing.rst Tokenization tutorial (#5257) 2020-06-24 18:43:20 -04:00
pretrained_models.rst Fix all sphynx warnings (#5068) 2020-06-16 16:50:02 -04:00
quicktour.rst Switch from return_tuple to return_dict (#6138) 2020-07-30 09:17:00 -04:00
serialization.rst Added capability to quantize a model while exporting through ONNX. (#6089) 2020-07-29 13:21:29 +02:00
task_summary.rst Update doc to new model outputs (#5946) 2020-07-21 18:13:55 -04:00
tokenizer_summary.rst doc fixes (#5613) 2020-07-08 19:52:44 -04:00
training.rst Switch from return_tuple to return_dict (#6138) 2020-07-30 09:17:00 -04:00