transformers/tests
NielsRogge 2ab790e82d
Add Donut (#18488)
* First draft

* Improve script

* Update script

* Make conversion work

* Add final_layer_norm attribute to Swin's config

* Add DonutProcessor

* Convert more models

* Improve feature extractor and convert base models

* Fix bug

* Improve integration tests

* Improve integration tests and add model to README

* Add doc test

* Add feature extractor to docs

* Fix integration tests

* Remove register_buffer

* Fix toctree and add missing attribute

* Add DonutSwin

* Make conversion script work

* Improve conversion script

* Address comment

* Fix bug

* Fix another bug

* Remove deprecated method from docs

* Make Swin and Swinv2 untouched

* Fix code examples

* Fix processor

* Update model_type to donut-swin

* Add feature extractor tests, add token2json method, improve feature extractor

* Fix failing tests, remove integration test

* Add do_thumbnail for consistency

* Improve code examples

* Add code example for document parsing

* Add DonutSwin to MODEL_NAMES_MAPPING

* Add model to appropriate place in toctree

* Update namespace to appropriate organization

Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
2022-08-12 16:40:58 +02:00
..
benchmark [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
deepspeed deprecate is_torch_bf16_available (#17738) 2022-06-20 08:40:11 -04:00
extended Update self-push workflow (#17177) 2022-05-13 16:28:00 +02:00
fixtures add a warning in SpmConverter for sentencepiece's model using the byte fallback feature (#16629) 2022-04-11 11:06:10 +02:00
generation Generate: validate model_kwargs (and catch typos in generate arguments) (#18261) 2022-08-12 14:53:51 +01:00
mixed_int8 Supporting seq2seq models for bitsandbytes integration (#18579) 2022-08-12 16:15:09 +02:00
models Add Donut (#18488) 2022-08-12 16:40:58 +02:00
onnx Adds CLIP to models exportable with ONNX (#18515) 2022-08-10 15:47:31 -04:00
optimization [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
pipelines Use commit hash to look in cache instead of calling head (#18534) 2022-08-10 11:55:18 -04:00
sagemaker transformers-cli login => huggingface-cli login (#18490) 2022-08-06 09:42:55 +02:00
tokenization fix train_new_from_iterator in the case of byte-level tokenizers (#17549) 2022-06-08 15:30:41 +02:00
trainer Enable torchdynamo with torch_tensorrt(fx path) (#17765) 2022-07-13 12:43:28 -04:00
utils Clean up hub (#18497) 2022-08-08 08:48:10 -04:00
__init__.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
test_configuration_common.py Use commit hash to look in cache instead of calling head (#18534) 2022-08-10 11:55:18 -04:00
test_feature_extraction_common.py Use new huggingface_hub tools for download models (#18438) 2022-08-05 10:12:40 -04:00
test_modeling_common.py Use new huggingface_hub tools for download models (#18438) 2022-08-05 10:12:40 -04:00
test_modeling_flax_common.py Load sharded pt to flax (#18419) 2022-08-12 09:48:10 +02:00
test_modeling_tf_common.py Use new huggingface_hub tools for download models (#18438) 2022-08-05 10:12:40 -04:00
test_sequence_feature_extraction_common.py Some tests misusing assertTrue for comparisons fix (#16771) 2022-04-19 14:44:08 +02:00
test_tokenization_common.py Use new huggingface_hub tools for download models (#18438) 2022-08-05 10:12:40 -04:00