transformers/examples/research_projects
NielsRogge 31ee80d556
Add LayoutLMv3 (#17060)
* Make forward pass work

* More improvements

* Remove unused imports

* Remove timm dependency

* Improve loss calculation of token classifier

* Fix most tests

* Add docs

* Add model integration test

* Make all tests pass

* Add LayoutLMv3FeatureExtractor

* Improve integration test + make fixup

* Add example script

* Fix style

* Add LayoutLMv3Processor

* Fix style

* Add option to add visual labels

* Make more tokenizer tests pass

* Fix more tests

* Make more tests pass

* Fix bug and improve docs

* Fix import of processors

* Improve docstrings

* Fix toctree and improve docs

* Fix auto tokenizer

* Move tests to model folder

* Move tests to model folder

* change default behavior add_prefix_space

* add prefix space for fast

* add_prefix_spcae set to True for Fast

* no space before `unique_no_split` token

* add test to hightligh special treatment of added tokens

* fix `test_batch_encode_dynamic_overflowing` by building a long enough example

* fix `test_full_tokenizer` with add_prefix_token

* Fix tokenizer integration test

* Make the code more readable

* Add tests for LayoutLMv3Processor

* Fix style

* Add model to README and update init

* Apply suggestions from code review

* Replace asserts by value errors

* Add suggestion by @ducviet00

* Add model to doc tests

* Simplify script

* Improve README

* a step ahead to fix

* Update pair_input_test

* Make all tokenizer tests pass - phew

* Make style

* Add LayoutLMv3 to CI job

* Fix auto mapping

* Fix CI job name

* Make all processor tests pass

* Make tests of LayoutLMv2 and LayoutXLM consistent

* Add copied from statements to fast tokenizer

* Add copied from statements to slow tokenizer

* Remove add_visual_labels attribute

* Fix tests

* Add link to notebooks

* Improve docs of LayoutLMv3Processor

* Fix reference to section

Co-authored-by: SaulLu <lucilesaul.com@gmail.com>
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
2022-05-24 09:53:45 +02:00
..
adversarial Black preview (#17217) 2022-05-12 16:25:55 -04:00
bert-loses-patience Black preview (#17217) 2022-05-12 16:25:55 -04:00
bertabs Black preview (#17217) 2022-05-12 16:25:55 -04:00
bertology Black preview (#17217) 2022-05-12 16:25:55 -04:00
codeparrot Fix CodeParrot training script (#17291) 2022-05-23 12:55:35 +02:00
decision_transformer Decision transformer gym (#15845) 2022-03-23 16:18:43 -04:00
deebert Black preview (#17217) 2022-05-12 16:25:55 -04:00
distillation Black preview (#17217) 2022-05-12 16:25:55 -04:00
fsner Black preview (#17217) 2022-05-12 16:25:55 -04:00
information-gain-filtration Fix style 2022-05-18 10:46:40 -04:00
jax-projects fixed bug in run_mlm_flax_stream.py (#17203) 2022-05-16 13:40:27 +02:00
layoutlmv3 Add LayoutLMv3 (#17060) 2022-05-24 09:53:45 +02:00
longform-qa Black preview (#17217) 2022-05-12 16:25:55 -04:00
luke Black preview (#17217) 2022-05-12 16:25:55 -04:00
lxmert Black preview (#17217) 2022-05-12 16:25:55 -04:00
mlm_wwm Black preview (#17217) 2022-05-12 16:25:55 -04:00
mm-imdb Black preview (#17217) 2022-05-12 16:25:55 -04:00
movement-pruning Black preview (#17217) 2022-05-12 16:25:55 -04:00
onnx/summarization Black preview (#17217) 2022-05-12 16:25:55 -04:00
performer Black preview (#17217) 2022-05-12 16:25:55 -04:00
pplm Black preview (#17217) 2022-05-12 16:25:55 -04:00
quantization-qdqbert Black preview (#17217) 2022-05-12 16:25:55 -04:00
rag Black preview (#17217) 2022-05-12 16:25:55 -04:00
rag-end2end-retriever Black preview (#17217) 2022-05-12 16:25:55 -04:00
robust-speech-event Black preview (#17217) 2022-05-12 16:25:55 -04:00
self-training-text-classification Black preview (#17217) 2022-05-12 16:25:55 -04:00
seq2seq-distillation Black preview (#17217) 2022-05-12 16:25:55 -04:00
tapex Black preview (#17217) 2022-05-12 16:25:55 -04:00
visual_bert Black preview (#17217) 2022-05-12 16:25:55 -04:00
wav2vec2 Fix bug in Wav2Vec2 pretrain example (#17326) 2022-05-19 22:42:44 +02:00
xtreme-s Black preview (#17217) 2022-05-12 16:25:55 -04:00
zero-shot-distillation Updates the default branch from master to main (#16326) 2022-03-23 03:46:59 -04:00
README.md Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00

Research projects

This folder contains various research projects using 🤗 Transformers. They are not maintained and require a specific version of 🤗 Transformers that is indicated in the requirements file of each folder. Updating them to the most recent version of the library will require some work.

To use any of them, just run the command

pip install -r requirements.txt

inside the folder of your choice.

If you need help with any of those, contact the author(s), indicated at the top of the README of each folder.