transformers/examples/research_projects
Loubna Ben Allal 05a90579a8
CodeParrot data pretokenization (#16932)
* add pretokenization arguments

* add pretokenization script

* add support for pretokenized data

* reformat code

* fix run command for training

* fix model call from config

* remove a package

* add comments on pretokenization in the readme

* remove explicit parallelization

Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com>

* update readme

Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com>

* update readme -remove username

Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com>

* update readme -remove username

Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com>

* keep data parallelization

* reformat code

* reformat code

* update readme

* reformat code

* Update examples/research_projects/codeparrot/README.md

Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com>

Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com>
Co-authored-by: Loubna ben allal <loubnabenallal@gmail.com>
2022-05-16 15:32:16 +02:00
..
adversarial Black preview (#17217) 2022-05-12 16:25:55 -04:00
bert-loses-patience Black preview (#17217) 2022-05-12 16:25:55 -04:00
bertabs Black preview (#17217) 2022-05-12 16:25:55 -04:00
bertology Black preview (#17217) 2022-05-12 16:25:55 -04:00
codeparrot CodeParrot data pretokenization (#16932) 2022-05-16 15:32:16 +02:00
decision_transformer Decision transformer gym (#15845) 2022-03-23 16:18:43 -04:00
deebert Black preview (#17217) 2022-05-12 16:25:55 -04:00
distillation Black preview (#17217) 2022-05-12 16:25:55 -04:00
fsner Black preview (#17217) 2022-05-12 16:25:55 -04:00
jax-projects fixed bug in run_mlm_flax_stream.py (#17203) 2022-05-16 13:40:27 +02:00
longform-qa Black preview (#17217) 2022-05-12 16:25:55 -04:00
luke Black preview (#17217) 2022-05-12 16:25:55 -04:00
lxmert Black preview (#17217) 2022-05-12 16:25:55 -04:00
mlm_wwm Black preview (#17217) 2022-05-12 16:25:55 -04:00
mm-imdb Black preview (#17217) 2022-05-12 16:25:55 -04:00
movement-pruning Black preview (#17217) 2022-05-12 16:25:55 -04:00
onnx/summarization Black preview (#17217) 2022-05-12 16:25:55 -04:00
performer Black preview (#17217) 2022-05-12 16:25:55 -04:00
pplm Black preview (#17217) 2022-05-12 16:25:55 -04:00
quantization-qdqbert Black preview (#17217) 2022-05-12 16:25:55 -04:00
rag Black preview (#17217) 2022-05-12 16:25:55 -04:00
rag-end2end-retriever Black preview (#17217) 2022-05-12 16:25:55 -04:00
robust-speech-event Black preview (#17217) 2022-05-12 16:25:55 -04:00
self-training-text-classification Black preview (#17217) 2022-05-12 16:25:55 -04:00
seq2seq-distillation Black preview (#17217) 2022-05-12 16:25:55 -04:00
tapex Black preview (#17217) 2022-05-12 16:25:55 -04:00
visual_bert Black preview (#17217) 2022-05-12 16:25:55 -04:00
wav2vec2 Black preview (#17217) 2022-05-12 16:25:55 -04:00
xtreme-s Black preview (#17217) 2022-05-12 16:25:55 -04:00
zero-shot-distillation Updates the default branch from master to main (#16326) 2022-03-23 03:46:59 -04:00
README.md Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00

Research projects

This folder contains various research projects using 🤗 Transformers. They are not maintained and require a specific version of 🤗 Transformers that is indicated in the requirements file of each folder. Updating them to the most recent version of the library will require some work.

To use any of them, just run the command

pip install -r requirements.txt

inside the folder of your choice.

If you need help with any of those, contact the author(s), indicated at the top of the README of each folder.