transformers/examples/research_projects
Joe Davison c6fe17557e
Script for distilling zero-shot classifier to more efficient student (#10244)
* add zero-shot distillation script

* readme wordsmithing

* clean up code

* add multi-gpu teacher inference
plus tidying up more code

* add use_fast_tokenizer arg

* update results in readme

* more readme wordsmithing

* style

* Add handle to readme

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* fix code block

* add error+docs about distributed & tpu

* add @sgugger format requests

* xla -> tpu

* support fp16 for teacher preds

* no checkpoint by default

* add demo colab link

* add model sharing prompt + model link

* correct resulting acc of example

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
2021-02-18 17:08:45 -05:00
..
adversarial Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
bert-loses-patience Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
bertabs Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
bertology Line endings should be LF across repo and not CRLF (#10119) 2021-02-10 10:50:00 -05:00
deebert Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
distillation Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
longform-qa Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
lxmert [research proj] [lxmert] rm bleach dependency (#9970) 2021-02-03 05:24:40 -05:00
mlm_wwm Fit chinese wwm to new datasets (#9887) 2021-02-01 03:37:59 -05:00
mm-imdb Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
movement-pruning Remove nested lxmert (#9440) 2021-01-07 04:10:41 -05:00
performer Adding performer fine-tuning research exampke (#9239) 2020-12-21 21:19:41 +01:00
pplm Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
rag Fix typos in README and bugs in RAG example code for end-to-end evaluation and finetuning (#9355) 2021-01-03 16:00:30 +01:00
seq2seq-distillation [PyTorch Bart] Split Bart into different models (#9343) 2021-01-05 22:00:05 +01:00
zero-shot-distillation Script for distilling zero-shot classifier to more efficient student (#10244) 2021-02-18 17:08:45 -05:00
README.md Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00

Research projects

This folder contains various research projects using 🤗 Transformers. They are not maintained and require a specific version of 🤗 Transformers that is indicated in the requirements file of each folder. Updating them to the most recent version of the library will require some work.

To use any of them, just run the command

pip install -r requirements.txt

inside the folder of your choice.

If you need help with any of those, contact the author(s), indicated at the top of the README of each folder.