transformers/examples/research_projects
Stas Bekman 11d86d3de4
[Deepspeed Wav2vec2] integration (#11638)
* wip

* wip - but working with https://github.com/microsoft/DeepSpeed/pull/1044

* cleanup

* workaround

* working 5/8 modes

* solve fp32 distributed zero3

* style

* sync

* sync

* rework

* deprecation

* cleanup

* https://github.com/microsoft/DeepSpeed/pull/1044 pr was merged

* clean up

* add a guide

* more prose

* more prose

* fix

* more prose

* sub_group_size was too big

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* refactor

* bug fix

* make the true check explicit

* new deepspeed release

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2021-06-08 12:32:03 -07:00
..
adversarial Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
bert-loses-patience make style (#11442) 2021-04-26 13:50:34 +02:00
bertabs make style (#11442) 2021-04-26 13:50:34 +02:00
bertology make style (#11442) 2021-04-26 13:50:34 +02:00
deebert make style (#11442) 2021-04-26 13:50:34 +02:00
distillation Variable Correction for Consistency in Distillation Example (#11444) 2021-04-26 13:30:48 -04:00
longform-qa Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
lxmert Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027) 2021-06-08 13:58:38 +01:00
mlm_wwm Fit chinese wwm to new datasets (#9887) 2021-02-01 03:37:59 -05:00
mm-imdb [Examples] Fix invalid links after reorg (#11650) 2021-05-10 11:16:48 +05:30
movement-pruning Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027) 2021-06-08 13:58:38 +01:00
performer Adding performer fine-tuning research exampke (#9239) 2020-12-21 21:19:41 +01:00
pplm Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
rag Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027) 2021-06-08 13:58:38 +01:00
rag-end2end-retriever Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027) 2021-06-08 13:58:38 +01:00
seq2seq-distillation Close open files to suppress ResourceWarning (#11240) 2021-04-14 10:31:04 -04:00
wav2vec2 [Deepspeed Wav2vec2] integration (#11638) 2021-06-08 12:32:03 -07:00
zero-shot-distillation Update README.md (#11489) 2021-04-30 04:29:59 -04:00
README.md Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00

Research projects

This folder contains various research projects using 🤗 Transformers. They are not maintained and require a specific version of 🤗 Transformers that is indicated in the requirements file of each folder. Updating them to the most recent version of the library will require some work.

To use any of them, just run the command

pip install -r requirements.txt

inside the folder of your choice.

If you need help with any of those, contact the author(s), indicated at the top of the README of each folder.