riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-23 06:20:22 +06:00
Code Issues Actions 34 Packages Projects Releases Wiki Activity
d472bd7b18
transformers/examples/research_projects
History
Anton Lozhkov d472bd7b18
Wav2Vec2 Pretraining (#11306) 
* Working quantizer forward

* Working quantizer forward

* Clean up unused model parts, test reproducibility

* Working quantizer forward

* Clean up unused model parts, test reproducibility

* Remove custom outputs from the shared ones

* correct conversion

* correct bug

* add first pretrain script

* save intermediate

* static shapes

* save intermediate

* finish first pretrain script version

* more refactor

* remove wanddb

* refactor more

* improve test

* correct perplexity compute bug

* finish model implementation

* add to docs

* finish docs

* finish pretraining script

* finish pretraining script

* remove wandb

* finish PR for merge

* finish config

* finish

* make deepspeed work

* Apply suggestions from code review

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* apply suggestions

* fix flaky test

Co-authored-by: patrickvonplaten <patrick.v.platen@gmail.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2021-06-09 18:40:56 +01:00
..
adversarial Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
bert-loses-patience make style (#11442) 2021-04-26 13:50:34 +02:00
bertabs make style (#11442) 2021-04-26 13:50:34 +02:00
bertology make style (#11442) 2021-04-26 13:50:34 +02:00
deebert make style (#11442) 2021-04-26 13:50:34 +02:00
distillation Variable Correction for Consistency in Distillation Example (#11444) 2021-04-26 13:30:48 -04:00
longform-qa Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
lxmert Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027) 2021-06-08 13:58:38 +01:00
mlm_wwm Fit chinese wwm to new datasets (#9887) 2021-02-01 03:37:59 -05:00
mm-imdb [Examples] Fix invalid links after reorg (#11650) 2021-05-10 11:16:48 +05:30
movement-pruning Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027) 2021-06-08 13:58:38 +01:00
performer Adding performer fine-tuning research exampke (#9239) 2020-12-21 21:19:41 +01:00
pplm Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
rag Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027) 2021-06-08 13:58:38 +01:00
rag-end2end-retriever Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027) 2021-06-08 13:58:38 +01:00
seq2seq-distillation Close open files to suppress ResourceWarning (#11240) 2021-04-14 10:31:04 -04:00
wav2vec2 Wav2Vec2 Pretraining (#11306) 2021-06-09 18:40:56 +01:00
zero-shot-distillation Update README.md (#11489) 2021-04-30 04:29:59 -04:00
README.md Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00

README.md

Research projects

This folder contains various research projects using 🤗 Transformers. They are not maintained and require a specific version of 🤗 Transformers that is indicated in the requirements file of each folder. Updating them to the most recent version of the library will require some work.

To use any of them, just run the command

pip install -r requirements.txt

inside the folder of your choice.

If you need help with any of those, contact the author(s), indicated at the top of the README of each folder.