transformers/examples/research_projects
Patrick von Platen eef66035a2
[PyTorch Bart] Split Bart into different models (#9343)
* first try

* remove old template

* finish bart

* finish mbart

* delete unnecessary line

* init pegasus

* save intermediate

* correct pegasus

* finish pegasus

* remove cookie cutter leftover

* add marian

* finish blenderbot

* replace in file

* correctly split blenderbot

* delete "old" folder

* correct "add statement"

* adapt config for tf comp

* correct configs for tf

* remove ipdb

* fix more stuff

* fix mbart

* push pegasus fix

* fix mbart

* more fixes

* fix research projects code

* finish docs for bart, mbart, and marian

* delete unnecessary file

* correct attn typo

* correct configs

* remove pegasus for seq class

* correct peg docs

* correct peg docs

* finish configs

* further improve docs

* add copied from statements to mbart

* fix copied from in mbart

* add copy statements to marian

* add copied from to marian

* add pegasus copied from

* finish pegasus

* finish copied from

* Apply suggestions from code review

* make style

* backward comp blenderbot

* apply lysandres and sylvains suggestions

* apply suggestions

* push last fixes

* fix docs

* fix tok tests

* fix imports code style

* fix doc
2021-01-05 22:00:05 +01:00
..
adversarial Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
bert-loses-patience Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
bertabs Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
bertology GPT-model attention heads pruning example (#9189) 2020-12-18 16:32:10 -05:00
deebert Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
distillation Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
longform-qa Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
lxmert Bump notebook from 6.1.4 to 6.1.5 in /examples/research_projects/lxmert (#9402) 2021-01-04 10:02:07 -05:00
mm-imdb Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
movement-pruning Bump notebook in /examples/research_projects/movement-pruning/lxmert (#9062) 2020-12-11 10:32:43 -05:00
performer Adding performer fine-tuning research exampke (#9239) 2020-12-21 21:19:41 +01:00
pplm Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
rag Fix typos in README and bugs in RAG example code for end-to-end evaluation and finetuning (#9355) 2021-01-03 16:00:30 +01:00
seq2seq-distillation [PyTorch Bart] Split Bart into different models (#9343) 2021-01-05 22:00:05 +01:00
README.md Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00

Research projects

This folder contains various research projects using 🤗 Transformers. They are not maintained and require a specific version of 🤗 Transformers that is indicated in the requirements file of each folder. Updating them to the most recent version of the library will require some work.

To use any of them, just run the command

pip install -r requirements.txt

inside the folder of your choice.

If you need help with any of those, contact the author(s), indicated at the top of the README of each folder.