mirror of
https://github.com/huggingface/transformers.git
synced 2025-08-02 11:11:05 +06:00
4868a830db
* add simple multi gpu complet * add human_eval_multi_gpu * use copy strategy to distribute across gpu, to avoid padding * add doc string * update code style * use task id to arrange output * truncate input to avoid zero pad * Stop the copy mechanism * update style * restore copies to scale better in distributed mode * update style * replace human eval * Apply suggestions from code review 1. Tokenize all input at the same time 2. use attention_mask to get the input length 3. other small fixes Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com> * correct typo and update docstring * update code style * remove num sample division constraint * remove max len calculation * use accelerator.gather once to speed up * use accelerate set_seed; update accelerate version * correct gather bug Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| adversarial | ||
| bert-loses-patience | ||
| bertabs | ||
| bertology | ||
| codeparrot | ||
| decision_transformer | ||
| deebert | ||
| distillation | ||
| fsner | ||
| jax-projects | ||
| longform-qa | ||
| luke | ||
| lxmert | ||
| mlm_wwm | ||
| mm-imdb | ||
| movement-pruning | ||
| onnx/summarization | ||
| performer | ||
| pplm | ||
| quantization-qdqbert | ||
| rag | ||
| rag-end2end-retriever | ||
| robust-speech-event | ||
| seq2seq-distillation | ||
| tapex | ||
| visual_bert | ||
| wav2vec2 | ||
| xtreme-s | ||
| zero-shot-distillation | ||
| README.md | ||
Research projects
This folder contains various research projects using 🤗 Transformers. They are not maintained and require a specific version of 🤗 Transformers that is indicated in the requirements file of each folder. Updating them to the most recent version of the library will require some work.
To use any of them, just run the command
pip install -r requirements.txt
inside the folder of your choice.
If you need help with any of those, contact the author(s), indicated at the top of the README of each folder.