mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-23 14:29:01 +06:00
43f953cc2e
* add readme skeleton * update readme * add initialization script * add deduplication script * add codeparrot training script * add code generation evaluation * add validation loss script * add requirements * update readme * tweak readme * make style * add highlights to readme * add CLIs to scripts * add tokenizer training script * add docstring to constant length dataset * fix defaults in arguments * update readme with cli * move image to hub * tweaks of readme * fix cli commands * add author * explain env variables * fix formatting * Update examples/research_projects/codeparrot/README.md Co-authored-by: lewtun <lewis.c.tunstall@gmail.com> * Apply suggestions from code review Co-authored-by: lewtun <lewis.c.tunstall@gmail.com> * replace generic with gpt2 tokenizer Co-authored-by: lewtun <lewis.c.tunstall@gmail.com>
7 lines
125 B
Plaintext
7 lines
125 B
Plaintext
transformers==4.12.2
|
|
datasets==1.16.0
|
|
accelerate==0.5.1
|
|
wandb==0.12.0
|
|
tensorboard==2.6.0
|
|
torch==1.9.0
|
|
huggingface-hub==0.0.19 |