transformers/examples/research_projects/codeparrot/scripts
Nathan Cooper 48bf7e47a0
Code parrot minor fixes/niceties (#14666)
* Add some nicety flags for better controlling evaluation.

* Fix dependency issue with outdated requirement

* Add additional flag to example to ensure eval is done

* Wrap code into main function for accelerate launcher to find

* Fix valid batch size flag in readme

* Add note to install git-lfs when initializing/training the model

* Update examples/research_projects/codeparrot/scripts/arguments.py

Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com>

* Update examples/research_projects/codeparrot/README.md

Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com>

* Revert "Wrap code into main function for accelerate launcher to find"

This reverts commit ff11df1c81.

* Fix formatting issue

* Move git-lfs instructions to installation section

* Add a quick check before code generation for code evaluation

* Fix styling issue

* Update examples/research_projects/codeparrot/scripts/human_eval.py

Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com>

* Make iterable dataset use passed in tokenizer rather than globally defined one

Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com>
Co-authored-by: ncoop57 <nac33@students.uwf.edu>
2021-12-13 09:30:50 +01:00
..
arguments.py Code parrot minor fixes/niceties (#14666) 2021-12-13 09:30:50 +01:00
bpe_training.py Add CodeParrot 🦜 codebase (#14536) 2021-12-02 10:41:35 +01:00
codeparrot_training.py Code parrot minor fixes/niceties (#14666) 2021-12-13 09:30:50 +01:00
human_eval.py Code parrot minor fixes/niceties (#14666) 2021-12-13 09:30:50 +01:00
initialize_model.py Add CodeParrot 🦜 codebase (#14536) 2021-12-02 10:41:35 +01:00
preprocessing.py Add CodeParrot 🦜 codebase (#14536) 2021-12-02 10:41:35 +01:00
validation_loss.py Add CodeParrot 🦜 codebase (#14536) 2021-12-02 10:41:35 +01:00