wlhgtc
|
9a21b50614
|
Fix eval ref miss in Chinese WWM. (#8115)
* ADD: add whole word mask proxy for both eng and chinese
* MOD: adjust format
* MOD: reformat code
* MOD: update import
* MOD: fix bug
* MOD: add import
* MOD: fix bug
* MOD: decouple code and update readme
* MOD: reformat code
* Update examples/language-modeling/README.md
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update examples/language-modeling/README.md
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update examples/language-modeling/run_language_modeling.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update examples/language-modeling/run_language_modeling.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update examples/language-modeling/run_language_modeling.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update examples/language-modeling/run_language_modeling.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* change wwm to whole_word_mask
* reformat code
* reformat
* format
* Code quality
* ADD: update chinese ref readme
* MOD: small changes
* MOD: small changes2
* update readme
* fix eval ref file miss bug
* format file
* MOD: move ref code to contrib
* MOD: add delimeter check
* reformat code
* refomat code
* Update examples/language-modeling/README.md
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <sylvain.gugger@gmail.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
|
2020-10-29 17:08:39 -04:00 |
|