Julien Chaumond
757baee846
Fix un-prefixed f-string
...
see https://github.com/huggingface/transformers/pull/4367#discussion_r426356693
Hat/tip @girishponkiya
2020-05-18 11:20:46 -04:00
Julien Chaumond
448c467256
Fix: unpin flake8 and fix cs errors ( #4367 )
...
* Fix: unpin flake8 and fix cs errors
* Ok we still need to quote those
2020-05-14 13:14:26 -04:00
VictorSanh
2ae98336d1
fix vocab size in binarized_data (distil): int16 vs int32
2020-02-18 16:17:35 +00:00
alberduris
81d6841b4b
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
alberduris
dd4df80f0b
Moved the encoded_prompts to correct device
2020-01-06 15:11:12 +01:00
Aymeric Augustin
783a616999
Fix F401 flake8 warning (x88 / 116).
...
This change is mostly autogenerated with:
$ python -m autoflake --in-place --recursive --remove-all-unused-imports --ignore-init-module-imports examples templates transformers utils hubconf.py setup.py
I made minor changes in the generated diff.
2019-12-22 10:59:08 +01:00
Aymeric Augustin
fa2ccbc081
Fix E266 flake8 warning (x90).
2019-12-22 10:59:08 +01:00
Aymeric Augustin
158e82e061
Sort imports with isort.
...
This is the result of:
$ isort --recursive examples templates transformers utils hubconf.py setup.py
2019-12-22 10:57:46 +01:00
Aymeric Augustin
fa84ae26d6
Reformat source code with black.
...
This is the result of:
$ black --line-length 119 examples templates transformers utils hubconf.py setup.py
There's a lot of fairly long lines in the project. As a consequence, I'm
picking the longest widely accepted line length, 119 characters.
This is also Thomas' preference, because it allows for explicit variable
names, to make the code easier to understand.
2019-12-21 17:52:29 +01:00
Lysandre
7d709e55ed
Remove
2019-10-22 14:12:33 -04:00
VictorSanh
a12ab0a8db
update binarized_data
2019-10-03 10:27:11 -04:00
VictorSanh
4d6dfbd376
update extract
2019-10-03 10:27:11 -04:00
VictorSanh
23edebc079
update extract_distilbert
2019-10-03 10:27:11 -04:00
VictorSanh
cbfcfce205
update token_counts
2019-10-03 10:27:11 -04:00
thomwolf
481d9c4fb5
Merge branch 'master' into tf2
2019-09-26 12:02:54 +02:00
thomwolf
31c23bd5ee
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
VictorSanh
354944e607
[distillation] big update w/ new weights
2019-09-19 19:25:21 +00:00
VictorSanh
32e1332acf
[distil] fix once for all general logger for scripts
2019-09-11 14:19:07 +00:00
Stefan Schweter
a1c34bd286
distillation: fix ModuleNotFoundError error in token counts script
2019-08-31 12:21:38 +02:00
VictorSanh
803c1cc4ea
fix relative import bug cf Issue #1140
2019-08-30 12:01:27 -04:00
LysandreJik
caf1d116a6
Closing bracket in DistilBERT's token count.
2019-08-29 15:30:10 -04:00
thomwolf
912a377e90
dilbert -> distilbert
2019-08-28 13:59:42 +02:00
VictorSanh
fea921d382
add licensing
2019-08-28 04:45:39 +00:00
VictorSanh
0d8f8848d5
add scripts/extract_for_distil.py
2019-08-28 04:00:19 +00:00
VictorSanh
7f2c384c80
add scripts/token_counts.py
2019-08-28 04:00:03 +00:00
VictorSanh
4d16b279e5
add scripts/binarized_data.py
2019-08-28 03:59:48 +00:00
