Sam Shleifer
f5c2a122e3
Upgrade examples to pl=0.8.1( #5146 )
2020-06-22 20:40:10 -04:00
Patrick von Platen
fa0be6d761
Benchmarks ( #4912 )
...
* finish benchmark
* fix isort
* fix setup cfg
* retab
* fix time measuring of tf graph mode
* fix tf cuda
* clean code
* better error message
2020-06-22 12:06:56 +02:00
Sam Shleifer
043f9f51f9
[examples] SummarizationModule improvements ( #4951 )
2020-06-17 13:51:34 -04:00
Patrick von Platen
96f57c9ccb
[Benchmark] Memory benchmark utils ( #4198 )
...
* improve memory benchmarking
* correct typo
* fix current memory
* check torch memory allocated
* better pytorch function
* add total cached gpu memory
* add total gpu required
* improve torch gpu usage
* update memory usage
* finalize memory tracing
* save intermediate benchmark class
* fix conflict
* improve benchmark
* improve benchmark
* finalize
* make style
* improve benchmarking
* correct typo
* make train function more flexible
* fix csv save
* better repr of bytes
* better print
* fix __repr__ bug
* finish plot script
* rename plot file
* delete csv and small improvements
* fix in plot
* fix in plot
* correct usage of timeit
* remove redundant line
* remove redundant line
* fix bug
* add hf parser tests
* add versioning and platform info
* make style
* add gpu information
* ensure backward compatibility
* finish adding all tests
* Update src/transformers/benchmark/benchmark_args.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
* Update src/transformers/benchmark/benchmark_args_utils.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
* delete csv files
* fix isort ordering
* add out of memory handling
* add better train memory handling
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
2020-05-27 23:22:16 +02:00
Julien Chaumond
0ae96ff8a7
BIG Reorganize examples ( #4213 )
...
* Created using Colaboratory
* [examples] reorganize files
* remove run_tpu_glue.py as superseded by TPU support in Trainer
* Bugfix: int, not tuple
* move files around
2020-05-07 13:48:44 -04:00
Sam Shleifer
c59b1e682d
[examples] unit test for run_bart_sum ( #3544 )
...
- adds pytorch-lightning dependency
2020-04-15 18:35:01 -04:00
Patrick von Platen
5ad2ea06af
Add wmt translation example ( #3428 )
...
* add translation example
* make style
* adapt docstring
* add gpu device as input for example
* small renaming
* better README
2020-03-26 19:07:59 +01:00
Patrick von Platen
e703e923ca
Add t5 summarization example ( #3411 )
...
* rebase to master
* change tf to pytorch
* change to pytorch
* small fix
* renaming
* add gpu training possibility
* renaming
* improve README
* incoorporate collins feedback
* better Readme
* better README.md
2020-03-26 18:17:55 +01:00
Thomas Wolf
2187c49f5c
CPU/GPU memory benchmarking utilities - Remove support for python 3.5 (now only 3.6+) ( #3186 )
...
* memory benchmark rss
* have both forward pass and line-by-line mem tracing
* cleaned up tracing
* refactored and cleaning up API
* no f-strings yet...
* add GPU mem logging
* fix GPU memory monitoring
* style and quality
* clean up and doc
* update with comments
* Switching to python 3.6+
* fix quality
2020-03-17 10:17:11 -04:00
alberduris
81d6841b4b
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
alberduris
dd4df80f0b
Moved the encoded_prompts to correct device
2020-01-06 15:11:12 +01:00
thomwolf
be916cb3fb
Merge branch 'master' of https://github.com/huggingface/transformers
2019-10-15 10:37:13 +02:00
thomwolf
5875aaf762
install tensorboard
2019-10-15 10:36:46 +02:00
thomwolf
0f9ebb0b43
add seqeval as requirement for examples
2019-10-15 09:17:31 +02:00
thomwolf
1849aa7d39
update readme and pretrained model weight files
2019-07-16 15:11:29 +02:00