transformers/examples/tensorflow
Elysium1436 f3d0866ed9
Correct validation_split_percentage argument from int (ex:5) to float (0.05) (#12897)
* Fixed train_test_split test_size argument

* `Seq2SeqTrainer` set max_length and num_beams only when non None  (#12899)

* set max_length and num_beams only when non None

* fix instance variables

* fix code style

* [FLAX] Minor fixes in CLM example (#12914)

* readme: fix retrieval of vocab size for flax clm example

* examples: fix flax clm example when using training/evaluation files

* Fix module path for symbolic_trace example

Co-authored-by: cchen-dialpad <47165889+cchen-dialpad@users.noreply.github.com>
Co-authored-by: Stefan Schweter <stefan@schweter.it>
Co-authored-by: Sylvain Gugger <sylvain.gugger@gmail.com>
2021-07-27 21:01:40 -04:00
..
benchmarking Examples reorg (#11350) 2021-04-21 11:11:20 -04:00
language-modeling Correct validation_split_percentage argument from int (ex:5) to float (0.05) (#12897) 2021-07-27 21:01:40 -04:00
multiple-choice Add TF multiple choice example (#12865) 2021-07-26 15:15:51 +01:00
question-answering Docs for v4.10.0dev0 2021-07-22 12:52:25 +02:00
summarization Docs for v4.10.0dev0 2021-07-22 12:52:25 +02:00
text-classification Docs for v4.10.0dev0 2021-07-22 12:52:25 +02:00
token-classification Update TF examples README (#12703) 2021-07-14 15:15:25 +01:00
translation Docs for v4.10.0dev0 2021-07-22 12:52:25 +02:00
README.md Update TF examples README (#12703) 2021-07-14 15:15:25 +01:00

Examples

This folder contains actively maintained examples of use of 🤗 Transformers organized into different NLP tasks. All examples in this folder are TensorFlow examples, and are written using native Keras rather than classes like TFTrainer, which we now consider deprecated. If you've previously only used 🤗 Transformers via TFTrainer, we highly recommend taking a look at the new style - we think it's a big improvement!

In addition, all scripts here now support the 🤗 Datasets library - you can grab entire datasets just by changing one command-line argument!

A note on code folding

Most of these examples have been formatted with #region blocks. In IDEs such as PyCharm and VSCode, these blocks mark named regions of code that can be folded for easier viewing. If you find any of these scripts overwhelming or difficult to follow, we highly recommend beginning with all regions folded and then examining regions one at a time!

The Big Table of Tasks

Here is the list of all our examples:

Task Example datasets
language-modeling WikiText-2
multiple-choice SWAG
question-answering SQuAD
summarization XSum
text-classification GLUE
token-classification CoNLL NER
translation WMT

Coming soon

  • Colab notebooks to easily run through these scripts!