transformers/examples/tensorflow
amyeroberts e5db7051a8
Add TF image classification example script (#19956)
* TF image classification script

* Update requirements

* Fix up

* Add tests

* Update test fetcher
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Fix directory path

* Adding `zero-shot-object-detection` pipeline doctest. (#20274)

* Adding `zero-shot-object-detection` pipeline doctest.

* Remove nested_simplify.

* Add generate kwargs to `AutomaticSpeechRecognitionPipeline` (#20952)

* Add generate kwargs to AutomaticSpeechRecognitionPipeline

* Add test for generation kwargs

* Trigger CI

* Data collator returns np

* Update feature extractor -> image processor

* Bug fixes - updates to reflect changes in API

* Update flags to match PT & run faster

* Update instructions - Maria's comment

* Update examples/tensorflow/image-classification/README.md

* Remove slow decorator

---------

Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
Co-authored-by: bofeng huang <bofenghuang7@gmail.com>
Co-authored-by: Sylvain Gugger <Sylvain.gugger@gmail.com>
2023-02-01 19:09:36 +00:00
..
benchmarking [NumPy] Remove references to deprecated NumPy type aliases (#21022) 2023-01-05 13:02:10 -05:00
image-classification Add TF image classification example script (#19956) 2023-02-01 19:09:36 +00:00
language-modeling Use return_tensors="np" instead of "tf" (#21266) 2023-01-24 13:37:49 +00:00
multiple-choice Use return_tensors="np" instead of "tf" (#21266) 2023-01-24 13:37:49 +00:00
question-answering v4.27.0.dev0 2023-01-23 16:52:35 -05:00
summarization Use return_tensors="np" instead of "tf" (#21266) 2023-01-24 13:37:49 +00:00
text-classification Use return_tensors="np" instead of "tf" (#21266) 2023-01-24 13:37:49 +00:00
token-classification Use return_tensors="np" instead of "tf" (#21266) 2023-01-24 13:37:49 +00:00
translation Use return_tensors="np" instead of "tf" (#21266) 2023-01-24 13:37:49 +00:00
_tests_requirements.txt Pin to the right version... 2022-11-18 07:12:55 -05:00
README.md Just re-reading the whole doc every couple of months 😬 (#18489) 2022-08-06 09:38:55 +02:00
test_tensorflow_examples.py Add TF image classification example script (#19956) 2023-02-01 19:09:36 +00:00

Examples

This folder contains actively maintained examples of use of 🤗 Transformers organized into different ML tasks. All examples in this folder are TensorFlow examples, and are written using native Keras rather than classes like TFTrainer, which we now consider deprecated. If you've previously only used 🤗 Transformers via TFTrainer, we highly recommend taking a look at the new style - we think it's a big improvement!

In addition, all scripts here now support the 🤗 Datasets library - you can grab entire datasets just by changing one command-line argument!

A note on code folding

Most of these examples have been formatted with #region blocks. In IDEs such as PyCharm and VSCode, these blocks mark named regions of code that can be folded for easier viewing. If you find any of these scripts overwhelming or difficult to follow, we highly recommend beginning with all regions folded and then examining regions one at a time!

The Big Table of Tasks

Here is the list of all our examples:

Task Example datasets
language-modeling WikiText-2
multiple-choice SWAG
question-answering SQuAD
summarization XSum
text-classification GLUE
token-classification CoNLL NER
translation WMT

Coming soon

  • Colab notebooks to easily run through these scripts!