riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-04 05:10:06 +06:00
Code Issues Actions 20 Packages Projects Releases Wiki Activity
a14b055b65
transformers/examples/tensorflow
History
Albert Villanova del Moral a14b055b65
Pass datasets trust_remote_code (#31406) 
* Pass datasets trust_remote_code

* Pass trust_remote_code in more tests

* Add trust_remote_dataset_code arg to some tests

* Revert "Temporarily pin datasets upper version to fix CI"

This reverts commit b7672826ca.

* Pass trust_remote_code in librispeech_asr_dummy docstrings

* Revert "Pin datasets<2.20.0 for examples"

This reverts commit 833fc17a3e.

* Pass trust_remote_code to all examples

* Revert "Add trust_remote_dataset_code arg to some tests" to research_projects

* Pass trust_remote_code to tests

* Pass trust_remote_code to docstrings

* Fix flax examples tests requirements

* Pass trust_remote_dataset_code arg to tests

* Replace trust_remote_dataset_code with trust_remote_code in one example

* Fix duplicate trust_remote_code

* Replace args.trust_remote_dataset_code with args.trust_remote_code

* Replace trust_remote_dataset_code with trust_remote_code in parser

* Replace trust_remote_dataset_code with trust_remote_code in dataclasses

* Replace trust_remote_dataset_code with trust_remote_code arg
2024-06-17 17:29:13 +01:00
..
benchmarking update ruff version (#30932) 2024-05-22 06:40:15 +02:00
contrastive-image-text Pass datasets trust_remote_code (#31406) 2024-06-17 17:29:13 +01:00
image-classification Pass datasets trust_remote_code (#31406) 2024-06-17 17:29:13 +01:00
language-modeling Pass datasets trust_remote_code (#31406) 2024-06-17 17:29:13 +01:00
language-modeling-tpu Pass datasets trust_remote_code (#31406) 2024-06-17 17:29:13 +01:00
multiple-choice v4.42.dev.0 2024-05-17 17:30:41 +02:00
question-answering Pass datasets trust_remote_code (#31406) 2024-06-17 17:29:13 +01:00
summarization Pass datasets trust_remote_code (#31406) 2024-06-17 17:29:13 +01:00
text-classification update ruff version (#30932) 2024-05-22 06:40:15 +02:00
token-classification Pass datasets trust_remote_code (#31406) 2024-06-17 17:29:13 +01:00
translation Pass datasets trust_remote_code (#31406) 2024-06-17 17:29:13 +01:00
_tests_requirements.txt Pass datasets trust_remote_code (#31406) 2024-06-17 17:29:13 +01:00
README.md TF: purge TFTrainer (#28483) 2024-01-12 16:56:34 +00:00
test_tensorflow_examples.py Pass datasets trust_remote_code (#31406) 2024-06-17 17:29:13 +01:00

README.md

Examples

This folder contains actively maintained examples of the use of 🤗 Transformers organized into different ML tasks. All examples in this folder are TensorFlow examples and are written using native Keras. If you've previously only used 🤗 Transformers via TFTrainer, we highly recommend taking a look at the new style - we think it's a big improvement!

In addition, all scripts here now support the 🤗 Datasets library - you can grab entire datasets just by changing one command-line argument!

A note on code folding

Most of these examples have been formatted with #region blocks. In IDEs such as PyCharm and VSCode, these blocks mark named regions of code that can be folded for easier viewing. If you find any of these scripts overwhelming or difficult to follow, we highly recommend beginning with all regions folded and then examining regions one at a time!

The Big Table of Tasks

Here is the list of all our examples:

Task Example datasets
language-modeling WikiText-2
multiple-choice SWAG
question-answering SQuAD
summarization XSum
text-classification GLUE
token-classification CoNLL NER
translation WMT

Coming soon

  • Colab notebooks to easily run through these scripts!