mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-04 05:10:06 +06:00
7e22609e0f
* Tensorflow MLM example * Add CLM example * Style fixes, adding missing checkpoint code from the CLM example * Fix TPU training, avoid massive dataset warnings * Fix incorrect training length calculation for multi-GPU training * Fix incorrect training length calculation for multi-GPU training * Refactors and nitpicks from the review * Style pass * Adding README |
||
|---|---|---|
| .. | ||
| benchmarking | ||
| language-modeling | ||
| multiple-choice | ||
| question-answering | ||
| text-classification | ||
| README.md | ||
Examples
This folder contains actively maintained examples of use of 🤗 Transformers using the TensorFlow backend, organized along NLP tasks. It is under construction so we thank you for your patience!
Files containing tf such as run_tf_glue.py are the old-style files that will be rewritten very soon! Files without this such as run_text_classification.py are the newer ones. This message will be removed when the revamp is complete.
The Big Table of Tasks
Here is the list of all our examples:
- with information on whether they are built on top of
Keras(if not, they still work, they might just lack some features), - whether or not they leverage the 🤗 Datasets library.
- links to Colab notebooks to walk through the scripts and run them easily,
| Task | Example datasets | Keras support | 🤗 Datasets | Colab |
|---|---|---|---|---|
language-modeling |
WikiText-2 | - | - | - |
multiple-choice |
SWAG | - | - | - |
question-answering |
SQuAD | - | - | - |
summarization |
XSum | - | - | - |
text-classification |
GLUE | - | - | - |
text-generation |
n/a | - | n/a | - |
token-classification |
CoNLL NER | - | - | - |
translation |
WMT | - | - | - |