transformers/docs/source
Biao Zhang 3ef8896906
Encoder-Decoder Gemma (#38332)
* Initial submit

* Fix bugs:
1. add __init__ file
2. tied word embedding
3. support flash/flex attention
4. model saving and loading

* Code refactor:
* Rename encdecgemma to t5gemma.
* Split attention into self- and cross-attention
* Split stack into encoder and decoder
* Add test cases
* Add auto configuration

* Update configurations.

* Fix bugs related to copy and attribute checks

* Fix type union

* Fix merge errors

* run ruff format

* Run make style and update tests.

* Add t5gemma model doc.

* ruff and style formatting.

* Add missed module config.

* Add dummy checkpoint link to pass tests (need updated when real checkpoints are uplioaded.).

* Update model doc.

* Minor updates following Arthur's comments:
* replace docstrings with auto_docstrings
* remove checkpoint layers
* remove deprecate_kwargs

* fix rebase errors

* Fix docstring issues.

* fix t5gemma doc issue.

* run ruff format

* Updates:
* split encoder-only model out
* make t5gemmamodel encoder-decoder only
* update token and sequence classification
* update tests
2025-06-25 09:05:10 +00:00
..
ar No more Tuple, List, Dict (#38797) 2025-06-17 19:37:18 +01:00
de Use HF papers (#38184) 2025-06-13 11:07:09 +00:00
en Encoder-Decoder Gemma (#38332) 2025-06-25 09:05:10 +00:00
es No more Tuple, List, Dict (#38797) 2025-06-17 19:37:18 +01:00
fr Use HF papers (#38184) 2025-06-13 11:07:09 +00:00
hi [i18n-HI] Translated TFLite page to Hindi (#34572) 2024-11-04 09:40:30 -08:00
it No more Tuple, List, Dict (#38797) 2025-06-17 19:37:18 +01:00
ja No more Tuple, List, Dict (#38797) 2025-06-17 19:37:18 +01:00
ko No more Tuple, List, Dict (#38797) 2025-06-17 19:37:18 +01:00
ms Use HF papers (#38184) 2025-06-13 11:07:09 +00:00
pt No more Tuple, List, Dict (#38797) 2025-06-17 19:37:18 +01:00
te Fix typos in translated quicktour docs (#35302) 2024-12-17 09:32:00 -08:00
tr Translate index.md to Turkish (#27093) 2023-11-08 08:35:20 -05:00
zh No more Tuple, List, Dict (#38797) 2025-06-17 19:37:18 +01:00
_config.py [#29174] ImportError Fix: Trainer with PyTorch requires accelerate>=0.20.1 Fix (#29888) 2024-04-08 14:21:16 +01:00