transformers/docs/source
Sylvain Gugger b4d4d6fe87
Add RWKV-4 (#22797)
* First draft of RWKV-4

* Add support for generate

* Style post-rebase

* Properly use state

* Write doc

* Fix doc

* More math

* Add model to README, dummies and clean config

* Fix init

* multiple fixes:

- fix common tests
- fix configuraion default values
- add CI test for checking state computation
- fix some CI tests

* correct tokenizer

* some tweaks

- fix config docstring
- fix failing tests

* fix CI tests

- add output_attention / output_hidden_states
- override test_initialization
- fix failing CIs

* fix conversion script

- fix sharded case
- add new arguments

* add slow tests + more fixes on conversion script

* add another test

* final fixes

* change single name variable

* add mock attention mask for pipeline to work

* correct eos token id

* fix nits

* add checkpoints

* Apply suggestions from code review

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* add `tie_word_embeddings` in docstring

* change tensor name

* fix final nits

* Trigger CI

---------

Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
2023-05-09 13:04:10 -04:00
..
de Flax Regnet (#21867) 2023-04-04 12:41:12 -04:00
en Add RWKV-4 (#22797) 2023-05-09 13:04:10 -04:00
es Update feature selection in to_tf_dataset (#21935) 2023-04-24 17:34:30 +01:00
fr Flax Regnet (#21867) 2023-04-04 12:41:12 -04:00
it Depricate xpu_backend for ddp_backend (#23085) 2023-05-01 09:44:47 -04:00
ja Add Japanese translation to accelerate.mdx (#23232) 2023-05-09 10:51:43 -04:00
ko 🌐 [i18n-KO] docs: ko: Translate multiple_choice.mdx (#23064) 2023-05-05 11:36:56 -04:00
pt Update feature selection in to_tf_dataset (#21935) 2023-04-24 17:34:30 +01:00
zh Flax Regnet (#21867) 2023-04-04 12:41:12 -04:00
_config.py Adding evaluate to the list of libraries required in generated notebooks (#20850) 2022-12-21 14:04:08 +01:00