riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-23 22:38:58 +06:00
Code Issues Actions 31 Packages Projects Releases Wiki Activity
17,150 Commits 878 Branches 229 Tags 2 GiB
37ea04013b
Commit Graph

3 Commits

Author SHA1 Message Date
Joao Gante
e878eaa9fc
Tests: upcast logits to float() (#34042) 
upcast
 2024-10-11 11:51:49 +01:00
Joao Gante
d29738f5b4
Generate tests: modality-agnostic input preparation (#33685) 2024-10-03 14:01:24 +01:00
Niklas Muennighoff
ecd61c6286
Add OLMoE (#32406) 
* Add OLMoE

* Add OLMoE

* Updates

* Make norm optional; add keys

* Add output

* Add

* Fix dtype

* Fix eos config

* Update

* Add OLMoE

* Fix OLMoE path

* Format

* Format

* Rmv copy statement

* Rmv copy statement

* Format

* Add copies

* Cp rotary

* Fix aming

* Fix naming

* Update RoPE integration; num_logits_to_keep; Add copy statements

* Add eps to config

* Format

* Add aux loss

* Adapt router_aux_loss_coef

* Update md

* Adapt

* adapt tests
 2024-09-03 18:43:12 +02:00