4 Commits

Author	SHA1	Message	Date
Raushan Turganbay	061c2c4c38	Ignore keys on validate_rope (#33753) ... * ignore keys on check rope * add tests * fix tests, so maybe better leave at logger lvl	2024-10-04 12:39:37 +02:00
Alex Sherstinsky	122ded0a11	Bugfix/alexsherstinsky/fix none check for attention factor in rope scaling 2024 08 28 0 (#33188) ... * Fixing a bug in the way "attention_factor" is validated in ROPE utilities. * Fixing a bug in the way "attention_factor" is validated in ROPE utilities. * Fixing a bug in the way "attention_factor" is validated in ROPE utilities.	2024-09-04 17:01:12 +02:00
Joao Gante	083e13b7c4	RoPE: Add numerical tests ✨ (#32380) ... tests! :D	2024-08-02 09:39:45 +01:00
Joao Gante	2e113422b3	Llama: RoPE refactor (#32135) ... Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com> Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>	2024-07-23 10:42:55 +01:00