Ekagra Ranjan
578e18e002
🚨 🚨 🚨 Optimize Top P Sampler and fix edge case ( #18984 )
...
* init PR
* optimize top p and add edge case
* styling
* style
* revert tf and flax test
* add edge case test for FLAX and TF
* update doc with smallest set sampling for top p
* make style
2022-09-15 15:50:11 +02:00
Joao Gante
fb0ae12947
TF: XLA bad words logits processor and list of processors ( #16974 )
2022-04-29 15:54:58 +01:00
Joao Gante
9331b37967
TF: XLA Logits Warpers ( #16899 )
...
Co-authored-by: Matt <Rocketknight1@users.noreply.github.com>
2022-04-25 19:48:08 +01:00
Joao Gante
809dac48f9
TF: XLA logits processors - minimum length, forced eos, and forced bos ( #16912 )
...
* XLA min len, forced eos, and forced bos
Co-authored-by: Matt <Rocketknight1@users.noreply.github.com>
2022-04-25 19:27:53 +01:00
Joao Gante
99c8226b12
TF: XLA repetition penalty ( #16879 )
2022-04-22 18:29:32 +01:00
Joao Gante
d7f7f29f29
TF: remove set_tensor_by_indices_to_value ( #16729 )
2022-04-12 17:51:47 +01:00
Joao Gante
3f43d824b9
TF generate refactor - Beam Search ( #16374 )
...
* refactor TF beam search
* refactored generate can now properly use attention masks
* add force bos/eos logit processors
2022-04-06 18:19:34 +01:00
Joao Gante
baab5e7cdf
TF generate refactor - Sample ( #15793 )
...
* Add TF logits wrappers
* Add sample method
* add tests for TF logit wrappers
* TF generate sample tests now run on CPU
Co-authored-by: Matt <Rocketknight1@users.noreply.github.com>
2022-03-02 16:13:54 +00:00
Lysandre Debut
29c10a41d0
[Test refactor 1/5] Per-folder tests reorganization ( #15725 )
...
* Per-folder tests reorganization
Co-authored-by: sgugger <sylvain.gugger@gmail.com>
Co-authored-by: Stas Bekman <stas@stason.org>
2022-02-23 15:46:28 -05:00
