8 Commits

Author	SHA1	Message	Date
Joao Gante	a55a822adf	Generate: TextIteratorStreamer (streamer for gradio) (#22501) ... * haha text go brrr (but in gradio)	2023-04-03 15:04:37 +01:00
Joao Gante	228792a9dc	Generate: basic token streaming (#22449) ... * haha tokens go brrrr	2023-03-30 12:00:12 +01:00
Konstantin Kotik	367fdf3330	MinNewTokensLengthLogitsProcessor for .generate method #20814 (#20892) ... * feat: add min new length logit processor * test: add min new length logit processor * docs: add MinNewTokensLengthLogitsProcessor * feat: import MinNewTokensLengthLogitsProcessor * fix: update pytorch dummy objects * refactor & fix: rename attributes and var and get rid of dynamic attribute * tests: align test with new interface * docs: fix typo * docs: minor clarification * Empty-Commit * empty commit * run automated quality edits Co-authored-by: Joao Gante <joao@huggingface.co>	2023-01-03 06:29:02 -05:00
Joao Gante	f270b960d6	Generate: move generation_*.py src files into generation/*.py (#20096) ... * move generation_*.py src files into generation/*.py * populate generation.__init__ with lazy loading * move imports and references from generation.xxx.object to generation.object	2022-11-09 15:34:08 +00:00
GMFTBY	71786b10c5	Adding the state-of-the-art contrastive search decoding methods for the codebase of generation_utils.py (#19477) ... * add: the contrastive search for generaton_utils * add: testing scripts for contrastive search under examples/text-generation * update the quality of codes * revise the docstring; make the generation_contrastive_search.py scripts; * revise the examples/pytorch/text-generation/run_generation_contrastive_search.py to the auto-APIs format * revise the necessary documents * fix: revise the docstring of generation_contrastive_search.py * Fix the code indentation * fix: revise the nits and examples in contrastive_search docstring. * fix the copyright * delete generation_contrastive_search.py * revise the logic in contrastive_search * update the intergration test and the docstring * run the tests over * add the slow decorate to the contrastive_search intergrate test * add more test * do the style, quality, consistency checks	2022-10-19 10:17:46 +01:00
Robert Dargavel Smith	5c17918fe4	Allow from transformers import TypicalLogitsWarper (#17477) ... * Allow from transformers import TypicalLogitsWarper * Added TypicalLogitsWarper * Allow from transformers import TypicalLogitsWarper * Allow from transformers import TypicalLogitsWarper * Allow from transformers import TypicalLogitsWarper * Allow from transformers import TypicalLogitsWarper Added TypicalLogitsWarper Allow from transformers import TypicalLogitsWarper Allow from transformers import TypicalLogitsWarper Allow from transformers import TypicalLogitsWarper	2022-06-03 11:08:35 +02:00
Joao Gante	3f43d824b9	TF generate refactor - Beam Search (#16374) ... * refactor TF beam search * refactored generate can now properly use attention masks * add force bos/eos logit processors	2022-04-06 18:19:34 +01:00
Sylvain Gugger	b9a768b3ff	Enable doc in Spanish (#16518) ... * Reorganize doc for multilingual support * Fix style * Style * Toc trees * Adapt templates	2022-04-04 10:25:46 -04:00