7 Commits

Author	SHA1	Message	Date
Joao Gante	e4a97f82bf	Generate: assisted generation with sample (take 2) (#22949) ... * temperature controls speed	2023-04-24 19:54:55 +01:00
Joao Gante	78cda46f17	Generate: Add assisted generation (#22211) ... * working mvp * remove breakpoint * fix commit * standardize outputs * tmp commit * tests almost ready * tmp commit * skip a few models * Add streaming; Docs and examples * document limitations * PR commits * Amy PR comments	2023-04-18 17:36:56 +01:00
Joao Gante	3f96e0b4e4	Generate: add API warning to streamers (#22659) ... add API warning	2023-04-07 14:15:20 -04:00
Manuel de Prada	d5de578c22	Docs fix: Multinomial sampling decoding needs "num_beams=1", since by default it is usually not 1. (#22473) ... Fix: Multinomial sampling needs "num_beams=1", since by default is 5.	2023-03-30 11:04:12 -04:00
Joao Gante	228792a9dc	Generate: basic token streaming (#22449) ... * haha tokens go brrrr	2023-03-30 12:00:12 +01:00
Ashwin Mathur	b79607656b	Fix typo in Greedy Search Description (#22345) ... Fix typo in greedy search docs	2023-03-24 07:32:18 -04:00
Maria Khalusova	d386fd646a	Add: An introductory guide for text generation (#21090) ... * Part of the "text generation" rework: adding a high-level overview of the text generation strategies * code samples update via make style * fixed a few formatting issues * Apply suggestions from review Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * fixed spaces, and switched two links to markdown * Apply Steven's suggestions from review Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * new lines after headers to fix link rendering * review feedback addressed. added links to image captioning and audio transcription examples * minor capitalization fix * addressed the review feedback * Apply suggestions from review Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * Applied review suggestions Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>	2023-01-17 12:23:22 -05:00