Sigbjørn Skjæret
|
eafbb0eca7
|
Implement AsyncTextIteratorStreamer for asynchronous streaming (#34931)
* Add AsyncTextIteratorStreamer class
* export AsyncTextIteratorStreamer
* export AsyncTextIteratorStreamer
* improve docs
* missing import
* missing import
* doc example fix
* doc example output fix
* add pytest-asyncio
* first attempt at tests
* missing import
* add pytest-asyncio
* fallback to wait_for and raise TimeoutError on timeout
* check for TimeoutError
* autodoc
* reorder imports
* fix style
---------
Co-authored-by: Arthur Zucker <arthur.zucker@gmail.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
|
2024-12-20 12:08:12 +01:00 |
|
Lysandre Debut
|
f497f564bb
|
Update all references to canonical models (#29001)
* Script & Manual edition
* Update
|
2024-02-16 08:16:58 +01:00 |
|
Joao Gante
|
861ff890d6
|
Generate: TextIteratorStreamer timeout (#22576)
|
2023-04-05 09:57:46 +01:00 |
|
Joao Gante
|
1905384fd5
|
Generate: Add text streamer decoding options (#22544)
|
2023-04-04 09:03:13 +01:00 |
|
Joao Gante
|
a55a822adf
|
Generate: TextIteratorStreamer (streamer for gradio) (#22501)
* haha text go brrr (but in gradio)
|
2023-04-03 15:04:37 +01:00 |
|
Joao Gante
|
228792a9dc
|
Generate: basic token streaming (#22449)
* haha tokens go brrrr
|
2023-03-30 12:00:12 +01:00 |
|