mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-03 12:50:06 +06:00
parent
f33419261a
commit
3f96e0b4e4
@ -145,6 +145,12 @@ The `generate()` supports streaming, through its `streamer` input. The `streamer
|
||||
from a class that has the following methods: `put()` and `end()`. Internally, `put()` is used to push new tokens and
|
||||
`end()` is used to flag the end of text generation.
|
||||
|
||||
<Tip warning={true}>
|
||||
|
||||
The API for the streamer classes is still under development and may change in the future.
|
||||
|
||||
</Tip>
|
||||
|
||||
In practice, you can craft your own streaming class for all sorts of purposes! We also have basic streaming classes
|
||||
ready for you to use. For example, you can use the [`TextStreamer`] class to stream the output of `generate()` into
|
||||
your screen, one word at a time:
|
||||
|
@ -39,6 +39,12 @@ class TextStreamer(BaseStreamer):
|
||||
"""
|
||||
Simple text streamer that prints the token(s) to stdout as soon as entire words are formed.
|
||||
|
||||
<Tip warning={true}>
|
||||
|
||||
The API for the streamer classes is still under development and may change in the future.
|
||||
|
||||
</Tip>
|
||||
|
||||
Parameters:
|
||||
tokenizer (`AutoTokenizer`):
|
||||
The tokenized used to decode the tokens.
|
||||
@ -128,6 +134,12 @@ class TextIteratorStreamer(TextStreamer):
|
||||
useful for applications that benefit from acessing the generated text in a non-blocking way (e.g. in an interactive
|
||||
Gradio demo).
|
||||
|
||||
<Tip warning={true}>
|
||||
|
||||
The API for the streamer classes is still under development and may change in the future.
|
||||
|
||||
</Tip>
|
||||
|
||||
Parameters:
|
||||
tokenizer (`AutoTokenizer`):
|
||||
The tokenized used to decode the tokens.
|
||||
|
Loading…
Reference in New Issue
Block a user