transformers/examples/pytorch/text-generation
Yong Hoon Shin 555715f418
Fix broken example generation script for Llama3 (#38062)
Fix broken example generation script for llama3
2025-05-20 10:53:43 +02:00
..
README.md chore: Fix typos in docs and examples (#36524) 2025-03-04 13:47:41 +00:00
requirements.txt make run_generation more generic for other devices (#25133) 2023-07-28 08:20:10 -04:00
run_generation_contrastive_search.py Use Python 3.9 syntax in examples (#37279) 2025-04-07 12:52:21 +01:00
run_generation.py Fix broken example generation script for Llama3 (#38062) 2025-05-20 10:53:43 +02:00

Language generation

Based on the script run_generation.py.

Conditional text generation using the auto-regressive models of the library: GPT, GPT-2, GPT-J, Transformer-XL, XLNet, CTRL, BLOOM, LLAMA, OPT. A similar script is used for our official demo Write With Transformer, where you can try out the different models available in the library.

Example usage:

python run_generation.py \
    --model_type=gpt2 \
    --model_name_or_path=openai-community/gpt2