transformers/examples/pytorch/text-generation
Wang, Yi 33687a3f61
add GPTJ/bloom/llama/opt into model list and enhance the jit support (#23291)
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
2023-05-24 10:57:56 +01:00
..
README.md add GPTJ/bloom/llama/opt into model list and enhance the jit support (#23291) 2023-05-24 10:57:56 +01:00
requirements.txt Examples reorg (#11350) 2021-04-21 11:11:20 -04:00
run_generation_contrastive_search.py Adding the state-of-the-art contrastive search decoding methods for the codebase of generation_utils.py (#19477) 2022-10-19 10:17:46 +01:00
run_generation.py add GPTJ/bloom/llama/opt into model list and enhance the jit support (#23291) 2023-05-24 10:57:56 +01:00

Language generation

Based on the script run_generation.py.

Conditional text generation using the auto-regressive models of the library: GPT, GPT-2, GPTJ, Transformer-XL, XLNet, CTRL, BLOOM, LLAMA, OPT. A similar script is used for our official demo Write With Transfomer, where you can try out the different models available in the library.

Example usage:

python run_generation.py \
    --model_type=gpt2 \
    --model_name_or_path=gpt2