transformers/docs/source
Chan Woo Kim 2b5603f6ac
Constrained Beam Search [without disjunctive decoding] (#15416)
* added classes to get started with constrained beam search

* in progress, think i can directly force tokens now but not yet with the round robin

* think now i have total control, now need to code the bank selection

* technically works as desired, need to optimize and fix design choices leading to undersirable outputs

* complete PR #1 without disjunctive decoding

* removed incorrect tests

* Delete k.txt

* Delete test.py

* Delete test.sh

* revert changes to test scripts

* genutils

* full implementation with testing, no disjunctive yet

* shifted docs

* passing all tests realistically ran locally

* removing accidentally included print statements

* fixed source of error in initial PR test

* fixing the get_device() vs device trap

* fixed documentation docstrings about constrained_beam_search

* fixed tests having failing for Speech2TextModel's floating point inputs

* fix cuda long tensor

* added examples and testing for them and founx & fixed a bug in beam_search and constrained_beam_search

* deleted accidentally added test halting code with assert False

* code reformat

* Update tests/test_generation_utils.py

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Update tests/test_generation_utils.py

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Update tests/test_generation_utils.py

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Update tests/test_generation_utils.py

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Update tests/test_generation_utils.py

* fixing based on comments on PR

* took out the testing code that should but work fails without the beam search moditification ; style changes

* fixing comments issues

* docstrings for ConstraintListState

* typo in PhrsalConstraint docstring

* docstrings improvements

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
2022-02-09 16:59:26 +01:00
..
internal Constrained Beam Search [without disjunctive decoding] (#15416) 2022-02-09 16:59:26 +01:00
main_classes PoC for a ProcessorMixin class (#15549) 2022-02-09 09:24:49 -05:00
model_doc Add TFSpeech2Text (#15113) 2022-02-08 16:27:23 +00:00
_config.py Prevent style_doc from tempering the config file 2021-12-10 15:31:43 -05:00
_toctree.yml Create a custom model guide (#15489) 2022-02-07 12:34:56 -06:00
accelerate.mdx Fix code format for Accelerate doc (#15335) 2022-01-27 13:49:04 -06:00
add_new_model.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
add_new_pipeline.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
autoclass_tutorial.mdx Update tutorial docs (#15165) 2022-02-01 18:31:35 -06:00
benchmarks.mdx [doc] normalize HF Transformers string (#15023) 2022-01-10 08:44:33 -08:00
bertology.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
community.mdx add t5 ner finetuning (#15432) 2022-01-31 17:03:06 +01:00
contributing.md Update installation page and add contributing to the doc (#5084) 2020-06-17 14:01:10 -04:00
converting_tensorflow_models.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
create_a_model.mdx Create a custom model guide (#15489) 2022-02-07 12:34:56 -06:00
custom_datasets.mdx Added missing code in exemplary notebook - custom datasets fine-tuning (#15300) 2022-01-25 17:26:17 -05:00
custom_models.mdx Save code of registered custom models (#15379) 2022-02-02 10:44:37 -05:00
debugging.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
examples.md per_device instead of per_gpu/error thrown when argument unknown (#4618) 2020-05-27 11:36:55 -04:00
fast_tokenizers.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
glossary.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
index.mdx Add TFSpeech2Text (#15113) 2022-02-08 16:27:23 +00:00
installation.mdx Get started docs (#15098) 2022-01-28 19:01:37 -06:00
migration.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
model_sharing.mdx Update model share tutorial (#15288) 2022-01-28 18:49:26 -06:00
model_summary.mdx Add "open in hf spaces" gradio button issue #73 (#15106) 2022-01-14 10:12:30 -05:00
multilingual.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
notebooks.md Update notebooks (#3620) 2020-04-06 14:32:39 -04:00
parallelism.mdx [deepspeed docs] Megatron-Deepspeed info (#15488) 2022-02-04 11:15:13 -08:00
performance.mdx add model scaling section (#15119) 2022-02-09 15:27:30 +01:00
perplexity.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
philosophy.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
pipeline_tutorial.mdx Update tutorial docs (#15165) 2022-02-01 18:31:35 -06:00
pr_checks.mdx [docs] fix wrong file name in pr_check (#15380) 2022-01-28 07:52:01 -05:00
preprocessing.mdx Update tutorial docs (#15165) 2022-02-01 18:31:35 -06:00
quicktour.mdx Get started docs (#15098) 2022-01-28 19:01:37 -06:00
sagemaker.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
serialization.mdx electra is added to onnx supported model (#15084) 2022-02-08 15:47:49 +01:00
task_summary.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
testing.mdx [doc] normalize HF Transformers string (#15023) 2022-01-10 08:44:33 -08:00
tokenizer_summary.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
training.mdx Update fine-tune docs (#15259) 2022-02-01 18:28:12 -06:00
troubleshooting.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00