transformers/tests/fixtures
Sylvain Gugger 81156d20cd
Add model like (#14992)
* Add new model like command

* Bad doc-styler

* black and doc-styler, stop fighting!

* black and doc-styler, stop fighting!

* At last

* Clean up

* Typo

* Bad doc-styler

* Bad doc-styler

* All good maybe?

* Use constants

* Add doc and type hints

* More cleaning

* Add doc

* Fix Copied from

* Doc template

* Use typing.Pattern instead

* Framework-specific files

* Fixes

* Select frameworks clean model init

* Deal with frameworks in main init

* fixes

* Last fix

* Prompt user for info

* Delete exemple config

* Last fixes

* Add test config

* Fix bug with model_type included in each other

* Fixes

* More fixes

* More fixes

* Adapt config

* Remove print statements

* Will fix tokenization later, leave it broken for now

* Add test

* Quality

* Try this way

* Debug

* Maybe by setting the path?

* Let's try another way

* It should go better when actually passing the arg...

* Remove debug statements and style

* Fix config

* Add tests

* Test require the three backends

* intermediate commit

* Revamp pattern replacements and start work on feature extractors

* Adapt model info

* Finalize code for processors

* Fix in main init additions

* Finish questionnaire for processing classes

* Fix file name

* Fix for real

* Fix patterns

* Style

* Remove needless warnings

* Copied from should work now.

* Include Copied form in blocks

* Add test

* More fixes and tests

* Apply suggestions from code review

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Address review comment

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
2022-01-24 15:25:10 -05:00
..
tests_samples Fix img classification tests (#13456) 2021-09-07 05:58:45 -04:00
add_distilbert_like_config.json Add model like (#14992) 2022-01-24 15:25:10 -05:00
dummy_feature_extractor_config.json [AutoProcessor] Add Wav2Vec2WithLM & small fix (#14675) 2021-12-08 15:51:28 +01:00
dummy-config.json AutoConfig + other Auto classes honor model_type 2020-01-11 02:46:17 +00:00
empty.txt GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
input.txt GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
merges.txt [AutoTokenizer] Allow creation of tokenizers by tokenizer type (#13668) 2021-09-22 00:29:38 +02:00
preprocessor_config.json Auto processor (#14465) 2021-11-22 12:17:38 -05:00
sample_text_no_unicode.txt [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
sample_text.txt GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
spiece.model GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
test_entity_vocab.json Feature/fix slow test in mluke (#14749) 2021-12-22 06:35:59 -05:00
test_sentencepiece_bpe.model Conversion from slow to fast for BPE spm vocabs contained an error. (#10120) 2021-02-13 08:24:53 -05:00
test_sentencepiece_no_bos.model [pegasus] Faster tokenizer tests (#7672) 2020-10-09 11:10:32 -04:00
test_sentencepiece.model GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
vocab.json [AutoTokenizer] Allow creation of tokenizers by tokenizer type (#13668) 2021-09-22 00:29:38 +02:00
vocab.txt [AutoTokenizer] Allow creation of tokenizers by tokenizer type (#13668) 2021-09-22 00:29:38 +02:00