8 Commits

Author	SHA1	Message	Date
Lysandre Debut	c3d9ac7607	Expose get_config() on ModelTesters (#12812) ... * Expose get_config() on ModelTesters * Typo	2021-07-21 04:13:11 -04:00
Sylvain Gugger	81009b7a5c	Replace error by warning when loading an architecture in another (#11207) ... * Replace error by warning when loading an architecture in another * Style * Style again * Add a test * Adapt old test	2021-04-13 10:33:52 -04:00
demSd	3b7e612a5e	Implementing the test integration of BertGeneration (#9990) ... * claiming this issue * Integration test for BertGeneration(Encoder and Decoder) * fix code quality	2021-02-08 08:22:19 -05:00
Suraj Patil	88ef8893cd	Add caching mechanism to BERT, RoBERTa (#9183) ... * add past_key_values * add use_cache option * make mask before cutting ids * adjust position_ids according to past_key_values * flatten past_key_values * fix positional embeds * fix _reorder_cache * set use_cache to false when not decoder, fix attention mask init * add test for caching * add past_key_values for Roberta * fix position embeds * add caching test for roberta * add doc * make style * doc, fix attention mask, test * small fixes * adress patrick's comments * input_ids shouldn't start with pad token * use_cache only when decoder * make consistent with bert * make copies consistent * add use_cache to encoder * add past_key_values to tapas attention * apply suggestions from code review * make coppies consistent * add attn mask in tests * remove copied from longformer * apply suggestions from code review * fix bart test * nit * simplify model outputs * fix doc * fix output ordering	2020-12-23 23:01:32 +05:30
Sylvain Gugger	00aa9dbca2	Copyright (#8970) ... * Add copyright everywhere missing * Style	2020-12-07 18:36:34 -05:00
Sylvain Gugger	1073a2bde5	Switch return_dict to True by default. (#8530) ... * Use the CI to identify failing tests * Remove from all examples and tests * More default switch * Fixes * More test fixes * More fixes * Last fixes hopefully * Use the CI to identify failing tests * Remove from all examples and tests * More default switch * Fixes * More test fixes * More fixes * Last fixes hopefully * Run on the real suite * Fix slow tests	2020-11-16 11:43:00 -05:00
Patrick von Platen	a1bbcf3f6c	Refactoring the generate() function (#6949) ... * first draft * show design proposition for new generate method * up * make better readable * make first version * gpt2 tests pass * make beam search for gpt2 work * add first encoder-decoder code * delete typo * make t5 work * save indermediate * make bart work with beam search * finish beam search bart / t5 * add default kwargs * make more tests pass * fix no bad words sampler * some fixes and tests for all distribution processors * fix test * fix rag slow tests * merge to master * add nograd to generate * make all slow tests pass * speed up generate * fix edge case bug * small fix * correct typo * add type hints and docstrings * fix typos in tests * add beam search tests * add tests for beam scorer * fix test rag * finish beam search tests * move generation tests in seperate file * fix generation tests * more tests * add aggressive generation tests * fix tests * add gpt2 sample test * add more docstring * add more docs * finish doc strings * apply some more of sylvains and sams comments * fix some typos * make fix copies * apply lysandres and sylvains comments * final corrections on examples * small fix for reformer	2020-11-03 16:04:22 +01:00
Patrick von Platen	7fd1febf38	Add "Leveraging Pretrained Checkpoints for Generation" Seq2Seq models. (#6594) ... * add conversion script * improve conversion script * make style * add tryout files * fix * update * add causal bert * better names * add tokenizer file as well * finish causal_bert * fix small bugs * improve generate * change naming * renaming * renaming * renaming * remove leftover files * clean files * add fix tokenizer * finalize * correct slow test * update docs * small fixes * fix link * adapt check repo * apply sams and sylvains recommendations * fix import * implement Lysandres recommendations * fix logger warn	2020-09-10 16:40:51 +02:00