mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-07 06:40:04 +06:00
d8049331dc
* Init FNet * Update config * Fix config * Update model classes * Update tokenizers to use sentencepiece * Fix errors in model * Fix defaults in config * Remove position embedding type completely * Fix typo and take only real numbers * Fix type vocab size in configuration * Add projection layer to embeddings * Fix position ids bug in embeddings * Add minor changes * Add conversion script and remove CausalLM vestiges * Fix conversion script * Fix conversion script * Remove CausalLM Test * Update checkpoint names to dummy checkpoints * Add tokenizer mapping * Fix modeling file and corresponding tests * Add tokenization test file * Add PreTraining model test * Make style and quality * Make tokenization base tests work * Update docs * Add FastTokenizer tests * Fix fast tokenizer special tokens * Fix style and quality * Remove load_tf_weights vestiges * Add FNet to main README * Fix configuration example indentation * Comment tokenization slow test * Fix style * Add changes from review * Fix style * Remove bos and eos tokens from tokenizers * Add tokenizer slow test, TPU transforms, NSP * Add scipy check * Add scipy availabilty check to test * Fix tokenizer and use correct inputs * Remove remaining TODOs * Fix tests * Fix tests * Comment Fourier Test * Uncomment Fourier Test * Change to google checkpoint * Add changes from review * Fix activation function * Fix model integration test * Add more integration tests * Add comparison steps to MLM integration test * Fix style * Add masked tokenization fix * Improve mask tokenization fix * Fix index docs * Add changes from review * Fix issue * Fix failing import in test * some more fixes * correct fast tokenizer * finalize * make style * Remove additional tokenization logic * Set do_lower_case to False * Allow keeping accents * Fix tokenization test * Fix FNet Tokenizer Fast * fix tests * make style * Add tips to FNet docs Co-authored-by: patrickvonplaten <patrick.v.platen@gmail.com> |
||
|---|---|---|
| .. | ||
| albert.rst | ||
| auto.rst | ||
| bart.rst | ||
| barthez.rst | ||
| beit.rst | ||
| bert_japanese.rst | ||
| bert.rst | ||
| bertgeneration.rst | ||
| bertweet.rst | ||
| bigbird_pegasus.rst | ||
| bigbird.rst | ||
| blenderbot_small.rst | ||
| blenderbot.rst | ||
| bort.rst | ||
| byt5.rst | ||
| camembert.rst | ||
| canine.rst | ||
| clip.rst | ||
| convbert.rst | ||
| cpm.rst | ||
| ctrl.rst | ||
| deberta_v2.rst | ||
| deberta.rst | ||
| deit.rst | ||
| detr.rst | ||
| dialogpt.rst | ||
| distilbert.rst | ||
| dpr.rst | ||
| electra.rst | ||
| encoderdecoder.rst | ||
| flaubert.rst | ||
| fnet.rst | ||
| fsmt.rst | ||
| funnel.rst | ||
| gpt_neo.rst | ||
| gpt.rst | ||
| gpt2.rst | ||
| gptj.rst | ||
| herbert.rst | ||
| hubert.rst | ||
| ibert.rst | ||
| layoutlm.rst | ||
| layoutlmv2.rst | ||
| layoutxlm.rst | ||
| led.rst | ||
| longformer.rst | ||
| luke.rst | ||
| lxmert.rst | ||
| m2m_100.rst | ||
| marian.rst | ||
| mbart.rst | ||
| megatron_bert.rst | ||
| megatron_gpt2.rst | ||
| mobilebert.rst | ||
| mpnet.rst | ||
| mt5.rst | ||
| pegasus.rst | ||
| phobert.rst | ||
| prophetnet.rst | ||
| rag.rst | ||
| reformer.rst | ||
| rembert.rst | ||
| retribert.rst | ||
| roberta.rst | ||
| roformer.rst | ||
| speech_to_text_2.rst | ||
| speech_to_text.rst | ||
| speechencoderdecoder.rst | ||
| splinter.rst | ||
| squeezebert.rst | ||
| t5.rst | ||
| t5v1.1.rst | ||
| tapas.rst | ||
| transformerxl.rst | ||
| visual_bert.rst | ||
| vit.rst | ||
| wav2vec2.rst | ||
| xlm.rst | ||
| xlmprophetnet.rst | ||
| xlmroberta.rst | ||
| xlnet.rst | ||
| xlsr_wav2vec2.rst | ||