transformers/docs/source/model_doc
Sehoon Kim 63645b3b11
I-BERT model support (#10153)
* IBertConfig, IBertTokentizer added

* IBert Model names moified

* tokenizer bugfix

* embedding -> QuantEmbedding

* quant utils added

* quant_mode added to configuration

* QuantAct added, Embedding layer + QuantAct addition

* QuantAct added

* unused path removed, QKV quantized

* self attention layer all quantized, except softmax

* temporarl commit

* all liner layers quantized

* quant_utils bugfix

* bugfix: requantization missing

* IntGELU added

* IntSoftmax added

* LayerNorm implemented

* LayerNorm implemented all

* names changed: roberta->ibert

* config not inherit from ROberta

* No support for CausalLM

* static quantization added, quantize_model.py removed

* import modules uncommented

* copyrights fixed

* minor bugfix

* quant_modules, quant_utils merged as one file

* import * fixed

* unused runfile removed

* make style run

* configutration.py docstring fixed

* refactoring: comments removed, function name fixed

* unused dependency removed

* typo fixed

* comments(Copied from), assertion string added

* refactoring: super(..) -> super(), etc.

* refactoring

* refarctoring

* make style

* refactoring

* cuda -> to(x.device)

* weight initialization removed

* QuantLinear set_param removed

* QuantEmbedding set_param removed

* IntLayerNorm set_param removed

* assert string added

* assertion error message fixed

* is_decoder removed

* enc-dec arguments/functions removed

* Converter removed

* quant_modules docstring fixed

* conver_slow_tokenizer rolled back

* quant_utils docstring fixed

* unused aruments e.g. use_cache removed from config

* weight initialization condition fixed

* x_min, x_max initialized with small values to avoid div-zero exceptions

* testing code for ibert

* test emb, linear, gelu, softmax added

* test ln and act added

* style reformatted

* force_dequant added

* error tests overrided

* make style

* Style + Docs

* force dequant tests added

* Fix fast tokenizer in init

* Fix doc

* Remove space

* docstring, IBertConfig, chunk_size

* test_modeling_ibert refactoring

* quant_modules.py refactoring

* e2e integration test added

* tokenizers removed

* IBertConfig added to tokenizer_auto.py

* bugfix

* fix docs & test

* fix style num 2

* final fixes

Co-authored-by: Sehoon Kim <sehoonkim@berkeley.edu>
Co-authored-by: Lysandre <lysandre.debut@reseau.eseo.fr>
Co-authored-by: Sylvain Gugger <sylvain.gugger@gmail.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
2021-02-25 10:06:42 -05:00
..
albert.rst Enforce all objects in the main init are documented (#9014) 2020-12-10 11:57:12 -05:00
auto.rst AutoModelForTableQuestionAnswering (#9154) 2020-12-16 12:14:33 -05:00
bart.rst BartForCausalLM analogs to ProphetNetForCausalLM (#9128) 2021-02-04 11:56:12 +03:00
barthez.rst Fix documentation links always pointing to master. (#9217) 2021-01-05 06:18:48 -05:00
bert.rst Enforce all objects in the main init are documented (#9014) 2020-12-10 11:57:12 -05:00
bertgeneration.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
bertweet.rst Improve documentation coverage for Bertweet (#9379) 2021-01-04 13:12:59 -05:00
blenderbot_small.rst BartForCausalLM analogs to ProphetNetForCausalLM (#9128) 2021-02-04 11:56:12 +03:00
blenderbot.rst BartForCausalLM analogs to ProphetNetForCausalLM (#9128) 2021-02-04 11:56:12 +03:00
bort.rst ADD BORT (#9813) 2021-01-27 21:25:11 +03:00
camembert.rst Enforce all objects in the main init are documented (#9014) 2020-12-10 11:57:12 -05:00
convbert.rst Fix doc for TFConverBertModel 2021-02-04 10:14:46 -05:00
ctrl.rst Added TF CTRL Sequence Classification (#9151) 2020-12-17 18:10:57 -05:00
deberta_v2.rst Integrate DeBERTa v2(the 1.5B model surpassed human performance on Su… (#10018) 2021-02-19 18:34:44 -05:00
deberta.rst Integrate DeBERTa v2(the 1.5B model surpassed human performance on Su… (#10018) 2021-02-19 18:34:44 -05:00
dialogpt.rst ADD BORT (#9813) 2021-01-27 21:25:11 +03:00
distilbert.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
dpr.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
electra.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
encoderdecoder.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
flaubert.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
fsmt.rst Deprecate prepare_seq2seq_batch (#10287) 2021-02-22 12:36:16 -05:00
funnel.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
gpt.rst Added TF OpenAi GPT1 Sequence Classification (#9105) 2020-12-15 11:27:08 -05:00
gpt2.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
herbert.rst Improve documentation coverage for Herbert (#9428) 2021-01-06 09:13:43 -05:00
ibert.rst I-BERT model support (#10153) 2021-02-25 10:06:42 -05:00
layoutlm.rst Improve LayoutLM (#9476) 2021-01-12 09:26:32 -05:00
led.rst Upgrade styler to better handle lists (#9423) 2021-01-06 07:46:17 -05:00
longformer.rst Add message to documentation that longformer doesn't support token_type_ids (#9152) 2020-12-16 11:06:14 -05:00
lxmert.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
marian.rst Deprecate prepare_seq2seq_batch (#10287) 2021-02-22 12:36:16 -05:00
mbart.rst Deprecate prepare_seq2seq_batch (#10287) 2021-02-22 12:36:16 -05:00
mobilebert.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
mpnet.rst MPNet copyright files (#9015) 2020-12-10 09:29:38 -05:00
mt5.rst Enforce all objects in the main init are documented (#9014) 2020-12-10 11:57:12 -05:00
pegasus.rst Deprecate prepare_seq2seq_batch (#10287) 2021-02-22 12:36:16 -05:00
phobert.rst Improve documentation coverage for Phobert (#9427) 2021-01-06 10:04:32 -05:00
prophetnet.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
rag.rst Deprecate prepare_seq2seq_batch (#10287) 2021-02-22 12:36:16 -05:00
reformer.rst Enforce all objects in the main init are documented (#9014) 2020-12-10 11:57:12 -05:00
retribert.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
roberta.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
squeezebert.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
t5.rst Deprecate prepare_seq2seq_batch (#10287) 2021-02-22 12:36:16 -05:00
tapas.rst Fix URLs to TAPAS notebooks (#9435) 2021-01-06 07:20:41 -05:00
transformerxl.rst Fix script that check objects are documented (#9259) 2020-12-22 11:12:58 -05:00
wav2vec2.rst [PretrainedFeatureExtractor] + Wav2Vec2FeatureExtractor, Wav2Vec2Processor, Wav2Vec2Tokenizer (#10324) 2021-02-25 17:42:46 +03:00
xlm.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
xlmprophetnet.rst Copyright (#8970) 2020-12-07 18:36:34 -05:00
xlmroberta.rst Enforce all objects in the main init are documented (#9014) 2020-12-10 11:57:12 -05:00
xlnet.rst Enforce all objects in the main init are documented (#9014) 2020-12-10 11:57:12 -05:00