transformers/docs/source/model_doc
Forrest Iandola 02ef825be2
SqueezeBERT architecture (#7083)
* configuration_squeezebert.py

thin wrapper around bert tokenizer

fix typos

wip sb model code

wip modeling_squeezebert.py. Next step is to get the multi-layer-output interface working

set up squeezebert to use BertModelOutput when returning results.

squeezebert documentation

formatting

allow head mask that is an array of [None, ..., None]

docs

docs cont'd

path to vocab

docs and pointers to cloud files (WIP)

line length and indentation

squeezebert model cards

formatting of model cards

untrack modeling_squeezebert_scratchpad.py

update aws paths to vocab and config files

get rid of stub of NSP code, and advise users to pretrain with mlm only

fix rebase issues

redo rebase of modeling_auto.py

fix issues with code formatting

more code format auto-fixes

move squeezebert before bert in tokenization_auto.py and modeling_auto.py because squeezebert inherits from bert

tests for squeezebert modeling and tokenization

fix typo

move squeezebert before bert in modeling_auto.py to fix inheritance problem

disable test_head_masking, since squeezebert doesn't yet implement head masking

fix issues exposed by the test_modeling_squeezebert.py

fix an issue exposed by test_tokenization_squeezebert.py

fix issue exposed by test_modeling_squeezebert.py

auto generated code style improvement

issue that we inherited from modeling_xxx.py: SqueezeBertForMaskedLM.forward() calls self.cls(), but there is no self.cls, and I think the goal was actually to call self.lm_head()

update copyright

resolve failing 'test_hidden_states_output' and remove unused encoder_hidden_states and encoder_attention_mask

docs

add integration test. rename squeezebert-mnli --> squeezebert/squeezebert-mnli

autogenerated formatting tweaks

integrate feedback from patrickvonplaten and sgugger to programming style and documentation strings

* tiny change to order of imports
2020-10-05 04:25:43 -04:00
..
albert.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
auto.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
bart.rst Cleanup documentation for BART, Marian, MBART and Pegasus (#7523) 2020-10-05 04:22:12 -04:00
bert.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
bertgeneration.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
camembert.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
ctrl.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
deberta.rst Add DeBERTa model (#5929) 2020-09-30 07:07:30 -04:00
dialogpt.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
distilbert.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
dpr.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
electra.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
encoderdecoder.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
flaubert.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
fsmt.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
funnel.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
gpt.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
gpt2.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
layoutlm.rst Update LayoutLM doc (#7388) 2020-10-01 09:11:42 -04:00
longformer.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
lxmert.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
marian.rst Cleanup documentation for BART, Marian, MBART and Pegasus (#7523) 2020-10-05 04:22:12 -04:00
mbart.rst Cleanup documentation for BART, Marian, MBART and Pegasus (#7523) 2020-10-05 04:22:12 -04:00
mobilebert.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
pegasus.rst Cleanup documentation for BART, Marian, MBART and Pegasus (#7523) 2020-10-05 04:22:12 -04:00
rag.rst Document RAG again (#7377) 2020-09-28 08:31:46 -04:00
reformer.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
retribert.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
roberta.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
squeezebert.rst SqueezeBERT architecture (#7083) 2020-10-05 04:25:43 -04:00
t5.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
transformerxl.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
xlm.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
xlmroberta.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00
xlnet.rst Models doc (#7345) 2020-09-23 13:20:45 -04:00