2207 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Lysandre	c110c41fdb	Run GLUE and remove LAMB	2019-11-26 13:08:12 -05:00
Lysandre	6637a77f80	AlbertForSequenceClassification	2019-11-26 13:08:12 -05:00
Lysandre	0d07a23c04	LAMB implementation	2019-11-26 13:08:12 -05:00
Lysandre	c987545592	Converting script	2019-11-26 13:08:12 -05:00
Lysandre	4f3a54bfc8	ALBERT can load pre-trained models. Doesn't inherit from BERT anymore.	2019-11-26 13:08:12 -05:00
Lysandre	c4403006b8	External MLM head	2019-11-26 13:08:12 -05:00
Lysandre	b21402fc86	Python 2 tests + licence	2019-11-26 13:08:12 -05:00
Lysandre	c14a22272f	ALBERT passes all tests	2019-11-26 13:08:12 -05:00
Lysandre	870320a24e	Early tests	2019-11-26 13:08:12 -05:00
Lysandre	25a31953e8	Output Attentions + output hidden states	2019-11-26 13:08:12 -05:00
Lysandre	ce9eade29c	Initializer range using BertPreTrainedModel	2019-11-26 13:08:12 -05:00
Lysandre	5680a11063	Activation function managed from the config file	2019-11-26 13:08:12 -05:00
Lysandre	1e5b31c388	Several fixes and improvements	2019-11-26 13:08:12 -05:00
Lysandre	ee20201d33	Tokenization tests + fixes + init	2019-11-26 13:08:12 -05:00
Lysandre	e3ea5d1d8d	Docstrings	2019-11-26 13:08:12 -05:00
Lysandre	fedac786d4	Tokenization + small fixes	2019-11-26 13:08:12 -05:00
Lysandre	67b422662c	Documentation + improved AlbertForMaskedLM	2019-11-26 13:08:12 -05:00
Lysandre	1b92564330	Reorganize and cleanup	2019-11-26 13:08:12 -05:00
Lysandre	12290c0d5c	Handles multi layer and multi groups	2019-11-26 13:08:12 -05:00
Lysandre	139affaa8d	Albert layer/layer groups	2019-11-26 13:08:12 -05:00
Lysandre	91ccbae788	Accepts multiple sizes	2019-11-26 13:08:12 -05:00
Lysandre	c0c2088333	ALBERT model	2019-11-26 13:08:12 -05:00
v_sboliu	8e5d84fcc1	Fixed typo	2019-11-26 09:01:32 -05:00
manansanghi	5d3b8daad2	Minor bug fixes on run_ner.py	2019-11-25 16:48:03 -05:00
İbrahim Ethem Demirci	aa92a184d2	resize model when special tokenizer present	2019-11-25 15:06:32 -05:00
Bilal Khan	07bf43074f	Fix GPT2 docstring	2019-11-25 11:32:00 -05:00
Evpok Padding	fa963ecc59	if→elif	2019-11-25 10:21:03 -05:00
Evpok Padding	c8eb8157b8	fix docstrings	2019-11-25 10:21:03 -05:00
Evpok Padding	99f750d64e	add Camembert models to modeling_auto	2019-11-25 10:21:03 -05:00
Lysandre	7485caefb0	fix #1894	2019-11-25 09:33:39 -05:00
Julien Chaumond	afaa335851	[doc] Fix assets urls	2019-11-23 11:34:45 -05:00
Julien Chaumond	176cd1ce1b	[doc] homogenize instructions slightly	2019-11-23 11:18:54 -05:00
Nikolay Korolev	041a901f32	Fix typo in documentation. toto -> to	2019-11-23 10:55:16 -05:00
Rémi Louf	26db31e0c0	update the documentation	2019-11-21 14:41:19 -05:00
Rémi Louf	6f70bb8c69	add instructions to run the examples	2019-11-21 14:41:19 -05:00
Thomas Wolf	0cdfcca24b	Merge pull request #1860 from stefan-it/camembert-for-token-classification ... [WIP] Add support for CamembertForTokenClassification	2019-11-21 10:56:07 +01:00
Jin Young Sohn	e70cdf083d	Cleanup TPU bits from run_glue.py ... TPU runner is currently implemented in: https://github.com/pytorch-tpu/transformers/blob/tpu/examples/run_glue_tpu.py. We plan to upstream this directly into `huggingface/transformers` (either `master` or `tpu`) branch once it's been more thoroughly tested.	2019-11-20 17:54:34 -05:00
Lysandre	454455c695	fix #1879	2019-11-20 09:42:48 -05:00
Kazutoshi Shinoda	f3386d9383	typo "deay" -> "decay"	2019-11-18 11:50:06 -05:00
Stefan Schweter	56c84863a1	camembert: add support for CamemBERT in run_ner example	2019-11-18 17:06:57 +01:00
Stefan Schweter	0b3d45eb64	camembert: add implementation for save_vocabulary method	2019-11-18 15:49:44 +01:00
Julien Chaumond	3916b334a8	[camembert] Acknowledge the full author list	2019-11-18 09:29:11 -05:00
Sebastian Stabinger	44455eb5b6	Adds CamemBERT to Model architectures list	2019-11-18 09:23:14 -05:00
Stefan Schweter	33753d9139	module: import CamembertForTokenClassification	2019-11-18 14:14:54 +01:00
Stefan Schweter	d32ce2c8df	camembert: add wrapper for CamembertForTokenClassification	2019-11-18 14:14:19 +01:00
Julien Chaumond	0477b307c7	[camembert] tokenizer: use additional_special_tokens	2019-11-16 00:11:07 -05:00
Julien Chaumond	f9abf73e31	[camembert] realign w/ recent changes	2019-11-16 00:11:07 -05:00
Julien Chaumond	26858f27cb	[camembert] Upload to s3 + rename script	2019-11-16 00:11:07 -05:00
Louis MARTIN	035fea5315	Add CamemBERT to auto files and docs	2019-11-16 00:11:07 -05:00
Louis MARTIN	694d4fcbb6	Add CamemBERT classes to __init__.py	2019-11-16 00:11:07 -05:00