712 Commits

Author	SHA1	Message	Date
thomwolf	67376c02e2	update readme for tokenizers	2019-02-13 10:11:11 +01:00
Liang Niu	e1b3cfb504	fixed a minor bug in README.md	2019-02-12 15:54:23 +04:00
Thomas Wolf	3c33499f87	fix typo in readme	2019-02-12 10:22:54 +01:00
thomwolf	1e71f11dec	Release: 0.5.0	2019-02-11 14:16:27 +01:00
thomwolf	eebc8abbe2	clarify and unify model saving logic in examples	2019-02-11 14:04:19 +01:00
thomwolf	81c7e3ec9f	fix typo in readme	2019-02-11 13:37:12 +01:00
thomwolf	884ca81d87	transposing the inputs of Transformer-XL to have a unified interface	2019-02-11 13:19:59 +01:00
thomwolf	32fea876bb	add distant debugging to run_transfo_xl	2019-02-11 12:53:32 +01:00
thomwolf	b31ba23913	cuda on in the examples by default	2019-02-11 12:15:43 +01:00
thomwolf	2071a9b86e	fix python 2.7 imports	2019-02-11 10:35:36 +01:00
thomwolf	b514a60c36	added tests for OpenAI GPT and Transformer-XL tokenizers	2019-02-11 10:17:16 +01:00
thomwolf	9f9909ea2f	update readme	2019-02-09 16:59:21 +01:00
thomwolf	0c1a6f9b1d	update readme	2019-02-08 22:32:25 +01:00
thomwolf	009b581316	updated readme	2019-02-07 23:15:05 +01:00
thomwolf	f99f2fb661	docstrings	2019-02-07 17:07:22 +01:00
Thomas Wolf	848aae49e1	Merge branch 'master' into python_2	2019-02-06 00:13:20 +01:00
thomwolf	ba37ddc5ce	fix run_lm_modeling example command line	2019-02-06 00:07:08 +01:00
Girishkumar	0dd2b750ca	Minor update in README ... Update links to classes in `modeling.py`	2019-01-30 23:49:15 +05:30
thomwolf	3a848111e6	update config, docstrings and readme to switch to seperated tokens and position embeddings	2019-01-29 11:00:11 +01:00
Davide Fiocco	35115eaf93	(very) minor update to README	2019-01-16 21:05:24 +01:00
nhatchan	8edc898f63	Fix documentation (missing backslashes) ... This PR adds missing backslashes in LM Fine-tuning subsection in README.md.	2019-01-13 21:23:19 +09:00
thomwolf	e5c78c6684	update readme and few typos	2019-01-10 01:40:00 +01:00
thomwolf	fa5222c296	update readme	2019-01-10 01:25:28 +01:00
Thomas Wolf	c18bdb4433	Merge pull request #124 from deepset-ai/master ... Add example for fine tuning BERT language model	2019-01-07 12:03:51 +01:00
Julien Chaumond	8da280ebbe	Setup CI	2018-12-20 16:33:39 -05:00
tholor	e5fc98c542	add exemplary training data. update to nvidia apex. refactor 'item -> line in doc' mapping. add warning for unknown word.	2018-12-20 18:30:52 +01:00
tholor	67f4dd56a3	update readme for run_lm_finetuning	2018-12-19 09:22:37 +01:00
Julien Chaumond	d57763f582	Fix typos	2018-12-18 19:23:22 -05:00
Thomas Wolf	786cc41299	Typos in readme	2018-12-17 09:22:18 +01:00
Daniel Khashabi	8b1b93947f	Minor fix.	2018-12-14 14:10:36 -05:00
Thomas Wolf	8809eb6c93	update readme with information on NVIDIA's apex	2018-12-14 16:59:39 +01:00
thomwolf	d821358884	update readme	2018-12-14 15:15:17 +01:00
thomwolf	087798b7fa	fix reloading model for evaluation in examples	2018-12-13 14:48:12 +01:00
thomwolf	0f544625f4	fix swag example for work with apex	2018-12-13 13:35:59 +01:00
thomwolf	4946c2c500	run_swag example in readme	2018-12-13 13:02:07 +01:00
Thomas Wolf	91aab2a6d3	Merge pull request #116 from FDecaYed/deyuf/fp16_with_apex ... Change to use apex for better fp16 and multi-gpu support	2018-12-13 12:32:37 +01:00
Thomas Wolf	ffe9075f48	Merge pull request #96 from rodgzilla/multiple-choice-code ... BertForMultipleChoice and Swag dataset example.	2018-12-13 12:05:11 +01:00
Grégory Châtel	dcb50eaa4b	Swag example readme section update with gradient accumulation run.	2018-12-12 18:17:46 +01:00
Deyu Fu	c8ea286048	change to apex for better fp16 and multi-gpu support	2018-12-11 17:13:58 -08:00
Thomas Wolf	a3a3180c86	Bump up requirements to Python 3.6	2018-12-11 11:29:45 +01:00
Grégory Châtel	0876b77f7f	Change to the README file to add SWAG results.	2018-12-10 15:34:19 +01:00
Davide Fiocco	c9f67e037c	Adding --do_lower_case for all uncased BERTs ... I had missed those, it should make sense to use them	2018-12-07 20:40:56 +01:00
Grégory Châtel	150f3cd9fa	Few typos in README.md	2018-12-06 19:22:07 +01:00
Grégory Châtel	4fa7892d64	Wrong line number link to modeling file.	2018-12-06 19:18:29 +01:00
Grégory Châtel	6a26e19ea3	Updating README.md with SWAG example informations.	2018-12-06 19:15:08 +01:00
Grégory Châtel	0a7c8bdcac	Fixing badly formatted links.	2018-12-04 13:43:56 +01:00
Grégory Châtel	3113e967db	Adding links to examples files.	2018-12-04 13:40:38 +01:00
Davide Fiocco	8a8aa59d8c	Update finetuning example adding --do_lower_case ... Should be consistent with the fact that an uncased model is used	2018-12-01 01:00:05 +01:00
thomwolf	f9f3bdd60b	update readme	2018-11-30 23:05:18 +01:00
thomwolf	52ff0590ff	tup => tpu	2018-11-30 23:01:10 +01:00
thomwolf	296f006132	added BertForTokenClassification model	2018-11-30 13:56:53 +01:00
thomwolf	298107fed7	Added new bert models	2018-11-30 13:56:02 +01:00
Davide Fiocco	ec2c339b53	Updated quick-start example with BertForMaskedLM ... As `convert_ids_to_tokens` returns a list, the code in the README currently throws an `AssertionError`, so I propose I quick fix.	2018-11-28 14:53:46 +01:00
thomwolf	05053d163c	update cache_dir in readme and examples	2018-11-26 10:45:13 +01:00
thomwolf	029bdc0d50	fixing readme examples	2018-11-26 09:56:41 +01:00
Thomas Wolf	60e01ac427	fix link in readme	2018-11-21 12:08:30 +01:00
Thomas Wolf	fd32ebed81	Merge pull request #42 from weiyumou/master ... Fixed UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2	2018-11-20 10:09:50 +01:00
thomwolf	eed255a58d	fixing CLI typo in readme	2018-11-20 10:02:57 +01:00
weiyumou	9ff2b7d86d	Fixed README typo	2018-11-19 23:13:10 -05:00
Thomas Wolf	da73925f6a	fix typos	2018-11-19 20:58:48 +01:00
Joel Grus	dd56cfd89a	update pip package name	2018-11-19 09:50:34 -08:00
Thomas Wolf	956c917344	fix typos in readme	2018-11-17 23:25:23 +01:00
Thomas Wolf	7c91e51c26	update links in readme	2018-11-17 22:54:15 +01:00
Thomas Wolf	e113101702	fix typos in readme	2018-11-17 12:36:35 +01:00
thomwolf	47a7d4ec14	update examples from master	2018-11-17 12:21:35 +01:00
thomwolf	c8cba67742	clean up readme and examples	2018-11-17 12:19:16 +01:00
thomwolf	757750d6f6	fix tests	2018-11-17 11:58:14 +01:00
thomwolf	d0673c7dbd	fix links	2018-11-17 08:59:29 +01:00
thomwolf	68b937aa40	sub section overviews	2018-11-17 08:55:56 +01:00
thomwolf	c54d8b1847	fixing links in readme	2018-11-17 08:46:17 +01:00
thomwolf	f920eff8c3	update readme	2018-11-17 08:42:45 +01:00
thomwolf	886cb49792	updating readme and notebooks	2018-11-16 14:31:15 +01:00
thomwolf	1de35b624b	preparing for first release	2018-11-15 20:56:10 +01:00
Thomas Wolf	278fd28a32	added results for 16-bit fine-tuning in readme	2018-11-13 09:34:49 +01:00
thomwolf	d940eeda54	typo	2018-11-12 15:26:46 +01:00
thomwolf	1cf0a16c67	cleaning up readme	2018-11-12 15:24:47 +01:00
thomwolf	66b0090877	add fp16 training	2018-11-12 15:15:02 +01:00
Thomas Wolf	5dfd19060a	fix typo in readme	2018-11-12 12:39:57 +01:00
Thomas Wolf	fa1aa81f26	fix typo in readme bach examples	2018-11-12 08:37:43 +01:00
Thomas Wolf	6d6b916f48	update to BERT-large results	2018-11-11 17:00:49 +01:00
Thomas Wolf	c4bfc646f5	Add results of fine-tuning BERT-large on GPUs	2018-11-11 16:59:35 +01:00
thomwolf	ea85cca8ab	adding optimize_on_cpu explanation in readme	2018-11-09 11:42:37 +01:00
Thomas Wolf	0c24db9d5f	update results for SQuAD	2018-11-09 09:11:59 +01:00
thomwolf	2c5d993ba4	update readme - fix SQuAD model on multi-GPU	2018-11-08 21:22:22 +01:00
Gopal Krishna	4850ec5888	fixed small typos in the README.md (#8)	2018-11-08 15:00:02 -05:00
Thomas Wolf	3bfbc21376	updating pytest command	2018-11-08 00:44:17 +01:00
Thomas Wolf	0ed7696191	Updated MRPC results	2018-11-08 00:39:42 +01:00
Thomas Wolf	d92a7f7721	Removing note on run_squad.py example	2018-11-07 23:37:55 +01:00
Thomas Wolf	1a5bbd83dc	Updating run_squad information in readme	2018-11-06 08:53:01 +01:00
Thomas Wolf	79e1b95e75	fix link in readme	2018-11-06 08:38:02 +01:00
Knut Ole Sjøli	886f595c37	Fix typo in subheader (#4)	2018-11-05 18:34:18 -05:00
Thomas Wolf	59d4cc5f2b	typos	2018-11-05 22:47:24 +01:00
Thomas Wolf	d983eecdd3	more readme typo fixes	2018-11-05 21:29:04 +01:00
Thomas Wolf	8f91b4de91	more typo fixes	2018-11-05 21:24:14 +01:00
Thomas Wolf	7316b0d6d0	fix typo	2018-11-05 21:22:45 +01:00
Clement	d130cb5139	typos	2018-11-05 15:09:24 -05:00
Clement	2a8fee495b	typos	2018-11-05 15:04:06 -05:00
Clement	f968b11657	typo	2018-11-05 14:59:44 -05:00
thomwolf	88e793f31a	fix typos	2018-11-05 16:14:19 +01:00
thomwolf	3914eed505	update readme	2018-11-05 16:09:27 +01:00
thomwolf	7394eb47a5	update readme	2018-11-05 15:35:44 +01:00
thomwolf	6cc651778a	update readme	2018-11-04 21:26:03 +01:00
thomwolf	d6418c5ef3	tweaking the readme	2018-11-03 23:52:35 +01:00
thomwolf	3b70b270e0	update readme	2018-11-03 23:39:55 +01:00
thomwolf	f8276008df	update readme, file names, removing TF code, moving tests	2018-11-03 23:35:14 +01:00
VictorSanh	5889765a7c	Update README.md	2018-11-03 09:18:44 -04:00
VictorSanh	844b2f0e6f	Small update Readme	2018-11-02 08:57:15 -04:00
VictorSanh	72d69a4ef4	Update README	2018-11-02 03:37:39 -04:00
VictorSanh	bf65d4dbb7	Begin Updating the README.md	2018-11-02 02:51:07 -04:00
thomwolf	13ee61e4de	switch to full google code	2018-10-31 18:46:03 +01:00
thomwolf	12e013dbac	added wordpiece - updated readme	2018-10-30 23:09:09 +01:00
Thomas Wolf	43badf217d	Initial commit	2018-10-29 14:56:02 +01:00