NielsRogge 31ee80d556 Add LayoutLMv3 (#17060) ... * Make forward pass work * More improvements * Remove unused imports * Remove timm dependency * Improve loss calculation of token classifier * Fix most tests * Add docs * Add model integration test * Make all tests pass * Add LayoutLMv3FeatureExtractor * Improve integration test + make fixup * Add example script * Fix style * Add LayoutLMv3Processor * Fix style * Add option to add visual labels * Make more tokenizer tests pass * Fix more tests * Make more tests pass * Fix bug and improve docs * Fix import of processors * Improve docstrings * Fix toctree and improve docs * Fix auto tokenizer * Move tests to model folder * Move tests to model folder * change default behavior add_prefix_space * add prefix space for fast * add_prefix_spcae set to True for Fast * no space before `unique_no_split` token * add test to hightligh special treatment of added tokens * fix `test_batch_encode_dynamic_overflowing` by building a long enough example * fix `test_full_tokenizer` with add_prefix_token * Fix tokenizer integration test * Make the code more readable * Add tests for LayoutLMv3Processor * Fix style * Add model to README and update init * Apply suggestions from code review * Replace asserts by value errors * Add suggestion by @ducviet00 * Add model to doc tests * Simplify script * Improve README * a step ahead to fix * Update pair_input_test * Make all tokenizer tests pass - phew * Make style * Add LayoutLMv3 to CI job * Fix auto mapping * Fix CI job name * Make all processor tests pass * Make tests of LayoutLMv2 and LayoutXLM consistent * Add copied from statements to fast tokenizer * Add copied from statements to slow tokenizer * Remove add_visual_labels attribute * Fix tests * Add link to notebooks * Improve docs of LayoutLMv3Processor * Fix reference to section Co-authored-by: SaulLu <lucilesaul.com@gmail.com> Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>		2022-05-24 09:53:45 +02:00
..
benchmark	[Test refactor 1/5] Per-folder tests reorganization (#15725)	2022-02-23 15:46:28 -05:00
deepspeed	missing file (#17164)	2022-05-10 10:19:50 -07:00
extended	Update self-push workflow (#17177)	2022-05-13 16:28:00 +02:00
fixtures	add a warning in SpmConverter for sentencepiece's model using the byte fallback feature (#16629)	2022-04-11 11:06:10 +02:00
generation	[Generation] Fix Transition probs (#17311)	2022-05-19 22:17:02 +02:00
models	Add LayoutLMv3 (#17060)	2022-05-24 09:53:45 +02:00
onnx	Add onnx export cuda support (#17183)	2022-05-18 17:52:13 +02:00
optimization	[Test refactor 1/5] Per-folder tests reorganization (#15725)	2022-02-23 15:46:28 -05:00
pipelines	Adding batch_size test to QA pipeline. (#17330)	2022-05-19 14:28:12 -04:00
sagemaker	Black preview (#17217)	2022-05-12 16:25:55 -04:00
tokenization	[Test refactor 1/5] Per-folder tests reorganization (#15725)	2022-02-23 15:46:28 -05:00
trainer	[tests] fix copy-n-paste error (#17312)	2022-05-18 16:00:47 -07:00
utils	Fix tests of mixed precision now that experimental is deprecated (#17300)	2022-05-17 14:14:17 +01:00
__init__.py
test_configuration_common.py	Black preview (#17217)	2022-05-12 16:25:55 -04:00
test_feature_extraction_common.py	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
test_modeling_common.py	Use Accelerate in from_pretrained for big model inference (#17341)	2022-05-23 14:32:21 -04:00
test_modeling_flax_common.py	[Flax] improve large model init and loading (#16148)	2022-04-19 14:19:55 +02:00
test_modeling_tf_common.py	Rewrite TensorFlow train_step and test_step (#17057)	2022-05-17 14:36:23 +01:00
test_sequence_feature_extraction_common.py	Some tests misusing assertTrue for comparisons fix (#16771)	2022-04-19 14:44:08 +02:00
test_tokenization_common.py	Black preview (#17217)	2022-05-12 16:25:55 -04:00