Andreas Madsen b4b613b102 Implement Roberta PreLayerNorm (#20305) ... * Copy RoBERTa * formatting * implement RoBERTa with prelayer normalization * update test expectations * add documentation * add convertion script for DinkyTrain weights * update checkpoint repo Unfortunately the original checkpoints assumes a hacked roberta model * add to RoBERTa-PreLayerNorm docs to toc * run utils/check_copies.py * lint files * remove unused import * fix check_repo reporting wrongly a test is missing * fix import error, caused by rebase * run make fix-copies * add RobertaPreLayerNormConfig to ROBERTA_EMBEDDING_ADJUSMENT_CONFIGS * Fix documentation <Facebook> -> Facebook Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * fixup: Fix documentation <Facebook> -> Facebook Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * Add missing Flax header Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * expected_slice -> EXPECTED_SLICE Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * update copies after rebase * add missing copied from statements * make fix-copies * make prelayernorm explicit in code * fix checkpoint path for the original implementation * add flax integration tests * improve docs * update utils/documentation_tests.txt * lint files * Remove Copyright notice Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * make fix-copies * Remove EXPECTED_SLICE calculation comments Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>		2022-12-19 09:30:17 +01:00
..
test_module	AutoImageProcessor (#20111)	2022-11-08 19:54:41 +00:00
tf_ops	Check TF ops for ONNX compliance (#10025)	2021-02-15 07:55:10 -05:00
check_config_docstrings.py	Create dummy models (#19901)	2022-10-28 13:05:41 +02:00
check_copies.py	README in Hindi 🇮🇳 (#20097)	2022-12-06 01:04:40 +05:30
check_doc_toc.py	Split model list on modality (#18328)	2022-08-01 11:10:20 -05:00
check_dummies.py	Add some tests for check_dummies (#19146)	2022-09-21 14:54:09 -04:00
check_inits.py	Add ESMFold (#19977)	2022-10-31 21:32:58 -04:00
check_repo.py	Implement Roberta PreLayerNorm (#20305)	2022-12-19 09:30:17 +01:00
check_self_hosted_runner.py	Add offline runners info in the Slack report (#19169)	2022-09-23 19:23:05 +02:00
check_table.py	Fix some typos. (#17560)	2022-07-11 05:00:13 -04:00
check_tf_ops.py	Check TF ops for ONNX compliance (#10025)	2021-02-15 07:55:10 -05:00
create_dummy_models.py	[Tiny model creation] deal with ImageProcessor (#20298)	2022-11-17 20:49:46 +01:00
custom_init_isort.py	Fix init import_structure sorting (#20477)	2022-11-29 09:46:10 -05:00
documentation_tests.txt	Implement Roberta PreLayerNorm (#20305)	2022-12-19 09:30:17 +01:00
download_glue_data.py	Raise exceptions instead of asserts (#13907)	2021-10-07 12:44:23 +05:30
extract_warnings.py	Update some GH action versions (#20537)	2022-12-06 16:54:40 +01:00
get_ci_error_statistics.py	Update Past CI report script (#19228)	2022-09-29 19:22:23 +02:00
get_github_job_time.py	add a script to get time info. from GA workflow jobs (#18822)	2022-09-01 12:02:52 +02:00
get_modified_files.py	Updates the default branch from master to main (#16326)	2022-03-23 03:46:59 -04:00
notification_service_doc_tests.py	fix missing block when there is no failure (#18775)	2022-08-29 09:10:13 +02:00
notification_service.py	extract warnings in GH workflows (#20487)	2022-11-29 15:58:54 +01:00
past_ci_versions.py	Add PyTorch 1.11 to past CI (#18302)	2022-07-26 15:47:23 +02:00
prepare_for_doc_test.py	Add a check regarding the number of occurrences of ``` (#18389)	2022-08-01 14:23:02 +02:00
print_env.py	Print more library versions in CI (#17384)	2022-06-02 10:24:16 +02:00
release.py	Clean README in post release job as well. (#17519)	2022-06-02 07:44:03 -04:00
sort_auto_mappings.py	Automatically sort auto mappings (#17250)	2022-05-16 13:24:20 -04:00
tests_fetcher.py	Add dpt-hybrid support (#20645)	2022-12-07 17:01:55 +01:00
update_metadata.py	Add video classification pipeline (#20151)	2022-12-08 16:22:43 -05:00