transformers/utils
Yih-Dar 8f2cc1c3ab
Add TFCLIPModel (#13967)
* Start the work for TFCLIPModel

* Convert to TF code (TODO: loss + doc)

* Clean up

* Fix pooled_output for TFCLIPTextTransformer - using tf.gather_nd

* assert -> raise error

* Expose TFCLIPModel

* Deal with dummy_inputs

* Add tests

* Fix all tests. TODO: manual check weight loading + add more comments

* Fix pt tf equivalence test

* fixes

* update TFCLIPVisionEmbeddings's Conv2D

* Fix loss + overwrite test_pt_tf_model_equivalence from common

* Add a comment about the change about MainLayer in test_keras_save_load

* Set return_loss=True in TFCLIPModelTester + make tests pass

* overwrite test_pt_tf_model_equivalence from tf common

* fix base_model_prefix

* Fix examples

* remove unused

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* apply review suggestions

* change self.pre_layrnorm to self.pre_layernorm

* apply more review suggestions

* return attention probs before dropout (to align with PT)

* fix weight init

* fix

* build doc

* fix missing doc

* fix for test

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2021-12-23 11:19:44 -05:00
..
tf_ops Check TF ops for ONNX compliance (#10025) 2021-02-15 07:55:10 -05:00
check_copies.py Doc new front (#14590) 2021-12-01 14:13:02 -05:00
check_dummies.py Fix dummy objects for quantization (#14478) 2021-11-21 17:39:20 -05:00
check_inits.py Fixes in init (#14681) 2021-12-08 13:42:22 -05:00
check_repo.py Add TFCLIPModel (#13967) 2021-12-23 11:19:44 -05:00
check_table.py Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
check_tf_ops.py Check TF ops for ONNX compliance (#10025) 2021-02-15 07:55:10 -05:00
custom_init_isort.py Sort init import (#10801) 2021-03-19 16:17:13 -04:00
documentation_tests.txt Doctests job (#13088) 2021-08-12 03:42:25 -04:00
download_glue_data.py Raise exceptions instead of asserts (#13907) 2021-10-07 12:44:23 +05:30
get_modified_files.py a more reliable version of branching point discovery (#9449) 2021-01-07 04:47:50 -05:00
notification_service.py Nightly torch ci (#13550) 2021-09-13 16:17:29 -04:00
print_env_pt.py [CI] move env print to util, add pt, nccl versions (#14607) 2021-12-03 08:18:36 -05:00
release.py Docs for v4.14.0 2021-12-15 18:29:53 +01:00
style_doc.py Only test the files impacted by changes in the diff (#12644) 2021-07-14 10:56:55 -04:00
tests_fetcher.py fix flax examples tests (#14646) 2021-12-07 00:34:27 +05:30
update_metadata.py Replace commit sha by commit url for update jobs (#14852) 2021-12-21 11:17:11 -05:00