Yih-Dar
|
8f2cc1c3ab
|
Add TFCLIPModel (#13967)
* Start the work for TFCLIPModel
* Convert to TF code (TODO: loss + doc)
* Clean up
* Fix pooled_output for TFCLIPTextTransformer - using tf.gather_nd
* assert -> raise error
* Expose TFCLIPModel
* Deal with dummy_inputs
* Add tests
* Fix all tests. TODO: manual check weight loading + add more comments
* Fix pt tf equivalence test
* fixes
* update TFCLIPVisionEmbeddings's Conv2D
* Fix loss + overwrite test_pt_tf_model_equivalence from common
* Add a comment about the change about MainLayer in test_keras_save_load
* Set return_loss=True in TFCLIPModelTester + make tests pass
* overwrite test_pt_tf_model_equivalence from tf common
* fix base_model_prefix
* Fix examples
* remove unused
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* apply review suggestions
* change self.pre_layrnorm to self.pre_layernorm
* apply more review suggestions
* return attention probs before dropout (to align with PT)
* fix weight init
* fix
* build doc
* fix missing doc
* fix for test
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
|
2021-12-23 11:19:44 -05:00 |
|
Patrick von Platen
|
0c3174c758
|
Add TF<>PT and Flax<>PT everywhere (#14047)
* up
* up
* up
* up
* up
* up
* up
* add clip
* fix clip PyTorch
* fix clip PyTorch
* up
* up
* up
* up
* up
* up
* up
|
2021-10-25 23:55:08 +02:00 |
|
Suraj Patil
|
84ad6af49a
|
minor fixes (#14026)
|
2021-10-15 20:08:57 -04:00 |
|
Suraj Patil
|
c164c651dc
|
[CLIP] fix logit_scale init (#13436)
* fix logit_scale init
* add logit_scale_init_value as config param
|
2021-09-08 14:21:13 +05:30 |
|
Lysandre Debut
|
c3d9ac7607
|
Expose get_config() on ModelTesters (#12812)
* Expose get_config() on ModelTesters
* Typo
|
2021-07-21 04:13:11 -04:00 |
|
Stas Bekman
|
372ab9cd6d
|
[style] consistent nn. and nn.functional: part 3 tests (#12155)
* consistent nn. and nn.functional: p3 templates
* restore
|
2021-06-14 12:18:22 -07:00 |
|
Tobias Norlund
|
9d2cee8b48
|
CLIPFeatureExtractor should resize images with kept aspect ratio (#11994)
* Resize with kept aspect ratio
* Fixed failed test
* Overload center_crop and resize methods instead
* resize should handle non-PIL images
* update slow test
* Tensor => tensor
Co-authored-by: patil-suraj <surajp815@gmail.com>
|
2021-06-10 18:40:41 +05:30 |
|
Mario Šaško
|
f5eec0d8e9
|
Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027)
* Replace legacy torch.Tensor constructor with torch.{tensor, empty}
* Remove torch.Tensor in examples
|
2021-06-08 13:58:38 +01:00 |
|
Suraj Patil
|
8719afa1ad
|
CLIP (#11445)
* begin second draft
* fix import, style
* add loss
* fix embeds, logits_scale, and projection
* fix imports
* add conversion script
* add feature_extractor and processor
* style
* add tests for tokenizer, extractor and processor
* add vision model tests
* add weight init
* add more tests
* fix save_load test
* model output, dosstrings, causal mask
* config doc
* add clip model tests
* return dict
* bigin integration test
* add integration tests
* fix-copies
* fix init
* Clip => CLIP
* fix module name
* docs
* fix doc
* output_dim => projection_dim
* fix checkpoint names
* remoe fast tokenizer file
* fix conversion script
* fix tests, quality
* put causal mask on device
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* fix attribute test
* style
* address sylvains comments
* style
* fix docstrings
* add qucik_gelu in activations, docstrings
* clean-up attention test
* fix act fun
* fix config
* fix torchscript tests
* even batch_size
* remove comment
* fix ouput tu_tuple
* fix save load tests
* fix add tokens test
* add fast tokenizer
* update copyright
* new processor API
* fix docs
* docstrings
* docs
* fix doc
* fix doc
* fix tokenizer
* fix import in doc example
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* check types of config
* valhalla => openai
* load image using url
* fix test
* typo
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
|
2021-05-12 13:48:15 +05:30 |
|