riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-23 22:38:58 +06:00
Code Issues Actions 31 Packages Projects Releases Wiki Activity
15,053 Commits 878 Branches 229 Tags 2 GiB
3f9f749325
Commit Graph

15053 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Joao Gante
0f78529f98
Generate: general TF XLA constrastive search are now slow tests (#20277) 
* move contrastive search test to slow
 2022-11-17 12:34:46 +00:00
Joao Gante
2062c28552
TF: add test for PushToHubCallback (#20231) 
* test hub tf callback

* create repo before cloning it
 2022-11-17 12:33:44 +00:00
amyeroberts
3a780cc57a
Image transforms functionality used instead (#20278) 
* Image transforms functionality used instead

* Import torch

* Import rather than copy

* Update src/transformers/models/conditional_detr/feature_extraction_conditional_detr.py
 2022-11-17 11:16:13 +00:00
Nicolas Patry
3fad6ae3fd
Adding doctest for object-detection pipeline. (#20258) 
* Adding doctest for `object-detection` pipeline.

* Removed nested_simplify.
 2022-11-17 11:59:59 +01:00
Nicolas Patry
6c2be845dd
Adding zero-shot-object-detection pipeline doctest. (#20274) 
* Adding `zero-shot-object-detection` pipeline doctest.

* Remove nested_simplify.
 2022-11-17 10:55:55 +01:00
Younes Belkada
7d65efec29
[bnb] Let's warn users when saving 8-bit models (#20282) 
* add warning on 8-bit models

- added tests
- added wrapper

* move to a private attribute

- remove wrapper
- changed `save_pretrained` method

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* fix suggestions

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2022-11-17 08:16:36 +01:00
Arthur
0a144b8c6b
[DOCTEST] Fix the documentation of RoCBert (#20142) 
* update part of the doc

* add temp values, fix part of the doc

* add template outputs

* add correct models and outputss

* style

* fixup
 2022-11-17 06:40:47 +01:00
Zachary Mueller
441811ecd7
Fix summarization script (#20286) 2022-11-16 15:57:07 -05:00
Saad Mahmud
5e012f8e3c
[Doctest] Add configuration_deformable_detr.py (#20273) 
* Update configuration_deformable_detr.py comment

* Add DeformableDetrConfig to documentation_tests.txt
 2022-11-16 18:20:06 +01:00
Alexander Markov
610acc5ae9
Data collator for token classification pads labels column when receives pytorch tensors (#20244) 
* token cls data_collator pads labels column

* remove walrus operator for code quality

* remove redundat space

* remove comment that was fixed

* PR comments fix

Co-authored-by: Alexander Markov <amarkov.me@gmail.com>
 2022-11-16 12:18:46 -05:00
IMvision12
d4d23141c4
remaining pytorch type hints (#20217) 
* Update modeling_flava.py

* Update modeling_markuplm.py

* Update modeling_glpn.py

* Update modeling_roc_bert.py

* Update modeling_segformer.py

* Update modeling_tapas.py

* Update modeling_tapas.py

* Update modeling_tapas.py

* Update modeling_tapas.py

* Update modeling_trocr.py

* Update modeling_videomae.py

* Update modeling_videomae.py

* Update modeling_videomae.py

* Update modeling_yolos.py

* Update modeling_wav2vec2.py

* Update modeling_jukebox.py

* Update modeling_jukebox.py

* Update modeling_jukebox.py

* Update modeling_jukebox.py
 2022-11-16 16:53:40 +00:00
Nicolas Patry
9ea1dbd2be
Adding doctest for token-classification pipeline. (#20265) 
* Adding doctest for `token-classification` pipeline.

* Adding doctest to `token-classification` pipeline.

* Remove nested_simplify.
 2022-11-16 17:22:00 +01:00
Nicolas Patry
21b0ad05a0
Adding doctest for image-to-text pipeline. (#20257) 
* Adding `zero-shot-object-detection` pipeline doctest.

* Adding doctest for `image-to-text` pipeline.

* Remove nested_simplify.
 2022-11-16 17:17:40 +01:00
Shogo Hida
389702242d
[Docs] Add resources of OpenAI GPT (#20084) 
* Add resources of OpenAI GPT

* Delete Deploy section and add .

* Add scripts

* Update docs/source/en/model_doc/openai-gpt.mdx

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Delete causal-language-modeling section

* Add TFOpenAIGPTLMHeadModel

* Add resources from community

* Delete a link

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2022-11-16 11:17:32 -05:00
Nicolas Patry
9accbe531e
Adding doctest for question-answering pipeline. (#20259) 
* Adding doctest for `question-answering` pipeline.

* Remove nested simplify.
 2022-11-16 17:16:19 +01:00
Nicolas Patry
d9efb36cf6
Adding doctest for text-classification pipeline. (#20262) 
* Adding doctest for `text-classification` pipeline.

* Remove nested_simplify.
 2022-11-16 17:15:34 +01:00
Nicolas Patry
c282e93a74
Adding doctest for visual-question-answering pipeline. (#20266) 
* Adding doctest for `visual-question-answering` pipeline.

* Remove nested_simplify.
 2022-11-16 17:15:25 +01:00
Nicolas Patry
e06657a798
Adding doctest for zero-shot-classification pipeline. (#20268) 
* Adding doctest for `zero-shot-classification` pipeline.

* Removing nested_simplify.
 2022-11-16 17:15:01 +01:00
Nicolas Patry
69715f2ee0
Adding doctest for zero-shot-image-classification pipeline. (#20272) 
* Adding doctest for `zero-shot-image-classification` pipeline.

* Remove nested_simplify.
 2022-11-16 17:14:48 +01:00
Nicolas Patry
291c17f608
Adding doctest example for image-classification pipeline. (#20254) 
* adding doctest example for `image-classification` pipeline.

* Remove nested simplify.
 2022-11-16 17:09:57 +01:00
Nicolas Patry
a239bdd28f
Rephrasing the link. (#20253) 
* Rephrasing the link.

* Removing `nested_simplify` within doctests.

* Fixup.
 2022-11-16 17:09:45 +01:00
Matt
e9d9982e7c
Add TF protein notebook to notebooks doc (#20271) 2022-11-16 16:08:51 +00:00
Nicolas Patry
5ca479d252
Adding doctest for text-generation pipeline. (#20264) 2022-11-16 16:57:46 +01:00
Nicolas Patry
449f2ae459
Adding doctest for text2text-generation pipeline. (#20261) 2022-11-16 16:57:08 +01:00
Nicolas Patry
f6490180eb
Adding doctest for image-segmentation pipeline. (#20256) 
* Adding doctest for `image-segmentation` pipeline.

* Fixup.
 2022-11-16 16:56:54 +01:00
Nicolas Patry
c389d35a7f
Adding a doctest for table-question-answering pipeline. (#20260) 2022-11-16 16:45:42 +01:00
Jiahao Li
9681f052a1
Fix result saving errors of pytorch examples (#20276) 2022-11-16 09:51:04 -05:00
Mishig
e627e9b5ae
Complete doc migration (#20267) 2022-11-16 08:43:37 -05:00
Nicolas Patry
4fb34de99e
Adding an example for depth-estimation pipeline. (#20237) 
* Adding an example for `depth-estimation` pipeline.

* Adding missing internal link to tutorial.
 2022-11-16 09:52:45 +01:00
Nicolas Patry
1f029b6ae7
Adding doctest for document-question-answering (#20239) 
* Adding doctest for doc qa.

* Adding doctest for doc qa.

* Fixup.
 2022-11-16 09:52:35 +01:00
Nicolas Patry
443aaaa1a7
Adding ASR pipeline example. (#20226) 
* Adding ASR pipeline example.

* De indent.

* Example deindent.

* Fixing example ?

* Putting the example in a more prominent place.

* Fixup.

* Adding the file.

* Adding the doctest to the daily test.

* Fixing comments.

* transcriber name.

* Adding `>>>`.

* Removing assert.
 2022-11-16 09:51:45 +01:00
Nicolas Patry
e434627858
Adding doctest for feature-extraction. (#20240) 
* Adding doctest for `feature-extraction`.

* Update feature_extraction.py
 2022-11-16 09:51:31 +01:00
Nicolas Patry
529037fda5
Adding doctest for fill-mask pipeline. (#20241) 2022-11-16 09:51:20 +01:00
Nicolas Patry
5e080c11bf
Updating the doctest for conversational. (#20236) 
* Updating the doctest for conversational.

- Make it tested against
- Add explicit output in the test.

* Removing assert.

* Adding missing link.
 2022-11-16 09:51:12 +01:00
Nicolas Patry
860ea8a574
Adding audio-classification example in the doc. (#20235) 
* Adding `audio-classification` example in the doc.

* Adding `>>>` to get the real test.

* Removing assert.

* Fixup.
 2022-11-16 09:51:03 +01:00
Alara Dirik
a00b7e85ea
Adds image-guided object detection support to OWL-ViT (#20136) 
Adds image-guided object detection method to OwlViTForObjectDetection class as described in the original paper. One-shot/ image-guided object detection enables users to use a query image to search for similar objects in the input image.

Co-Authored-By: Dhruv Karan k4r4n.dhruv@gmail.com
 2022-11-16 09:07:46 +03:00
Yih-Dar
0d0d77693f
Allow trainer to return eval. loss for CLIP-like models (#20214) 
* Allow trainer to return loss for CLIP-like models

* Apply suggestions

* update

* update

* update

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-11-15 19:47:10 +01:00
Zachary Mueller
822ae69c1b
Update reqs to include min gather_for_metrics Accelerate version (#20242) 
* Update reqs to include min gather_for_metrics Accelerate version

* Other reqs
 2022-11-15 13:28:00 -05:00
Ambuj Pawar
c19aa7acce
Add clip resources to the transformers documentation (#20190) 
* WIP: Added CLIP resources from HuggingFace blog

* ADD: Notebooks documentation to clip

* Add link straight to notebook

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Change notebook links to colab

Co-authored-by: Ambuj Pawar <your_email@abc.example>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2022-11-15 13:26:46 -05:00
Saad Mahmud
5b62f8ea2b
Add to DeBERTa resources (#20155) 
* Add to DeBERTa resources

* Fix mistakes with chapter number

* Add fill-mask pipeline

* Add sequence, token and QA pipeline

* Change token classification pipeline order

* Remove flax script and notebook links
 2022-11-15 13:26:07 -05:00
Matt
26ec7928d0
Slightly alter Keras dummy loss (#20232) 
* Slightly alter Keras dummy loss

* Slightly alter Keras dummy loss

* Add sample weight to test_keras_fit

* Fix test_keras_fit for datasets

* Skip the sample_weight stuff for models where the model tester has no batch_size
 2022-11-15 16:58:43 +00:00
Suraj Patil
7f74433814
[CLIP] allow loading projection layer in vision and text model (#18962) 
* allow loading projection in text and vision model

* begin tests

* finish test for CLIPTextModelTest

* style

* add slow tests

* add new classes for projection heads

* remove with_projection

* add in init

* add in doc

* fix tests

* fix some more tests

* fix copies

* fix docs

* remove leftover from fix-copies

* add the head models in IGNORE_NON_AUTO_CONFIGURED

* fix docstr

* fix tests

* Apply suggestions from code review

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* add docstr for models

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2022-11-15 17:50:07 +01:00
Sylvain Gugger
9643ecf8ca
Enable PyTorch 1.13 (#20168) 
* Try PT1.13 by removing torch scatter

* Skip failing tests

* Style

* Remvoe testing extras for repo utils

* Try with all decorators

* Try to wipe the cache

* Fix all tests?

* Try this way

* Fix comma

* Update to main

* Try with less deps

* Quality
 2022-11-15 11:33:09 -05:00
Muhammad Sakib Khan Inan
777b1bfe62
New logging support to "Trainer" Class (ClearML Logger) (#20184) 
* Init Update

* ClearML Callbacks integration

* update corrections

* args reporting updated

* {'tensorboard': False, 'pytorch': False}

* ClearML Tests added

* add clearml

* output_uri=True in Task.init

* reformatted integrations.py

* reformatted and fixed

* IF-ELSE statement issue on "has_clearml" resolved

* Add clearml in main callback docs

* Add additional clearml documentation

* Update src/transformers/integrations.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Accept suggestion

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Accept suggestion

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Small change in comments

* Make style clearml

* Accept suggestion

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

Co-authored-by: Victor Sonck <victor.sonck@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2022-11-15 10:08:59 -05:00
NielsRogge
b4997382da
Fix MaskformerFeatureExtractor (#20100) 
* Fix bug

* Add another fix

* Add print statement

* Apply fix

* Fix feature extractor

* Fix feature extractor

* Add print statements

* Add print statements

* Remove print statements

* Add instance segmentation integration test

* Add integration test for semantic segmentation

* Add draft for panoptic segmentation integration test

* Fix integration test for panoptic segmentation

* Remove slow annotator

Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
 2022-11-15 16:00:37 +01:00
TilmannR
6e3b014471
Fix docstring of CLIPTokenizer(Fast) (#20233) 2022-11-15 10:00:16 -05:00
Yih-Dar
cf7b98b807
Fix run_clip.py (#20234) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-11-15 15:45:21 +01:00
Kendall
683cbc4c34
fixed spelling error in testing.mdx (#20220) 2022-11-15 09:40:06 -05:00
Yih-Dar
6ed6ed29b1
fix device issue (#20227) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-11-15 15:21:16 +01:00
Matt
d3d5fa3e85
Add missing ESM autoclass (#20177) 
* Add missing ESM autoclass

* Correct ESMFold checkpoint
 2022-11-15 14:20:22 +00:00