transformers/tests
Arthur 474bf508df
Add Segment Anything Model (SAM) (#22654)
* initial commit

* keys match

* update, fix conversion

* fixes, inference working

* fix

* more fixes

* more fixes

* clean up

* more clean up

* fix copies and add convext copied layer norm

* stash

* pretty big upfate

* cleaning

* more cleaning

* fixup stuffs

* fix copies

* fix iinit

* update test removing tokenizer

* nits

* add pretrained

* more nits

* remove tracking of pipeline

* few fixes

* update san and conversion script

* fix mask decoder and prompt encoder conversion

* fixes

* small update

* fix order

* fix

* fix image embeddings

* nites

* few fixes

* fix logits

* clean up

* fixes boxes inference

* v1 AMG

* clean up

* some clean up

* multi points support

* amg working

* fixup

* clean up

* readme

* update toctree

* fix type hint

* multiple fixes

* fixup

* fixes

* updates

* updates

* more tests

* few fixes

* change to `SamForMaskGeneration`

* doc

* fixup

* fix more tests

* multiple fixes

* fix CI tests

* refactor processor

* renamings

* draft the pipeline

* refactor

* fix tests

* fix test

* few cleanings

* fix test

* edit pipelien support chunking

* udate

* add slow tests

* fix nit

* fixup

* fix nit

* current chunk pipleine

* cast boxes in fp32

* nit

* current updates

* piepleine works

* fixup

* clean up config

* fix slow tests

* fix slow tests

* clean up

* update doc and pipeline

* adds more slow tests

* fix slow tests

* cleaning

* tests pass

* add docstring

* fix copies

* clean up

* support batch of images

* style

* dummy is needed, add tests

* fix slow tests

* fix CI

* update

* adds more tests

* fixes

* fixes

* fixup

* fixes

* few fixes

* filter

* few fixes

* some refactor

* touches finales

* fix

* style

* remove pipeline files

* fixes nits

* revert pipeline changes

* fix test

* fixup

* remove automodel for automatic mask generation

* fix failing torch tests

* update mdx

* revert removal of `MODEL_FOR_AUTOMATIC_MASK_GENERATION_MAPPING`

* update sam config based on review

Co-authored-by: amyeroberts <aeroberts4444@gmail.com>
Co-authored-by: sgugger <sylvain.gugger@gmail.com>

* update low_resolution_masks -> pred_masks
inti ln with layer_norm_eps
add_decomposed_rel_pos doc
forward doc of SamForMaskGeneration

* update processor docstring

* remove image processor import empty

* update for testing

* output vision hidden states + clean recomm
also test all iou values

* fixup

* fixup

* remove unused

* Update src/transformers/models/sam/modeling_sam.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/sam/image_processing_sam.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* nits

* fix

* fix CI tests and slow tests

* replace with Amy's processor

* clearer docstring

* add `SamVisionNeck`

* refactor - all CI tests should pass

* fix broken import on Gcolab

* few fixes here and there

* fix another bug

* fix more bugs

* update and merge

* correct ckpt

* address comments

* add tips

* revert

* fix docstring

* replace with `SamModel`

* make fixup

* add support for bathed images and batch ed points

* make fixup this time, really

* make fixup again and again

* few fixes here and there, this should be the touche finale

* Update docs/source/en/model_doc/sam.mdx

* fixup

* correct checkpoints

* correct name

* rm unneeded file

* add notebook

---------

Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: amyeroberts <aeroberts4444@gmail.com>
Co-authored-by: sgugger <sylvain.gugger@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
2023-04-19 21:01:49 +02:00
..
benchmark
deepspeed Fix decorator order (#22708) 2023-04-11 17:59:15 +02:00
extended [tests] switch to torchrun (#22712) 2023-04-12 08:25:45 -07:00
fixtures
generation Generate: Add assisted generation (#22211) 2023-04-18 17:36:56 +01:00
mixed_int8 [bnb] Let's make serialization of int8 models possible (#22177) 2023-04-12 08:01:18 -04:00
models Add Segment Anything Model (SAM) (#22654) 2023-04-19 21:01:49 +02:00
onnx Time to Say Goodbye, torch 1.7 and 1.8 (#22291) 2023-03-21 19:22:01 +01:00
optimization Make schedulers picklable by making lr_lambda fns global (#21768) 2023-03-02 12:08:43 -05:00
pipelines Don't use LayoutLMv2 and LayoutLMv3 in some pipeline tests (#22774) 2023-04-17 17:45:20 +02:00
repo_utils Test fetch v2 (#22367) 2023-03-31 16:18:43 -04:00
sagemaker Apply ruff flake8-comprehensions (#21694) 2023-02-22 09:14:54 +01:00
tokenization
trainer Introduce PartialState as the device handler in the Trainer (#22752) 2023-04-17 15:09:45 -04:00
utils Make dynamic code work with offline mode (#22661) 2023-04-10 08:49:42 -04:00
__init__.py
test_backbone_common.py Backbone add mixin tests (#22542) 2023-04-06 13:50:15 +01:00
test_configuration_common.py Remove set_access_token usage + fail tests if FutureWarning (#22051) 2023-03-09 09:23:48 -05:00
test_feature_extraction_common.py Remove set_access_token usage + fail tests if FutureWarning (#22051) 2023-03-09 09:23:48 -05:00
test_image_processing_common.py Remove set_access_token usage + fail tests if FutureWarning (#22051) 2023-03-09 09:23:48 -05:00
test_image_transforms.py Rescale image back if it was scaled during PIL conversion (#22458) 2023-03-30 11:29:11 +01:00
test_modeling_common.py Fix inverted conditional in TF common test! (#22540) 2023-04-04 21:59:54 +01:00
test_modeling_flax_common.py Remove set_access_token usage + fail tests if FutureWarning (#22051) 2023-03-09 09:23:48 -05:00
test_modeling_tf_common.py Fix inverted conditional in TF common test! (#22540) 2023-04-04 21:59:54 +01:00
test_pipeline_mixin.py DocumentQuestionAnsweringPipeline only for fast tokenizers (#22745) 2023-04-13 17:22:59 +02:00
test_sequence_feature_extraction_common.py Apply ruff flake8-comprehensions (#21694) 2023-02-22 09:14:54 +01:00
test_tokenization_common.py Fix llama tokenizer (#22402) 2023-04-03 09:07:32 -04:00