transformers/docs/source/en
NielsRogge f9a0008d2d
Add VideoMAE (#17821)
* First draft

* Add VideoMAEForVideoClassification

* Improve conversion script

* Add VideoMAEForPreTraining

* Add VideoMAEFeatureExtractor

* Improve VideoMAEFeatureExtractor

* Improve docs

* Add first draft of model tests

* Improve VideoMAEForPreTraining

* Fix base_model_prefix

* Make model take pixel_values of shape (B, T, C, H, W)

* Add loss computation of VideoMAEForPreTraining

* Improve tests

* Improve model testsé

* Make all tests pass

* Add VideoMAE to main README

* Add tests for VideoMAEFeatureExtractor

* Add integration test

* Improve conversion script

* Rename patch embedding class

* Remove VideoMAELayer from init

* Update design of patch embeddings

* Improve comments

* Improve conversion script

* Improve conversion script

* Add conversion of pretrained model

* Add loss verification of pretrained model

* Add loss verification of unnormalized targets

* Add integration test for pretraining model

* Apply suggestions from code review

* Fix bug to make feature extractor resize only shorter edge

* Address more comments

* Improve normalization of videos

* Add doc examples

* Move constants to dedicated script

* Remove scripts

* Transfer checkpoints, fix docs

* Update script

* Update image mean and std

* Fix doc tests

* Set return_tensors to NumPy by default

* Revert the previous change

Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
2022-08-04 18:02:55 +02:00
..
internal Allow from transformers import TypicalLogitsWarper (#17477) 2022-06-03 11:08:35 +02:00
main_classes Update feature extractor docs (#18324) 2022-07-27 15:32:57 -05:00
model_doc Add VideoMAE (#17821) 2022-08-04 18:02:55 +02:00
tasks Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
_config.py Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
_toctree.yml Add VideoMAE (#17821) 2022-08-04 18:02:55 +02:00
accelerate.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
add_new_model.mdx Rewrite push_to_hub to use upload_files (#18366) 2022-08-01 12:07:30 -04:00
add_new_pipeline.mdx Update add_new_pipeline.mdx (#18224) 2022-07-21 07:55:30 +02:00
autoclass_tutorial.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
benchmarks.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
bertology.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
big_models.mdx Add link to existing documentation (#17931) 2022-07-04 04:13:05 -04:00
community.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
contributing.md Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
converting_tensorflow_models.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
create_a_model.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
custom_models.mdx Fix some typos. (#17560) 2022-07-11 05:00:13 -04:00
debugging.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
fast_tokenizers.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
glossary.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
index.mdx Add VideoMAE (#17821) 2022-08-04 18:02:55 +02:00
installation.mdx Added Command for windows VENV activation in installation docs (#18008) 2022-07-07 08:18:44 -04:00
migration.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
model_sharing.mdx Rewrite push_to_hub to use upload_files (#18366) 2022-08-01 12:07:30 -04:00
model_summary.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
multilingual.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
notebooks.md Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
pad_truncation.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
perf_hardware.mdx [WIP] [doc] performance/scalability revamp (#15723) 2022-05-16 13:36:41 +02:00
perf_infer_cpu.mdx Extend Transformers Trainer Class to Enable PyTorch Torchscript for Inference (#17153) 2022-06-14 07:56:47 -04:00
perf_infer_gpu_many.mdx Improve performance docs (#17750) 2022-06-23 14:51:54 +02:00
perf_infer_gpu_one.mdx Improve performance docs (#17750) 2022-06-23 14:51:54 +02:00
perf_infer_special.mdx Improve performance docs (#17750) 2022-06-23 14:51:54 +02:00
perf_train_cpu_many.mdx start from 1.12, torch_ccl is renamed as oneccl_bindings_for_pytorch … (#18229) 2022-07-27 11:15:41 -04:00
perf_train_cpu.mdx Extend Transformers Trainer Class to Enable CPU AMP and Integrate Intel Extension for PyTorch (#17138) 2022-06-08 09:41:57 -04:00
perf_train_gpu_many.mdx Improve performance docs (#17750) 2022-06-23 14:51:54 +02:00
perf_train_gpu_one.mdx Enable torchdynamo with torch_tensorrt(fx path) (#17765) 2022-07-13 12:43:28 -04:00
perf_train_special.mdx Improve performance docs (#17750) 2022-06-23 14:51:54 +02:00
perf_train_tpu.mdx Improve performance docs (#17750) 2022-06-23 14:51:54 +02:00
performance.mdx Improve performance docs (#17750) 2022-06-23 14:51:54 +02:00
perplexity.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
philosophy.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
pipeline_tutorial.mdx docs(transformers): fix typo (#17263) 2022-05-16 17:04:30 -04:00
pr_checks.mdx Add a check on config classes docstring checkpoints (#17012) 2022-04-30 10:40:46 +02:00
preprocessing.mdx Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
quicktour.mdx Add custom config to quicktour (#18115) 2022-07-20 12:23:03 -05:00
run_scripts.mdx Fix all docs for accelerate install directions (#17145) 2022-05-09 15:45:18 -04:00
sagemaker.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
serialization.mdx add ONNX support for LeVit (#18154) 2022-07-18 15:17:07 +02:00
task_summary.mdx [Doctests] Correct task summary (#16644) 2022-04-11 14:59:35 +02:00
testing.mdx Fix some typos. (#17560) 2022-07-11 05:00:13 -04:00
tokenizer_summary.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
training.mdx Doc to dataset (#18037) 2022-07-06 12:10:06 -04:00
troubleshooting.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00