riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-05 22:00:09 +06:00
Code Issues Actions 21 Packages Projects Releases Wiki Activity
fb2b45e562
transformers/docs/source/en
History
Pi Esposito fb2b45e562
add in layer gpt2 tokenizer (#20421) 
* add minimal working gpt2 tokenizer

* graph mode and output equivalence tests working

* not today tensorflow. serialization test passing!

* fix style, documentation, docstrings and all that jazz

* passing consistency checks

* move keras nlp to tf dependencies

* fix tf modeling utils and gpt2 attention to enable compiling

* fix (I hope) keras nlp dependencies

* rever changes on generation

* remove debug prints

* remove redundant tf dummy objects

* add from config, get config and max length settings to address review

* let flake ignore the error on distillation you are welcome

* test from config

* add padding test

* address sgugger review
2022-11-29 10:02:40 -05:00
..
internal Add padding image transformation (#19838) 2022-11-18 11:27:21 +00:00
main_classes Generate: add generation config class (#20218) 2022-11-21 13:30:15 +00:00
model_doc add in layer gpt2 tokenizer (#20421) 2022-11-29 10:02:40 -05:00
tasks Add inference section to task guides (#18781) 2022-11-21 10:06:21 -08:00
_config.py Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
_toctree.yml Add Audio Spectogram Transformer (#19981) 2022-11-21 18:58:54 +01:00
accelerate.mdx ✨ update to use interlibrary links instead of Markdown (#18500) 2022-08-08 10:53:52 -05:00
add_new_model.mdx add small updates only (#19847) 2022-10-24 10:18:20 -07:00
add_new_pipeline.mdx Update add_new_pipeline.mdx (#18224) 2022-07-21 07:55:30 +02:00
add_tensorflow_model.mdx docs: Resolve many typos in the English docs (#20088) 2022-11-07 09:19:04 -05:00
autoclass_tutorial.mdx Mention TF and Flax checkpoints (#18894) 2022-09-05 11:09:39 +02:00
benchmarks.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
bertology.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
big_models.mdx docs: Resolve many typos in the English docs (#20088) 2022-11-07 09:19:04 -05:00
community.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
contributing.md Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
converting_tensorflow_models.mdx Docs - Guide to add a new TensorFlow model (#19256) 2022-09-30 20:30:38 +01:00
create_a_model.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
custom_models.mdx Replace awkward timm link with the expected one (#20109) 2022-11-07 13:57:39 -05:00
debugging.mdx [doc] debug: fix import (#19042) 2022-09-14 16:29:58 -07:00
fast_tokenizers.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
glossary.mdx add cv + audio labels (#20114) 2022-11-09 07:40:15 -08:00
hpo_train.mdx update doc for perf_train_cpu_many (#19506) 2022-10-11 22:54:19 -04:00
index.mdx [Maskformer] Add MaskFormerSwin backbone (#20344) 2022-11-28 20:33:49 +01:00
installation.mdx Move cache folder to huggingface/hub for consistency with hf_hub (#18492) 2022-08-05 13:14:00 -04:00
migration.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
model_sharing.mdx Just re-reading the whole doc every couple of months 😬 (#18489) 2022-08-06 09:38:55 +02:00
model_summary.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
multilingual.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
notebooks.md Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
pad_truncation.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
perf_hardware.mdx [WIP] [doc] performance/scalability revamp (#15723) 2022-05-16 13:36:41 +02:00
perf_infer_cpu.mdx fix jit trace error for model forward sequence is not aligned with jit.trace tuple input sequence, update related doc (#19891) 2022-11-03 10:50:03 -04:00
perf_infer_gpu_many.mdx Update perf_infer_gpu_many.mdx (#18744) 2022-08-24 10:37:52 +02:00
perf_infer_gpu_one.mdx [bnb] Move documentation (#18671) 2022-08-18 17:34:48 +02:00
perf_infer_special.mdx Improve performance docs (#17750) 2022-06-23 14:51:54 +02:00
perf_train_cpu_many.mdx update cpu related doc (#20444) 2022-11-28 08:54:35 -05:00
perf_train_cpu.mdx update cpu related doc (#20444) 2022-11-28 08:54:35 -05:00
perf_train_gpu_many.mdx Improve performance docs (#17750) 2022-06-23 14:51:54 +02:00
perf_train_gpu_one.mdx docs: Resolve many typos in the English docs (#20088) 2022-11-07 09:19:04 -05:00
perf_train_special.mdx Improve performance docs (#17750) 2022-06-23 14:51:54 +02:00
perf_train_tpu.mdx Improve performance docs (#17750) 2022-06-23 14:51:54 +02:00
performance.mdx Improve performance docs (#17750) 2022-06-23 14:51:54 +02:00
perplexity.mdx Fix incorrect size of input for 1st strided window length in Perplexity of fixed-length models (#18906) 2022-09-06 15:20:12 -04:00
philosophy.mdx Update philosophy to include other preprocessing classes (#18550) 2022-08-10 13:20:39 -05:00
pipeline_tutorial.mdx Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
pr_checks.mdx 📝 update documentation build section (#18548) 2022-08-09 18:22:55 -05:00
preprocessing.mdx AutoImageProcessor (#20111) 2022-11-08 19:54:41 +00:00
quicktour.mdx Fix doctest (#20023) 2022-11-02 19:37:25 +01:00
run_scripts.mdx Just re-reading the whole doc every couple of months 😬 (#18489) 2022-08-06 09:38:55 +02:00
sagemaker.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
serialization.mdx add MobileNetV1 model (#17799) 2022-11-21 10:21:28 -05:00
task_summary.mdx Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
testing.mdx fixed spelling error in testing.mdx (#20220) 2022-11-15 09:40:06 -05:00
tokenizer_summary.mdx Update tokenizer_summary.mdx (#20135) 2022-11-15 01:18:13 +01:00
torchscript.mdx Breakup export guide (#19271) 2022-10-03 13:18:29 -07:00
training.mdx Update training.mdx (#19791) 2022-10-21 09:46:44 -04:00
troubleshooting.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00