Joao Gante
54cd86708d
[custom_generate] don't forward custom_generate and trust_remote_code ( #38304 )
...
* prevent infinite loops
* docs
* more links to custom generation methods
2025-05-23 14:49:39 +00:00
Joao Gante
8efe3a9d77
[chat] generate parameterization powered by GenerationConfig and UX-related changes ( #38047 )
...
* accept arbitrary kwargs
* move user commands to a separate fn
* work with generation config files
* rm cmmt
* docs
* base generate flag doc section
* nits
* nits
* nits
* no <br>
* better basic args description
2025-05-12 14:04:41 +01:00
co63oc
37508816d6
chore: Fix typos in docs and examples ( #36524 )
...
Fix typos in docs and examples
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
2025-03-04 13:47:41 +00:00
Steven Liu
c0f8d055ce
[docs] Redesign ( #31757 )
...
* toctree
* not-doctested.txt
* collapse sections
* feedback
* update
* rewrite get started sections
* fixes
* fix
* loading models
* fix
* customize models
* share
* fix link
* contribute part 1
* contribute pt 2
* fix toctree
* tokenization pt 1
* Add new model (#32615 )
* v1 - working version
* fix
* fix
* fix
* fix
* rename to correct name
* fix title
* fixup
* rename files
* fix
* add copied from on tests
* rename to `FalconMamba` everywhere and fix bugs
* fix quantization + accelerate
* fix copies
* add `torch.compile` support
* fix tests
* fix tests and add slow tests
* copies on config
* merge the latest changes
* fix tests
* add few lines about instruct
* Apply suggestions from code review
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
* fix
* fix tests
---------
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
* "to be not" -> "not to be" (#32636 )
* "to be not" -> "not to be"
* Update sam.md
* Update trainer.py
* Update modeling_utils.py
* Update test_modeling_utils.py
* Update test_modeling_utils.py
* fix hfoption tag
* tokenization pt. 2
* image processor
* fix toctree
* backbones
* feature extractor
* fix file name
* processor
* update not-doctested
* update
* make style
* fix toctree
* revision
* make fixup
* fix toctree
* fix
* make style
* fix hfoption tag
* pipeline
* pipeline gradio
* pipeline web server
* add pipeline
* fix toctree
* not-doctested
* prompting
* llm optims
* fix toctree
* fixes
* cache
* text generation
* fix
* chat pipeline
* chat stuff
* xla
* torch.compile
* cpu inference
* toctree
* gpu inference
* agents and tools
* gguf/tiktoken
* finetune
* toctree
* trainer
* trainer pt 2
* optims
* optimizers
* accelerate
* parallelism
* fsdp
* update
* distributed cpu
* hardware training
* gpu training
* gpu training 2
* peft
* distrib debug
* deepspeed 1
* deepspeed 2
* chat toctree
* quant pt 1
* quant pt 2
* fix toctree
* fix
* fix
* quant pt 3
* quant pt 4
* serialization
* torchscript
* scripts
* tpu
* review
* model addition timeline
* modular
* more reviews
* reviews
* fix toctree
* reviews reviews
* continue reviews
* more reviews
* modular transformers
* more review
* zamba2
* fix
* all frameworks
* pytorch
* supported model frameworks
* flashattention
* rm check_table
* not-doctested.txt
* rm check_support_list.py
* feedback
* updates/feedback
* review
* feedback
* fix
* update
* feedback
* updates
* update
---------
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Co-authored-by: Quentin Gallouédec <45557362+qgallouedec@users.noreply.github.com>
2025-03-03 10:33:46 -08:00
Fanli Lin
0a1a8e3c7e
[docs] no hard coding cuda as bnb has multi-backend support ( #35867 )
...
* change cuda to DEVICE
* Update docs/source/en/llm_tutorial.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
2025-02-05 08:20:02 -08:00
Joao Gante
62bd83947a
[chat] docs fix ( #35840 )
...
docs fix
2025-01-22 14:32:27 +00:00
Joao Gante
b3d6722469
[Chat] Add Chat from TRL 🐈 ( #35714 )
...
* tmp commit
* add working chat
* add docts
* docs 2
* use auto dtype by default
2025-01-22 13:30:12 +00:00
Joao Gante
430d3d43a5
[Docs] links to logits-processor-zoo ( #35552 )
...
links to logits-processor-zoo
2025-01-08 13:36:30 +00:00
TrickEye
2292be6c1b
Fix: typo ( #33880 )
...
Update llm_tutorial.md: typo
2024-10-02 09:12:21 +01:00
Shubham Ugare
9282413611
Add SynCode to llm_tutorial ( #32884 )
2024-08-22 15:30:22 +02:00
Joao Gante
1bff6a0b58
Generate: update links on LLM tutorial doc ( #30550 )
2024-04-30 18:14:12 +01:00
Joao Gante
58e7f9bb2f
Generate: All logits processors are documented and have examples ( #27796 )
...
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
2023-12-07 15:11:35 +00:00
Joao Gante
ae4fb84629
Generate: update basic llm tutorial ( #26937 )
2023-10-19 16:53:28 +01:00
omahs
0f0e1a2c2b
Fix typos ( #25936 )
...
* fix typo
* fix typo
* fix typo
* fix typos
* fix typos
* fix typo
* fix typo
* fix typo
* fix typos
* fix typo
* fix typo
* fix typo
* fix typos
* fix typos
2023-09-04 11:15:12 +01:00
Joao Gante
d59b872c9e
Docs: introduction to generation with LLMs ( #25240 )
...
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
2023-08-09 11:09:20 +01:00
