RhuiDih 9cf4f2aa9a Enhancing SFT Training Efficiency Using Packing and FlashAttention2 with Position IDs (#31629) ... * add DataCollatorBatchFlattening * Update data_collator.py * change name * new FA2 flow if position_ids is provided * add comments * minor fix * minor fix data collator * add test cases for models * add test case for data collator * remove extra code * formating for ruff check and check_repo.py * ruff format ruff format tests src utils * custom_init_isort.py		2024-07-23 15:56:41 +02:00
..
agent.md	Reboot Agents (#30387)	2024-05-07 12:59:49 +02:00
backbones.md	doc: fix broken BEiT and DiNAT model links on Backbone page (#32029)	2024-07-17 20:24:10 +01:00
callback.md	Update CometCallback to allow reusing of the running experiment (#31366)	2024-07-05 08:13:46 +02:00
configuration.md	Migrate doc files to Markdown. (#24376)	2023-06-20 18:07:47 -04:00
data_collator.md	Enhancing SFT Training Efficiency Using Packing and FlashAttention2 with Position IDs (#31629)	2024-07-23 15:56:41 +02:00
deepspeed.md	[docs] DeepSpeed (#28542)	2024-01-24 08:31:28 -08:00
feature_extractor.md	Fixed typos (#26810)	2023-10-16 09:52:29 +02:00
image_processor.md	Fast image processor (#28847)	2024-06-11 15:47:38 +01:00
keras_callbacks.md	Migrate doc files to Markdown. (#24376)	2023-06-20 18:07:47 -04:00
logging.md	Warnings controlled by logger level (#26527)	2023-10-12 10:48:38 +02:00
model.md	Speedup model init on CPU (by 10x+ for llama-3-8B as one example) (#31771)	2024-07-16 09:32:01 -04:00
onnx.md	Migrate doc files to Markdown. (#24376)	2023-06-20 18:07:47 -04:00
optimizer_schedules.md	Add WSD scheduler (#30231)	2024-04-25 12:07:21 +01:00
output.md	Update all references to canonical models (#29001)	2024-02-16 08:16:58 +01:00
pipelines.md	Allow FP16 or other precision inference for Pipelines (#31342)	2024-07-05 17:21:50 +01:00
processors.md	[docs] fixed links with 404 (#27327)	2023-11-06 19:45:03 +00:00
quantization.md	Add new quant method (#32047)	2024-07-22 20:21:59 +02:00
text_generation.md	Add Watermarking LogitsProcessor and WatermarkDetector (#29676)	2024-05-14 13:31:39 +05:00
tokenizer.md	[PretrainedTokenizer] add some of the most important functions to the doc (#27313)	2023-11-06 15:11:00 +01:00
trainer.md	[docs] Trainer docs (#28145)	2023-12-20 10:37:23 -08:00