Ao Tang 6a03942db7 Add Nemotron HF Support (#31699) ... * Add nemotron support * fix inference * add unit test * add layernorm1p as a class to avoid meta device mismatch * test fixed * Add copied_from statements * remove pretraining_tp args * remove nemotronlayernorm * force LN computation done in FP32 * remove nemotrontokenizer and use llamatokenizer * license update * add option for kv_channels for minitron8b * remove assert * o_proj fixed * o_proj reshape * add gated_proj option * typo * remove todos * fix broken test after merging latest main * remove nezha/nat after meging main * chnage default config to 15b model * add nemo conversion script * rename conversion script * remove gate_proj option * pr comment resolved * fix unit test * rename kv_channels to head_dim * resolve PR issue * add nemotron md * fix broken tests * refactor rope for nemotron * test fix * remove linearscaling * whitespace and import * fix some copied-from * code style fix * reformatted * add position_embedding to nemotronattention * rope refactor to only use config, copied-from fix * format * Run make fix-copies * nemotron md with autodoc * doc fix * fix order * pass check_config_docstrings.py * fix config_attributes * remove all llama BC related code * Use PreTrainedTokenizerFast * ruff check examples * conversion script update * add nemotron to toctree		2024-08-06 15:42:05 +02:00
..
agents	Updated ruff to the latest version (#31926)	2024-07-23 17:07:31 +02:00
benchmark	[Test refactor 1/5] Per-folder tests reorganization (#15725)	2022-02-23 15:46:28 -05:00
bettertransformer	Fixed malapropism error (#26660)	2023-10-09 11:04:57 +02:00
deepspeed	Yell at the user if zero-3 init wasn't performed, but expected to have been done (#32299)	2024-08-01 15:18:43 -04:00
extended	Skip tests properly (#31308)	2024-06-26 21:59:08 +01:00
fixtures	Implementation of SuperPoint and AutoModelForKeypointDetection (#28966)	2024-03-19 14:43:02 +00:00
fsdp	Llama et al. / FSDP : Fix breaking change in 4.40 for FSDP (#31161)	2024-06-26 14:50:08 +01:00
generation	Generate: end-to-end compilation (#30788)	2024-07-29 10:52:13 +01:00
models	Add Nemotron HF Support (#31699)	2024-08-06 15:42:05 +02:00
optimization	fix: Fixed the 1st argument name in classmethods (#31907)	2024-07-11 12:11:50 +01:00
peft_integration	FIX [CI]: Fix failing tests for peft integration (#29330)	2024-02-29 03:56:16 +01:00
pipelines	[pipeline] fix padding for 1-d tensors (#31776)	2024-07-29 21:24:42 +08:00
quantization	Support dequantizing GGUF FP16 format (#31783)	2024-07-24 17:59:59 +02:00
repo_utils	Allow # Ignore copy (#27328)	2023-12-07 10:00:08 +01:00
sagemaker	Fixed log messages that are resulting in TypeError due to too many arguments (#32017)	2024-07-17 10:56:44 +01:00
tokenization	#32184 save total_vocab_size (#32240)	2024-08-05 09:22:48 +02:00
trainer	Enhancing SFT Training Efficiency Using Packing and FlashAttention2 with Position IDs (#31629)	2024-07-23 15:56:41 +02:00
utils	Respect the config's attn_implementation if set (#32383)	2024-08-05 16:33:19 +01:00
__init__.py	GPU text generation: mMoved the encoded_prompt to correct device	2020-01-06 15:11:12 +01:00
test_backbone_common.py	Align backbone stage selection with out_indices & out_features (#27606)	2023-12-20 18:33:17 +00:00
test_configuration_common.py	Refactor: Removed un-necessary object base class (#32230)	2024-07-26 10:33:02 +02:00
test_feature_extraction_common.py	Split common test from core tests (#24284)	2023-06-15 07:30:24 -04:00
test_image_processing_common.py	Update kwargs validation for preprocess with decorator (#32024)	2024-08-06 11:33:05 +01:00
test_image_transforms.py	fix: center_crop occasionally outputs off-by-one dimension matrix (#30934)	2024-05-21 13:56:52 +01:00
test_modeling_common.py	>3-5x faster torch.compile forward compilation for autoregressive decoder models (#32227)	2024-08-01 02:03:07 +08:00
test_modeling_flax_common.py	add sdpa to ViT [follow up of #29325] (#30555)	2024-05-16 10:56:11 +01:00
test_modeling_tf_common.py	Port IDEFICS to tensorflow (#26870)	2024-05-13 15:59:46 +01:00
test_pipeline_mixin.py	fix: Fixed raising TypeError instead of ValueError for invalid type (#32111)	2024-07-22 17:46:17 +01:00
test_processing_common.py	add initial design for uniform processors + align model (#31197)	2024-06-13 16:27:16 +02:00
test_sequence_feature_extraction_common.py	Fix typo (#25966)	2023-09-05 10:12:25 +02:00
test_tokenization_common.py	Fix conflicting key in init kwargs in PreTrainedTokenizerBase (#31233)	2024-08-01 14:32:13 +02:00