mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-06 06:10:04 +06:00
e4ea19b958
* Add OLMo using add-new-model-like with Llama * Fix incorrect tokenizer for OLMo * Copy-paste relevant OLMo methods and their imports * Add OLMo config * Modify OLMo config to follow HF conventions * Remove unneeded Llama code from OLMo model * Add ability for OLMo model to output attentions * Add OLMoPreTrainedModel and OLMoModel * Add OLMoForCausalLM * Minor fixes to OLMo model for style and missing functions * Implement OLMo tokenizer * Implement OLMo to HF conversion script * Add tests for OLMo model * Add tests for OLMo fast tokenizer * Add auto-generated dummy objects * Remove unimplemented OLMo classes from auto and init classes and re-format * Add README and associated auto-generated files * Use OLMo names for common properties * Run make fixup * Remove `|` from OLMo typing * Remove unneeded tokenization_olmo.py * Revert model, config and converter to add-new-model-like Llama * Move logic for adding bos/eos token into GPTNeoxTokenizerFast * Change OLMoConfig defaults to match OLMo-7B * Use GPTNeoXToknizerFast in OLMo tokenizer tests * Modify auto-generated OLMoModelTests to work for OLMo * Add non-parametric layer norm OLMoLayerNorm * Update weight conversion script for OLMo * Fix __init__ and auto structure for OLMo * Fix errors from make fixup * Remove OLMoTokenizerFast from documentation * Add missing 'Copied from' for OLMoModel._update_causal_mask * Run make fix-copies * Rearrange string replacements in OLMoForCausalLM Copied from * Move OLMo and Llama CausalLM.forward example into global constants * Fix OLMO_GENERATION_EXAMPLE doc string typo * Add option for qkv clipping to OLMo * Rearrange OLMoConfig kwargs in convert_olmo_weights_to_hf * Add clip_qkv to OLMoConfig in convert_olmo_weights_to_hf * Fix OLMo tokenization bug using conversion script * Keep model in full precision after conversion * Do not add eos token automatically * Update references to OLMo model in HF Hub * Do not add eos token during encoding by default * Fix Llama generation example * Run make fixup * OLMo 7B integration test fix * Remove unneeded special case for OLMoConfig * OLMo 7B Twin 2T integration test fix * Fix test_model_7b_greedy_generation * Remove test_compile_static_cache * Fix OLMo and Llama generation example * Run make fixup * Revert "OLMo 7B integration test fix" This reverts commit |
||
|---|---|---|
| .. | ||
| asr.md | ||
| audio_classification.md | ||
| document_question_answering.md | ||
| idefics.md | ||
| image_captioning.md | ||
| image_classification.md | ||
| image_feature_extraction.md | ||
| image_to_image.md | ||
| knowledge_distillation_for_image_classification.md | ||
| language_modeling.md | ||
| mask_generation.md | ||
| masked_language_modeling.md | ||
| monocular_depth_estimation.md | ||
| multiple_choice.md | ||
| object_detection.md | ||
| prompting.md | ||
| question_answering.md | ||
| semantic_segmentation.md | ||
| sequence_classification.md | ||
| summarization.md | ||
| text-to-speech.md | ||
| token_classification.md | ||
| translation.md | ||
| video_classification.md | ||
| visual_question_answering.md | ||
| zero_shot_image_classification.md | ||
| zero_shot_object_detection.md | ||