mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-05 22:00:09 +06:00
64c05eecd6
* higgs init * working with crunches * per-model workspaces * style * style 2 * tests and style * higgs tests passing * protecting torch import * removed torch.Tensor type annotations * torch.nn.Module inheritance fix maybe * hide inputs inside quantizer calls * style structure something * Update src/transformers/quantizers/quantizer_higgs.py Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> * reworked num_sms * Update src/transformers/integrations/higgs.py Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> * revamped device checks * docstring upd * Update src/transformers/quantizers/quantizer_higgs.py Co-authored-by: Mohamed Mekkouri <93391238+MekkCyber@users.noreply.github.com> * edited tests and device map assertions * minor edits * updated flute cuda version in docker * Added p=1 and 2,3bit HIGGS * flute version check update * incorporated `modules_to_not_convert` * less hardcoding * Fixed comment * Added docs * Fixed gemma support * example in docs * fixed torch_dtype for HIGGS * Update docs/source/en/quantization/higgs.md Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> * Collection link * dequantize interface * newer flute version, torch.compile support * unittest message fix * docs update compile * isort * ValueError instead of assert --------- Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> Co-authored-by: Mohamed Mekkouri <93391238+MekkCyber@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| agent.md | ||
| backbones.md | ||
| callback.md | ||
| configuration.md | ||
| data_collator.md | ||
| deepspeed.md | ||
| executorch.md | ||
| feature_extractor.md | ||
| image_processor.md | ||
| keras_callbacks.md | ||
| logging.md | ||
| model.md | ||
| onnx.md | ||
| optimizer_schedules.md | ||
| output.md | ||
| pipelines.md | ||
| processors.md | ||
| quantization.md | ||
| text_generation.md | ||
| tokenizer.md | ||
| trainer.md | ||