2 Commits

Author	SHA1	Message	Date
Marc Sun	004530aa05	Fix regression loading dtype (#34409) ... * fix regression * add test for torchao * expected output * better fix	2024-10-29 11:41:04 +01:00
Jerry Zhang	78d78cdf8a	Add TorchAOHfQuantizer (#32306) ... * Add TorchAOHfQuantizer Summary: Enable loading torchao quantized model in huggingface. Test Plan: local test Reviewers: Subscribers: Tasks: Tags: * Fix a few issues * style * Added tests and addressed some comments about dtype conversion * fix torch_dtype warning message * fix tests * style * TorchAOConfig -> TorchAoConfig * enable offload + fix memory with multi-gpu * update torchao version requirement to 0.4.0 * better comments * add torch.compile to torchao README, add perf number link --------- Co-authored-by: Marc Sun <marc@huggingface.co>	2024-08-14 16:14:24 +02:00