2 Commits

Author	SHA1	Message	Date
Theia Vogel	e719b65c31	Fix FbgemmFp8Linear not preserving tensor shape (#33239) ... * add tests for linear shape behavior * fix linear shape behavior ended up adding the reshape at the end, after f8f8bf16_rowwise, because adding it directly after quantize_fp8_per_row caused f8f8bf16_rowwise to drop the seq_len dimension. (i.e., (17, 23, 1014) -> (17, 1024)) * save shape up front + comment	2024-09-11 13:26:44 +02:00
Marc Sun	96a074fa7e	Add new quant method (#32047) ... * Add new quant method * update * fix multi-device * add test * add offload * style * style * add simple example * initial doc * docstring * style again * works ? * better docs * switch to non persistant * remove print * fix init * code review	2024-07-22 20:21:59 +02:00