Joao Gante
|
80b774eb29
|
Cache: don't show warning in forward passes when past_key_values is None (#33541)
|
2024-09-19 12:02:46 +01:00 |
|
Joao Gante
|
2b789f27f3
|
Docs: add more cross-references to the KV cache docs (#33323)
* add more cross-references
* nit
* import guard
* more import guards
* nit
* Update src/transformers/generation/configuration_utils.py
|
2024-09-06 10:22:00 +01:00 |
|
Raushan Turganbay
|
ebbe8d8014
|
Cache docs: update (#32929)
* some changes
* more updates
* fix cache copy
* nits
* nits
* add tests
|
2024-09-04 15:05:31 +05:00 |
|
Gerben van V
|
5129671290
|
Add a static cache that offloads to the CPU or other device (#32161)
* Add a static cache that offloads to the CPU or other device
* Fix PR comments, add unit-tests
|
2024-08-29 11:51:09 +02:00 |
|
Raushan Turganbay
|
37c5ca5eb9
|
Cache: create docs (#32150)
* draft
* updates
* works?
* try adding python example in hidden section
* another try
* hwo do i render python
* format as html code?
* Update docs/source/en/kv_cache.md
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
* Update docs/source/en/kv_cache.md
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
* Update docs/source/en/kv_cache.md
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
* Update docs/source/en/kv_cache.md
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
* Update docs/source/en/kv_cache.md
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
* one more small update
* should render hidden secrtion now
* add outputs
* fix links
* check links
* update all links
* update with offloaded cache
* all cache is importable, so they appear in docs
* fix copies
* docstring...
---------
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
|
2024-08-06 10:24:19 +05:00 |
|