transformers/tests/tokenization
Yih-Dar 1fcaad6df9
Use lru_cache for tokenization tests (#36818)
* fix

* fix

* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2025-03-28 15:09:35 +01:00
..
__init__.py [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
test_tokenization_fast.py Use lru_cache for tokenization tests (#36818) 2025-03-28 15:09:35 +01:00
test_tokenization_utils.py tokenizer train from iterator without pre_tokenizers (#35396) 2025-01-09 15:34:43 +01:00