transformers/docs/source/en/model_doc/cpmant.md
Maria Khalusova 5964f820db
[Docs] Model_doc structure/clarity improvements (#26876)
* first batch of structure improvements for model_docs

* second batch of structure improvements for model_docs

* more structure improvements for model_docs

* more structure improvements for model_docs

* structure improvements for cv model_docs

* more structural refactoring

* addressed feedback about image processors
2023-11-03 10:57:03 -04:00

1.8 KiB

CPMAnt

Overview

CPM-Ant is an open-source Chinese pre-trained language model (PLM) with 10B parameters. It is also the first milestone of the live training process of CPM-Live. The training process is cost-effective and environment-friendly. CPM-Ant also achieves promising results with delta tuning on the CUGE benchmark. Besides the full model, we also provide various compressed versions to meet the requirements of different hardware configurations. See more

This model was contributed by OpenBMB. The original code can be found here.

Resources

CpmAntConfig

autodoc CpmAntConfig - all

CpmAntTokenizer

autodoc CpmAntTokenizer - all

CpmAntModel

autodoc CpmAntModel - all

CpmAntForCausalLM

autodoc CpmAntForCausalLM - all