riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 23 Packages Projects Releases Wiki Activity

Add programming languages (#18434)

Browse Source 
The current wording makes it sound as if the programming languages are part of the 46 natural languages.
This commit is contained in:
Christopher Akiki 2022-08-02 22:02:25 +02:00 committed by GitHub
parent 042f420364
commit 5096a654b7
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/en/model_doc/bloom.mdx
View File

@ -15,7 +15,7 @@ specific language governing permissions and limitations under the License.
## Overview
The BLOOM model has been proposed with its various versions through the [BigScience Workshop](https://bigscience.huggingface.co/). BigScience is inspired by other open science initiatives where researchers have pooled their time and resources to collectively achieve a higher impact.
The architecture of BLOOM is essentially similar to GPT3 (auto-regressive model for next token prediction), but has been trained on different 46 languages including code.
The architecture of BLOOM is essentially similar to GPT3 (auto-regressive model for next token prediction), but has been trained on 46 different languages and 13 programming languages.
Several smaller versions of the models have been trained on the same dataset. BLOOM is available in the following versions:
- [bloom-350m](https://huggingface.co/bigscience/bloom-350m)
@ -54,4 +54,4 @@ Several smaller versions of the models have been trained on the same dataset. BL
## BloomForTokenClassification
[[autodoc]] BloomForTokenClassification
- forward
- forward