riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-08-02 11:11:05 +06:00
Code Issues Actions 3 Packages Projects Releases Wiki Activity

[Reformer] Move model card to google model (#4113)

Browse Source 
* correct model card

* remove model card from patrick von platen
This commit is contained in:
Patrick von Platen 2020-05-02 10:25:22 +02:00 committed by GitHub
parent d713cfc5eb
commit 2d8340a91f
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
model_cards/patrickvonplaten/reformer-crime-and-punish/README.md → model_cards/google/reformer-crime-and-punishment/README.md
View File

@ -3,9 +3,8 @@ Crime and Punishment text was taken from `gs://trax-ml/reformer/crime-and-punish
Model was trained in flax using colab notebook proposed by authors: https://colab.research.google.com/github/google/trax/blob/master/trax/models/reformer/text_generation.ipynb
Weights were converted to Hugging Face PyTorch `ReformerModelWithLMHead`.
Model is used as a proof of concept that the forward pass works for a `ReformerModelWithLMHead`.
Given that the model was trained only for 30mins on a ~0.5M tokens dataset and has only 320 tokens,
the generation results are reasonable:
The model is a character level language model. Language from in `crime-and-punishment` style
can be generated as follows:
```python
model = ReformerModelWithLMHead.from_pretrained("patrickvonplaten/reformer-crime-and-punish")