transformers/model_cards/lysandre/arxiv
Lysandre Debut 33d3072e1c
Arxiv README (#2747)
* Arxiv README

* ArXiv-NLP readme
2020-02-05 15:26:28 -05:00
..
README.md Arxiv README (#2747) 2020-02-05 15:26:28 -05:00

ArXiv GPT-2 checkpoint

This is a GPT-2 small checkpoint for PyTorch. It is the official gpt2-small finetuned to ArXiv paper on physics fields.

Training data

This model was trained on a subset of ArXiv papers that were parsed from PDF to txt. The resulting data is made of 130MB of text, mostly from quantum physics (quant-ph) and other physics sub-fields.