We have trained generative GPT-3-like models for Finnish. We are currently in the process of evaluating and documenting the models and finalizing their release.

Prior to the full release, we are offering access to some of the models via the Hugging Face model repository:

• Finnish GPT-3 small
• Finnish GPT-3 medium
• Finnish GPT-3 large
• Finnish GPT-3 xl
• Finnish GPT-3 3B
• Finnish GPT-3 8B
• Finnish GPT-3 13B
• BLOOM + Finnish 176B coming soon!

You can also find a simple example of generating text with these models here.

Acknowledgments: The models were created in collaboration with the National Library of Finland (https://www.kansalliskirjasto.fi). We wish to acknowledge CSC – IT Center for Science, Finland, for generous computational resources. This project has received funding from the European Union’s Horizon Europe research and innovation programme under grant agreement No 101070350.