This is a LoRA adapter for GPT-SW3 40b with continued pre-training on Faroese data (BLARK corpus and a private Faroese books repository). Training was performed for 4 epochs.
Release: 19.04.2024
Contact: barbaras@setur.fo
A language model using LoRA to adapt GPT-SW3 40b by training it on Faroese texts.
This is a LoRA adapter for GPT-SW3 40b with continued pre-training on Faroese data (BLARK corpus and a private Faroese books repository). Training was performed for 4 epochs.
Release: 19.04.2024
Contact: barbaras@setur.fo
Faroese GTP-SW3 using LoRA
