TRAINING A MULTI-DOMAIN LANGUAGE MODEL FOR CONTENT MODERATION

原文（中文）

A method including receiving a multi-domain language model having a number of base layers, a number of domain general adapter layers, and a set of domain specific adapter layers. The method also includes training the base layers on an unlabeled training dataset. The method also includes training the domain general adapter layers on a domain general labeled dataset generated from the unlabeled training dataset. Training the domain general adapter layers excludes updating the set of domain specific adapter layers. The method also includes training the set of domain specific adapter layers on a domain specific labeled dataset generated from the unlabeled training dataset. Training the set of domain specific adapter layers excludes updating the domain general adapter layers. The method also includes returning, as a trained multi-domain language model, the updated base layers, the updated domain general adapter layers, and the updated set of domain specific adapter layers.