[ifkakao2021] BERT보다 10배 빠른 BERT 모델 구축
kakao tech · 14:43
Kakao's recommendation team built a custom Transformer encoder for classifying shopping products into categories. It trained about 10× faster than BERT or XLM-RoBERTa (one day instead of weeks) and scored higher, reac...