Posted on April 30, 2020 | Back to Showreel

Investigating Transferability in Pretrained Language Models

Tags: technical, text (NLP) | Paper

This is mostly a useful and interesting technical result around what is the best way to do transfer-learning when working with NLP models. The point is, in different data size regimes, you should do different things, to achieve the best results.