I'm surprised transfer learning via fine-tuning large transformer models hasn't taken off more in the public consciousness a la image recognition models. In my experience, the results can be staggering with very small amounts of training data.
That would be cool, yeah. We haven't had anything like that in spaCy so far, but the results from these models can be very good. I think with a good API it could be very useful.
Spacy also has one of the best documentations that I have come across. I really like the use of Tufte-style notes for code examples. https://spacy.io/api
11 comments
[ 2.7 ms ] story [ 32.2 ms ] threadAlso, transformers are only useful for short text, not full documents (AFAIK).