MPT-7B-8K: 8K Context Length for Document Understanding (mosaicml.com) 3 points by brianjking 2y ago ↗ HN
[–] brianjking 2y ago ↗ MosaicML has retrained their 7B model with an 8K context length window for their base, chat, and instruction tuned open source models.Base & instruction tuned versions are available for commercial use with Apache 2 license!
1 comment
[ 4.3 ms ] story [ 27.4 ms ] threadBase & instruction tuned versions are available for commercial use with Apache 2 license!