4 comments

[ 3.8 ms ] story [ 23.7 ms ] thread
Its permissively licensed... but no paper or other metrics yet, so take it with a grain of salt.

Interestingly, 7B was trained on 1.5T tokens (more than LLaMA 7B), while 40B was trained on "only" 1T tokens. Maybe the training is still in progress?

And there are some (unbenchmarked) instruct finetunes:

https://huggingface.co/tiiuae/falcon-7b-instruct

https://huggingface.co/tiiuae/falcon-40b-instruct

(comment deleted)
https://huggingface.co/tiiuae/falcon-40b/blob/main/LICENSE.t...

TL-DR; 10% Royalty on revenue earned if revenue is greater than $1M annually.

From the license:

<begin-extract>

  8.2 Where TII grants permission for You to make Commercial Use of the relevant Work, then for that purpose You shall be considered a Commercial User, and:
    (a) In its written grant of permission, TII shall set the royalty rate that will apply to you as a Commercial User as a percentage of revenue ( “Relevant Percentage”), where, unless otherwise specified in the grant of permission, the Relevant Percentage shall be 10%; and 

    (b) Each year on the anniversary of the date upon which you were granted permission by TII to make Commercial Use of the relevant Work (the “Anniversary Date") You shall account to TII in writing in full for all revenue you have received in the previous 12 months which is attributable (whether directly or indirectly) to Your use of the relevant Work (“Attributable Revenue”); and

    (c) Where, on the Anniversary Date, the Attributable Revenue for the preceding 12 months is greater than $1m or its equivalent in the currency or currencies in which the revenue has been earned (the “Royalty Threshold”) then You shall make a payment of the Relevant Percentage of the relevant Attributable Revenue that exceeds the Royalty Threshold in full in cleared funds to TII into the account specified by TII from time to time in writing for such purpose within 30 days of that Anniversary Date.
<end-extract>