phree_radical
No user record in our sample, but phree_radical has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
No user record in our sample, but phree_radical has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
Very incorrect! The "8x7b" in the name regularly confuses people into some similar conclusion, but there are not eight 7b "experts" in Mixtral 8x. It's more apt to think of all 256 FFN's as the "experts," as each expert…