[–] [dead] fsndz 2y ago ↗ [flagged] [–] [deleted] 2y ago ↗ (comment deleted) [–] 19h 2y ago ↗ You should explicitly mention that this is your blog post, and that this is a "members-only" post? [–] moralestapia 2y ago ↗ This is borderline spam.
[–] 19h 2y ago ↗ You should explicitly mention that this is your blog post, and that this is a "members-only" post?
[–] WhatsName 2y ago ↗ The name ist pixtral_12b_240910, size is 24gb. My best guess would be it's a multi modal LLM. [–] meetpateltech 2y ago ↗ It is vision only (not multimodal)https://github.com/mistralai/mistral-common/releases/tag/v1.... https://github.com/mistralai/mistral-common/pull/45 [–] kristianp 2y ago ↗ From the 1st link:Pixtral is out! Mistral common has image support! You can now pass images and URLs alongside text into the user message. [–] meetpateltech 2y ago ↗ I mean, it supports text+images, not documents or audio [–] moralestapia 2y ago ↗ >text+imagesSo, it's multimodal then.
[–] meetpateltech 2y ago ↗ It is vision only (not multimodal)https://github.com/mistralai/mistral-common/releases/tag/v1.... https://github.com/mistralai/mistral-common/pull/45 [–] kristianp 2y ago ↗ From the 1st link:Pixtral is out! Mistral common has image support! You can now pass images and URLs alongside text into the user message. [–] meetpateltech 2y ago ↗ I mean, it supports text+images, not documents or audio [–] moralestapia 2y ago ↗ >text+imagesSo, it's multimodal then.
[–] kristianp 2y ago ↗ From the 1st link:Pixtral is out! Mistral common has image support! You can now pass images and URLs alongside text into the user message. [–] meetpateltech 2y ago ↗ I mean, it supports text+images, not documents or audio [–] moralestapia 2y ago ↗ >text+imagesSo, it's multimodal then.
[–] meetpateltech 2y ago ↗ I mean, it supports text+images, not documents or audio [–] moralestapia 2y ago ↗ >text+imagesSo, it's multimodal then.
[–] danielhanchen 2y ago ↗ Downloaded params.json - GeLU & 2D RoPE are used for the vision adapter. The vocab size also got larger - 131072 in size.Also Mistral's latest tokenizer PR shows 3 extra new tokens (the image, the start & end).The torrent is 24GB, and I guess the implementation will be up in HF in a few days!Exciting times! [–] generalizations 2y ago ↗ At 24gb, I wonder how small the quantized models will go.
[–] julius-ceasar 2y ago ↗ will this be supported in ollama? [–] [dead] An0nymousHacker 2y ago ↗ [flagged] [–] [dead] WaduHECK 2y ago ↗ [flagged] [–] siggalucci 2y ago ↗ what's the hostility against Ollama? [–] krasin 2y ago ↗ Here is the feature request to support Pixtral on llama.cpp: https://github.com/ggerganov/llama.cpp/issues/9440 - once it's implemented in the upstream, ollama will be able to pick it up.
[–] [dead] An0nymousHacker 2y ago ↗ [flagged] [–] [dead] WaduHECK 2y ago ↗ [flagged] [–] siggalucci 2y ago ↗ what's the hostility against Ollama?
[–] krasin 2y ago ↗ Here is the feature request to support Pixtral on llama.cpp: https://github.com/ggerganov/llama.cpp/issues/9440 - once it's implemented in the upstream, ollama will be able to pick it up.
16 comments
[ 1.5 ms ] story [ 45.0 ms ] threadhttps://github.com/mistralai/mistral-common/releases/tag/v1.... https://github.com/mistralai/mistral-common/pull/45
Pixtral is out! Mistral common has image support! You can now pass images and URLs alongside text into the user message.
So, it's multimodal then.
Also Mistral's latest tokenizer PR shows 3 extra new tokens (the image, the start & end).
The torrent is 24GB, and I guess the implementation will be up in HF in a few days!
Exciting times!