[–] [dead] fsndz 1y ago ↗ [flagged] [–] [deleted] 1y ago ↗ (comment deleted) [–] 19h 1y ago ↗ You should explicitly mention that this is your blog post, and that this is a "members-only" post? [–] moralestapia 1y ago ↗ This is borderline spam.
[–] 19h 1y ago ↗ You should explicitly mention that this is your blog post, and that this is a "members-only" post?
[–] WhatsName 1y ago ↗ The name ist pixtral_12b_240910, size is 24gb. My best guess would be it's a multi modal LLM. [–] meetpateltech 1y ago ↗ It is vision only (not multimodal)https://github.com/mistralai/mistral-common/releases/tag/v1.... https://github.com/mistralai/mistral-common/pull/45 [–] kristianp 1y ago ↗ From the 1st link:Pixtral is out! Mistral common has image support! You can now pass images and URLs alongside text into the user message. [–] meetpateltech 1y ago ↗ I mean, it supports text+images, not documents or audio [–] moralestapia 1y ago ↗ >text+imagesSo, it's multimodal then.
[–] meetpateltech 1y ago ↗ It is vision only (not multimodal)https://github.com/mistralai/mistral-common/releases/tag/v1.... https://github.com/mistralai/mistral-common/pull/45 [–] kristianp 1y ago ↗ From the 1st link:Pixtral is out! Mistral common has image support! You can now pass images and URLs alongside text into the user message. [–] meetpateltech 1y ago ↗ I mean, it supports text+images, not documents or audio [–] moralestapia 1y ago ↗ >text+imagesSo, it's multimodal then.
[–] kristianp 1y ago ↗ From the 1st link:Pixtral is out! Mistral common has image support! You can now pass images and URLs alongside text into the user message. [–] meetpateltech 1y ago ↗ I mean, it supports text+images, not documents or audio [–] moralestapia 1y ago ↗ >text+imagesSo, it's multimodal then.
[–] meetpateltech 1y ago ↗ I mean, it supports text+images, not documents or audio [–] moralestapia 1y ago ↗ >text+imagesSo, it's multimodal then.
[–] danielhanchen 1y ago ↗ Downloaded params.json - GeLU & 2D RoPE are used for the vision adapter. The vocab size also got larger - 131072 in size.Also Mistral's latest tokenizer PR shows 3 extra new tokens (the image, the start & end).The torrent is 24GB, and I guess the implementation will be up in HF in a few days!Exciting times! [–] generalizations 1y ago ↗ At 24gb, I wonder how small the quantized models will go.
[–] julius-ceasar 1y ago ↗ will this be supported in ollama? [–] [dead] An0nymousHacker 1y ago ↗ [flagged] [–] [dead] WaduHECK 1y ago ↗ [flagged] [–] siggalucci 1y ago ↗ what's the hostility against Ollama? [–] krasin 1y ago ↗ Here is the feature request to support Pixtral on llama.cpp: https://github.com/ggerganov/llama.cpp/issues/9440 - once it's implemented in the upstream, ollama will be able to pick it up.
[–] [dead] An0nymousHacker 1y ago ↗ [flagged] [–] [dead] WaduHECK 1y ago ↗ [flagged] [–] siggalucci 1y ago ↗ what's the hostility against Ollama?
[–] krasin 1y ago ↗ Here is the feature request to support Pixtral on llama.cpp: https://github.com/ggerganov/llama.cpp/issues/9440 - once it's implemented in the upstream, ollama will be able to pick it up.
16 comments
[ 3.5 ms ] story [ 44.0 ms ] threadhttps://github.com/mistralai/mistral-common/releases/tag/v1.... https://github.com/mistralai/mistral-common/pull/45
Pixtral is out! Mistral common has image support! You can now pass images and URLs alongside text into the user message.
So, it's multimodal then.
Also Mistral's latest tokenizer PR shows 3 extra new tokens (the image, the start & end).
The torrent is 24GB, and I guess the implementation will be up in HF in a few days!
Exciting times!