24 comments

[ 0.21 ms ] story [ 10.6 ms ] thread
This still requires 128Gb of memory, right? Me and my lowly 96Gb, like a commoner; missing out on the fun.
How similar are Jeff Dean and Salvatore Sanfilippo?
I've been using MiniMax H3 on my M5 Pro 64GB MacBook Pro through ComfyUI. It works extremely well.

I had to modify the default ComfyUI workflows to use a GGUF quant (city96's ComfyUI-GGUF custom node, UnetLoaderGGUF in place of the stock loader) [0].

I use the model labeled Q5_K_M. There is Q8_0 available as well, which is 34GB and fits fine in 64GB unified memory if you keep resolution modest.

The main issue is speed, a ~9-second 480x864 clip at 20 steps takes me a bit over an hour. So this will be cool to try for the speed up alone.

There's a lot of great information and workflows available to follow on the r/StableDiffusion subreddit.

[0] https://huggingface.co/Abiray/MiniMax-H3-GGUF/tree/main/unet

This is where the DGX spark makes up a bit of the ground it loses on llm work, diffusion and cuda go together like peanut butter and jelly.
I'd love to know what the alternatives are and how this is better
In the AMA Minimax said that H3 could support sparse attention, that would be a huge speedup! I wonder if there are any news on that. H3 is very cool. EDIT: testing a --sparse-attention optional mode based on what they said in the Reddit post.
On my 128GB M4 Max Mac Studio, generating a 15s 480p video with MiniMax H3 in ComfyUI takes an hour and a half.

Put Codex to work on deploying it now, hoping the speed can improve quite a lot :-) Thanks anyway

Alright I’ve been afraid to ask but have been having trouble finding

What are some adult entertainment workflows in comfyui, I need best loras, best prompts to start with

and the communities, are they on telegram or something?

While you will find plenty of people willing to scam you to pay for “adult entertainment workflows”, the built in templates in ComfyUI for the model—perhaps dropping in a Lora Loader node for the a Turbo lora for speed—handle running the model, the subject matter adaptation isn’t really a workflow issue but one of reference/control images/audio/videos and prompting.

For Minimax H3, more than most models, you should read (and, if you are using an LLM for prompt assistance, make it sure it has access to) the official prompt guidelines, as each of the main models (fl2va that handles text-to-video and first- and/or last-frame-to-video and r2va that handles more complex reference cases) has its own structured prompt format (with many common features).

Noob question to all, is there any open source coding model that I can run on Mac mini 16gb?
I use Bonsai 27B ternary on my 24GB MBP. But, I believe you definitely can run it with 18 or even 8GB.
neat — now I just need a machine with the memory bandwidth to render the three-second clip of my cat before the cat itself forgets what happened
Anyone tried it with M4 Pro, 48GB of memory?
I'm looking to setup a way to create images for my own instagram marketing. I do not care how long it takes to make 10 variations of a post as that speed would still be faster than me making it.

Does this model work with ComfyUI easily? Can I just download it?

Yes, there's a default workflow template in Comfy for that matter now.
How long to generate a 10-sec 1920x1080 vid on Mac M4 64GiB?
I mean yeah, a 5090 is obviously gonna smoke a Mac lol. But that’s not really the point. If I can run this thing locally and get a video in a few minutes instead of an hour, that’s already pretty sick.
running this on an m1 max 64gb, it produces some really nice clips with music and audio, stitching the clips together after makes a nice short story generated entirely using a local ai system. It takes quite a while to generate each clip though, But at least it is working. I would like to know a few things:

-Optimal settings/configs examples for h3.c to help speed things up -Optimal recommended generation settings for each mac product, i am sure it is easy to do -Prompt generator assistant

Great work from the github author. The more i use it the more i realise i don't need a gui to generate video, just terminal.

My setup: Macbook #1 as a client Macbook #2 as server

-use macbook #1 terminal + ssh -run mactop in terminal tab to monitor Macbook #2's hardware during ai video generation -run h3.c on Macbook #2 via ssh session -transfer the output video file from macbook #2 to macbook #1 using terminal scp -view the video