21 comments

[ 0.19 ms ] story [ 17.1 ms ] thread
[flagged]
Do you have a sense of what degrades first in the smaller quants?
I see references to comfyui in the readme. Is that the easiest way to run it? I've always found it a bit cumbersome to use and wish I had something like a simple CLI tool to use it like llama.cpp. Perhaps that's not possible with a video diffusion model?
I use stable diffusion cpp with a LLM driving it using CLI. It’s been the quickest way for me to run new diffusion models and require near zero skills but the results come out great.
care to go more into your loop that you've setup
Not much too it! Use Hermes, *Claw, Claude cowork, etc and go like "setup this model <huggingface link> using stablediffusion cpp on this computer." Then when its done, in the same session "Use this as the main image (or video) generator moving forward" and it'll change the config
ComfyUI has an API. I've directed Hermes to pilot that API by authoring workflow JSON from scratch. I eventually migrated to launching those workflows from Concourse containers to queue a bunch of genops work against my limited hardware.

I've only recently experimented with directly executing GPU workloads on the pipeline workers themselves—this requires mounting models whereas routing through ComfyUI I kept the models on the host.

Torn.

[flagged]
This is very cool, I wish they would make quality+time comparisons between the various quantisations though
Seconded, I'd like to see a head to head comparison to see how the quant loks vs the original
Yeah this is only meaningful if you can compare quality at least.

Otherwise, it's just like saying: we compressed a JPEG file to 50% of its size using some compression level and we didn't check what it looks like.

[flagged]
if they did the whole thing would seem a lot less impressive. "It's smaller, but it also doesn't work nearly as well"
[flagged]
Am curious how this compares perf/quality wise with FastVideo's FastH3 trim/omni which I have been using pretty well with a basic laptop 8GB NVidia card (e.g. 5s 480p video in 90s).
[flagged]
I took all the doors off my car, so now its lighter.

Can the README say something about quality?