HN Explorer

Show HN: Rubbrband – Evaluating generated images at scale

11 points by jrmylee ↗ HN
Hey HN! We’re the founders of Rubbrband (https://www.rubbrband.com/), a evaluation platform for image generation models like Stable Diffusion. We provide a monitoring application to detect deformed human features in AI generated images at scale. For example, we automatically flag images of people with deformed eyes or hands.

We’ve worked with several companies leveraging generative image models in production, and found that one of the main problems is that it’s hard to filter images for good quality sample at scale. Typically, teams will have to manually look through the images for these samples, which is slow and expensive.

We wanted to build a monitoring solution that lets you to see all of the images you’ve generated, and to automatically be alerted when an image was generated with a deformity.

We’ve started by building evaluators that detects deformities in human features, like face and hands. We’re focused on expanding rapidly into build evaluators for other types of images, like gaming and design assets.

We charge using a storage-based pricing model. Rubbrband costs 5¢ per image to use, with your first 1000 images uploaded free.

We’d love to hear your thoughts and critiques, if you have any feature requests please let us know!

12 comments

[ 2.6 ms ] story [ 40.7 ms ] thread
michaelmior
Is the first image under "realistic hands" intended to have six fingers on one hand?
jrmylee
Yes it is. That caption is indeed confusing - pushed a fix!
michaelmior
That makes more sense now :) Although now all the images in that first row appear distorted to me.
[deleted]
(comment deleted)
johnnyworker
That astronaut with a coffee cup in space still looks very silly to me, apart from the eyes, just because the cup handle is facing the wrong way while the hand is positioned as if holding it by the handle.
jrmylee
Hm that's true.

We're working on ways to evaluate if an image looks "off" - but its a hard problem because a lot of it is subjective

johnnyworker
Yeah, I didn't mean that as a criticism, it's probably impossible to account for everything, and what is off in one context might be fine in another. Filtering out images that contain messed up objects and body parts still hugely reduces the amount of images a human has to look at, so that's valuable either way.

I have no clue about SD other than toying with it, so forgive if this is naive, but do you have any plans to maybe feed this back into the generation, e.g. jiggle the the seed or other parameters around a little until no fingers are malformed?

jrmylee
Yeah I think it's a great idea! Right now because the models are so finnicky changing the seed often does lead to an image with desirable qualities(ie: good hands) so this makes sense.

I do think over time the feedback loops will look much different, as the models get more solid.

tym0
He's also got six fingers on his right hand and his index finger on the left hand is way too long.
tikkun
Nice! What kinds of companies are generating enough AI images that they need automated image assessment? Is it only AI companies doing image galleries, or are there some more enterprise style companies
jrmylee
A healthy mix of both at this point, I would say this problem is more of a problem of enterprise since it occurs at scale.
tikkun
Nice! I’m guessing CPG type companies using it for product photos and such in particular