I believe Zero123++ gives you the ability to generate consistent images from multiple camera views, where as DreamCraft3D seems to output 3D models with geometry and textures if I'm understanding it right. Like I could take the output of DreamCraft3D (if I had the code) and drop the result into Blender for example.
It is not unusual for code release to follow paper release with a lag of days to weeks. The top priority for a researcher is to get the paper out. Code is supporting material of secondary importance.
I used to give descriptive names to directories that would each carry a main document, and associated materials like references, diagrams, etc. Since the directory already had a descriptive name, I used to name the main document like "-- paper.docx" so that it stays on top when sorting the files by name.
However, realizing the problem you have mentioned, I started giving descriptive names to the main document also, in most cases by re-using the name given to the directory, still adding the leading "--".
Unlike other areas of AI that are immediately applicable to use in products (LLMs, Stable Diffusion, RVC, etc.), 3D sculpting has years of further optimization before it finds its fit.
These sculpts are not "game ready". Their object geometry is massively bloated and inefficient.
They're not rigged with a skeleton or morph targets. That's a hard problem that some products (like rigify) can sort of solve, but not for assets in this poor shape.
The massive VC funds being poured into this "game ready asset AI" should sit on the sideline for 3-4 years and invest in a new player with a fresh cap table and no baggage.
I'm looking to jump into this area, but the timing is off.
I mean, alternatively, the timing is now. It's a great time to get a head start on it, because once it hits market-readiness, there are going to be massive opportunities.
Yup, I had the same thought. Click through the gallery to the last page, and you can start to see artifacts in the examples. The chicken & waffles one particularly. Although I must say, I am still extremely impressed by this tech.
There would still be a long way to go, I believe. Creating a consistent art style, with assets that fit into each other well for a whole game world would still be very challenging, for example.
We are definitely getting warmer. Exciting times. I would love a metahuman like diffusor for my characters. This would also be great for quickly generating props from photos or midjourney conjures. I still feel like all of these techniques and tools still require an artist, but the artists job is now more macro than at the micro. Awesome!
You know how many of these bullshit things we’ve had in the past year? Lots.
All of them promise something, have a long (maybe even AI generated) research paper.
And,, most of all, NO CODE.
Wtf. Push your code.
Or slse it doesn’t exist.
I have a ton of these bookmarked. Still waiting for code.
33 comments
[ 1.8 ms ] story [ 70.1 ms ] threadThe papers published on GitHub are typically presented in a much more accessible and beautiful way than arXiv.
The downstream social traction is further signal and affirmation for your results, lab, and/or company.
EDIT: Just realized this one only outputs multiple images which are 3D consistent, not a 3d model.
> Paper_high_res.pdf
It was on exactly the second download where I realized how restrictive my choice of namespace was
However, realizing the problem you have mentioned, I started giving descriptive names to the main document also, in most cases by re-using the name given to the directory, still adding the leading "--".
> Code will come soon.
They're not rigged with a skeleton or morph targets. That's a hard problem that some products (like rigify) can sort of solve, but not for assets in this poor shape.
The massive VC funds being poured into this "game ready asset AI" should sit on the sideline for 3-4 years and invest in a new player with a fresh cap table and no baggage.
I'm looking to jump into this area, but the timing is off.
This came out recently which looks like a leap forward in optimization: https://github.com/nv-tlabs/FlexiCubes
All that remains is a network for rigging (and maybe retopology)
Indie gamedev would be revolutionized
> Code will come soon.
Disappointing, but also:
> 6 forks
That's... eager.
https://www.youtube.com/watch?v=10JSPdTDFsI
And,, most of all, NO CODE.
Wtf. Push your code. Or slse it doesn’t exist. I have a ton of these bookmarked. Still waiting for code.
I call bullshit.
https://github.com/MrTornado24
All the rest have code. I'd expect to see it coming here in a few days
i would love to test this for my current game project .