NVIDIA’s Crazy New AI Paints With Images!
87,945
Published 2024-07-19
📝 The paper "Diffusion Texture Painting" is available here:
research.nvidia.com/labs/toronto-ai/DiffusionTextu…
📝 My paper on simulations that look almost like reality is available for free here:
rdcu.be/cWPfD
Or this is the orig. Nature Physics link with clickable citations:
www.nature.com/articles/s41567-022-01788-5
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Alex Balfanz, Alex Haro, B Shang, Benji Rabhan, Gaston Ingaramo, Gordon Child, John Le, Kyle Davis, Loyal Alchemist, Lukas Biewald, Martin, Michael Albrecht, Michael Tedder, Owen Skarpness, Richard Sundvall, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: www.patreon.com/TwoMinutePapers
My research: cg.tuwien.ac.at/~zsolnai/
X/Twitter: twitter.com/twominutepapers
Thumbnail design: Felícia Zsolnai-Fehér - felicia.hu/
#nvidia
All Comments (21)
-
What a time to be alive
-
What an AI time to be painted alive! 🎉
-
As an artist, this is pretty huge, especially if you can use your own textures. Like you said, the textures this method generates will need modification (for now), but you can just draw an image and plaster it onto a model. I see this being implemented in Blender or a dedicated texture editor, and I see myself using it for actual work.
-
We are seeing progress today that many just a few years ago would believe to be decades away
-
This is the kind of AI image generation that blurs the line between human-created and computer-created.
-
This is absolutely breathtaking. Oh My Graphics
-
Waiting for Adobe to patent something based on this and then sue anyone using something similar with their army of lawyers to maintain market dominance.
-
😊 This a wonderful use of this technology … Skinning has always been a difficult part of Modeling in 3 Dimensions. Now a director waves a brush, and AI set decorators sketch the first draft. Brilliant 👏
-
Now this is nice. It's like AI texture brush sampling rather than purely generative dribble. I can see this being really nice when painting environments with a megatexture approach if it can ever paint with PBR maps.
-
R.I.P adobe substance painter
-
Awesome they open source this. I want use this in Blender. 😁
-
Evolution of the stamp brushes, awesome!
-
A lot of cleanup is still required. I hope they develop this further so that the edges of the brush are natural and so that the whole piece blends together at the end!
-
Now this is a good application of AI in art, we can use it directly as a tool for texturing digital worlds easier and not always resort to using sctrict asset libraries for textures... this is an excellent tool for game developers and 3D artists alike.
-
What is name of the 3D texturing software? Is it available for tests?
-
I'm not an artist, but this seems a little too uncanny - like it's right at the line where using it won't lose you any time nor save you any time because you're spending the rest of the time prompt engineering to tweak the output just right.
-
When I was a kid, my grandma always told me diffusion texture painting was the work of Satan. 30 years later, I still have no idea what she was talking about.
-
Cool! Smart design workflow
-
That's actually sick like wow wow wow.
-
Fractal design Painter had a suite of tools like this.
