Ask HN: Generative AI Courses for Artists
I have a group of friends who are professional artists and they are not big fans of generative AI. I've tried my best to explain what it is and isn't and a few of them are interested in taking a more serious course on the subject.
Most of the learning material is either very technical and geared towards programmers or too vague and hand wavy to be practical to someone who wants to incorporate generative AI into their artistic workflow.
Most of them are familiar with text2img models, but ideally I'd like something that explains _how_ diffusion models work, their probabilistic nature, how they're trained on images/text and maybe even a high level description of what the different parts of a setup in, say, ComfyUI are doing (LoRA, VAE, CLIP, UNet models).
I admittedly have a tough time judging the technical expertise of people, but I think some of the resources I've personally found great for explaining the basics (3blue1Brown, Andrew Ngs course, ComputerPhile videos) are still too technical and impractical.
What resources would you point your friends to who both want to learn about generative AI and assuage their fears that AI will make artists obsolete?
78 comments
[ 3.3 ms ] story [ 161 ms ] threadSpecifically the reading and tutorials sections may be of interest to you.
Edit: honest question, why the downvotes? Am I not contributing to the conversation?
I suspect we could drill down into what you are trying to say for a whole thread but the result is just going to be a specification for pretension.
Why don’t you shelve the pretentious corporate rhetoric yourself and re-read what I’ve suggested.
Get off the computer and pick up a pencil, or mound of clay, or whatever, and give it a few years of regular practice. Theres nothing pretentious about that. It will do everything and I will need to say nothing.
"It will do everything and I will need to say nothing".
Those are the pretentious parts of your reply.
It's just not true that everyone feels that practicing art is the main point. Sure, it can be developmental for an individual.
then it's likely that you're discussing people who don't consider themselves artists. i used to know some folks who did graphic design for advertisements - they didn't consider that art, as the point of the banners etc that they made was to attract attention and get people to spend money on a client's website, not to express themselves in some meaningful way. they were under no delusion that they were creating anything that could be considered near the same category as a Picasso (for example).
As I said elsewhere, if you think the artifact is all that matters then you are lost.
And I have better things to do than get mired in rhetorical bickering.
Once software has “eaten the world” then it will starve with nothing more of value to consume. I will still be here.
And for some bloody reason still doing my taxes by hand while some energy hungry machine churns out Rembrandt imitations that I don’t bother viewing.
A person who has become accustomed to taking an engineering (or yes, unfortunately enough, a marketing) approach throughout their life may be more naturally drawn to a process that appeals to them rather than one that is unfamiliar. Especially as they grow older and their way of the world solidifies, since up to that point that mindset has served them well in their usual non-art domain.
I will be the first to say that I do not consider genAI as "art" in the traditional sense. And that the two approaches are not, and will never be, equivalent for the reasons of personal self-development outlined elsewhere in this thread. At the same time, I did do as you say and spent a lot of time and effort on analogue pencil/ink on paper drawing for a year and a half in rebellion to this genAI commodification of everything. I did a few free tutorials but in general just tried to sit down somewhere and draw anything, free of any boundaries or restrictions, to keep my mind on drawing.
After months and months of it, on a near daily basis, I just lost interest. I didn't have a strong drive to get really good beyond what I considered chicken scratches.
Now of course you could say something like I needed to spend more effort instead of stopping that early not truly understanding the process of drawing, but to me it feels like fitting a square peg into a round hole. It's about different people having a different alignment of interests. For example I find music processing tools like pure data far more interesting than anything related to pen-on-paper, and have created a lot of things with them (without any AI involvement), arguably rather artistic things, in a shorter timeframe, because I enjoyed it more than drawing. Likely because those systems feel more like engineering to me.
So in my opinion, some portion of the people insisting on genAI's superiority as an approach (completely the wrong thing to say IMO) in reality wouldn't have had much interest in creating art perhaps for the rest of their lives if genAI hadn't been invented at all. GenAI to those people is an indicator of how invested they are in art/personal reflection/growth, etc. Which is: not much, in comparison to other things. But to them that's fine. And it wouldn't have been much different without genAI, only you wouldn't have heard of all those people in an art-world context 6 years ago anyway - save for something perspective-altering like psychedelics, maybe.
And this also applies between domains within art as well. A person's interest in digital painting may never reach the same level as that of EDM production. And some portion of those hypothetical EDM producers will, unfortunately or not, discover a way of reclaiming the leftover time for their less-important hobbies in smashing a button 10 times.
When the bar has been lowered so low that someone can push a button and have a flurry of artifact imitations spit out, people will be naturally curious for at least a short time. When a few of them also realize that this places the domain of "art" (for whichever faulty or not definition they started with) into an engineering realm involving all sorts of sparkly bits like k-diffusion methods and LoRAs and UNets and activation functions and such, it's not surprising that some engineering-minded people would think to themselves "oh, this can become my way of expressing myself." However flawed that reasoning may be.
There are some real dangers here that need to be navigated.
Junior artists who get their start doing commissions are not going to have that path anymore.
Reddit's job boards for junior artists are a literal desert now.
In a sense, the activation energy gradient to producing good results has lowered such that the economic reward for up and coming artists has deteriorated.
> Why don’t you let the artists maintain their own practice, rather than pressuring your friends to join you in yours?
Artists who get their start in AI early can build recognition and clout within the community. They'll potentially be at a big advantage.
a16z is investing in non-technical artists to bootstrap production and community. There's actually a lot of interesting stuff happening when you dive in to AI art.
It’s just market forces being unsure about the future of hiring artists.
Companies are like lemmings, they just follow one another.
Artists already know that gen AI is just another tool in the toolbox.
We’re just waiting for MBAs to also realize this.
GenAI making artists obsolete is a dumb idea. No MBA is going to be trying to coax a GenAI model into making an image.
https://www.reddit.com/r/artistforhire/
This is hardly the only community for this, and it's evaporated into a ghost town. Prices have decreased an order of magnitude.
This is one of the ways up and coming artists without professional training get started earning money from their skill set.
You should see also how Fiverr has filled up with GenAI artists that are pricing out traditional artists. Fiverr isn't typically a place for highly skilled work - it's for newbies and developing world opportunities. And now the money is thinning out.
Contract art for individuals looking for a custom image has been devastated by GenAI.
This makes a little more sense as the bar for quality is much lower than a widespread commercial product and most individuals are willing to compromise on that to get a good desktop wallpaper quickly for free.
Even local events have been using AI banner images.
This is true for just about everything, honestly. The more you play with these tools (and use them in anger to do real shit) the more you push their boundaries and learn what they are good for and what they aren’t. You also quickly realize, like any other computer tool, there is a certain skill you need to have in order to provoke these things into generating the output you expect.
They can be time savers but also time wasters.
But what they aren’t gonna do is make the employees of entire industries vanish overnight. But I will say you’d be a fool to ignore these tools because once you master them they can be a pretty awesome force multiplier.
That all being said, many times it feels like it’s just a fancy, more annoying Alexa that you have to fight with to get the results you want. But alas…
I dont think anybody who has taken up an artistic practice, professional or otherwise, should or would spend much time basing their life decisions around an online job board.
You’re missing the point.
I'm an engineer and a filmmaker. I've lived with 5 AM call times and shoots that ended at sunrise. I've rented ridiculous $300,000 glassware, lifted heavy items from the top shelf of the prop house, dealt with talent issues, struggled to memorize lines, had post production drop projects on the floor, and dealt with so much bullshit - that world sucks.
The film portion of this market is bending a little bit differently than illustration, and these changes are presenting a huge opportunity for filmmakers and animators.
Film needed studios historically because (1) distribution was hard (YouTube and Netflix have addressed this) and (2) films are logistically complicated, capital intensive, and require lots of people. Gen AI is changing this last bit in a big way.
Film is basically getting its "Steam" moment. Just like indie devs can make games, indie authors can write novels, or indie musicians can work on a DAW and publish to Bandcamp, filmmakers will soon have the ability to build their own universes and audiences - something that wasn't possible before. (While there are writers, comedians, and animators like Vivienne Medrano, Joel Haver, and Zach Hadel, GenAI makes this happen in a big, repeatable, and sustainable way.)
20,000+ film students attend film and animation school every year. There aren't enough projects currently to have all of them be autonomous or pursue their own vision. That's changing.
And why would you want to build in Disney's ball pit and play by their rules when our own minds are so much more expansive? So many ideas wither on the vine and never see the light of day due to the intense capital requirements and the bland general audience algorithm of the existing regime.
Ask yourself why there are 20,000+ fantasy books but only 50 fairly generic fantasy films and TV shows.
This is all a good thing. Art is going to explode and fill into every niche and interest you can imagine.
The market will grow, not contract, and the artists will have their own brands and audiences.
So disgusting.
> activation energy gradient
> producing good results
> economic reward
> build recognition and clout
> big advantage
> a16z is investing
> bootstrap production
you're saying a lot of things about commodification and mass production, which are completely unnecessary to the expression of the human condition.
I like technology. I hate how its being used, especially by groups like that.
Software needs a soul revival. Holy shit
Read my response here https://news.ycombinator.com/item?id=42368209
I struggle to see how the existing status quo is better than the world that is coming.
you're saying "you must have a giant budget and tons of time to compete with the studios and AI can level the playing field" but i don't know why an artist would want to compete with a major film studio which is pushing out generic content in the first place?
you don't need a multimillion dollar production budget and $300k props to make art, in the same way a sculptor doesn't need to make statues out of gold or diamonds.
The non-artists community? The "I don't have anything I can show I own the copyright to" community? The "I made this with genAI so now the company can't even protect it's copyright?" community? The "tech-bro NFT fraud" community? The "do it for the exposure" community?
Which community?
I dont think any aspiring artist, professional or otherwise, was ever deeply concerned about their future prospects in creating corporate graphics or mechanical pop songs. It was a fast buck, that’s all.
Attempting to seduce them into committing ever more of their creative efforts in the service of a machine that only seeks to churn out more artifacts misses the entire point of ever starting, and especially continuing, an artistic practice of any kind.
The entire purpose is in the act of creating and the efforts involved in honing a craft that entirely relies on your commitment.
It doesn’t get any simpler or less pretentious.
The road to mastery is the entire bloody point.
Trying to encourage your own friends to short circuit that only serves in getting you to the artifact faster, and in the process neglects anything of any value from the entire process. Is that really being a friend?
Unless you think the only thing that matters here is the artifact. Then you’re lost.
I think that in my case, and I suspect the case of many of people, one of the most rewarding things is someone connecting with a piece that I made and having it greatly improve their lives. I can understand wanting to optimize the process of creating artifacts in order to have more people thanking you for making their day/week/month/year with your art ^_^
The road to mastery, while yes there is that whole spiritual journey aspect of mastering yourself via mastering a craft, is also supposed to end in a place where you have the skills to give joy to people via your art. Via making something that they'll love, be it a painting, a song, or some software.
Wanting to optimize this not only makes sense, but is probably part of the process of mastering the craft. It is for me in any case, I do give a fair amount of thought to how I can improve my creation velocity when I make music, drawing inspiration from artists like JuL and Lex Luger who are known for their ability to rapidly compelling new tracks.
The way you said this makes me think you agree with OP. The piece that You made is the embodiment of your experience, which can connect with someone at a certain level.
It's you, the piece is just the end result.
Could you do the same with an AI music generator where you input a prompt? Maybe the same amount of people would connect with it, but are you as an artist connected with it? Does that prompt embody your expression? I doubt it.
A good exercise anyone can do is to question why X or Y artists became a reference at a certain time.
You end up finding out it was about: the historical context, cultural disruption, influence during or after their life, consistency in pursuing their artistic expression... the list goes on.
In some cases the final outcome, the artifact, is "cool" on its own without the context, but in all cases, it's the artist that makes their body of work valuable and "cool".
Technology at the service of artists has played its role in new media and different ways to work with it, but it's mainly as a tool.
But to address your claim, I disagree that the entire purpose of art is individualistic honing of craft. That's a very romantic view of art which I imagine many artists would also disagree with. There are many reasons why people create art. One is for the individual honing of craft. One is as a means to communicate. One is as a means of making a living. One is catharsis. Another is to bring about change. And there are many more. Most artists likely have a cocktail of these reasons as to why they are artists. My guess is professional artists _do_ want their art to pay the bills, and might not be able to practice their art if they had to spend 40h a week doing something else to pay their bills. So I understand their concerns that being a _professional_ artist _who can support themselves from their art_ might be becoming obsolete.
I do agree with you that I don't fully understand the purpose of OP's proposal to teach them the internals of how AI models work. I would understand teaching them AI artist tools like Adobe's AI integrations -- since these tools could potentially give them a competitive edge over other artists, which would help them be able to continue working in the field they love. And like you said, artists might not have a great love for the more corporate gigs that pay the bills -- where that individualistic expression is greatly diminished anyways -- so that might be a prime opportunity where an artist could use AI to help support themselves so that they can then spend time creating art they care about.
It seems like your post is mostly based on assumptions about the poster, and a misreading(?) of this one word.
There’s no hubris in wanting to assuage people’s fears that their skills might become obsolete.
> The important part of art is the practice and the transformation that occurs in the creator.
They claim to be engaging (talking to friends) to the extent that they can be without already being a working artist. Maybe they are lying, but all we have is a post on the Internet, so if we assume the author of the post is a liar, we don’t have much to go by.
> You will never understand this unless you engage. Trying to circumvent it again and again will only result in circumambulating the point and will miss it every time. No matter how shiny the artifact that results.
Do you actually work in art? I don’t. But what do you mean by engage? I’ve taken some art classes. It was fun. But this was a cultivated experience, I was paying the instructor to have fun and explore ideas.
On the other hand, you can poke around online and find people who will complain about the day-to-day bullshit of their art jobs. I worry that, almost by definition, the easy paths to engagement are almost by-definition not going to give a good view of what the day-to-day bullshit experience looks like.
People romanticize engineering and programming as well. The beauty of getting a tangible solution, sprung from your mind, that impacts the world. At the end of the day, a lot of houses and dinners were bought by the need to throw together boring assed corporate inventory management systems.
Most work is the sort of stuff that nobody wants to do, after all. That’s why they pay you for it, rather than going the other way.
Oh, you didn't read the whole post. I'd recommend you do, it'd help with understanding and replying.
> , rather than pressuring your friends to join you in yours?
The OP is literally saying they're asking.
There are more constructive ways of engaging.
Let's try something simple.
Have you ever used a pre-existing piece as part of your composition? Would it matter if that was not created manually?
What's the least creative part of what you do, are there any bland things you could fill in (e.g. paint these clouds or grass for me).
I notice a lot of non-professional artists running to the rescue of artists. I suspect this is in part because there are a lot of young people who have pursued a degree in art and have been frustrated by the mismatch of their expectations in the commercial world. There is a lot of romanticism.
I myself went to art school (MFA). Actually I was really grossed out by the big Art gallery scene. It professes to be open minded, anti establishment and non commercial but it is extremely narrow in politics, hugely elitist and deeply oriented around big money. That’s ok, but I wouldn’t claim that Art has any moral superiority.
So if you make your art for "you", why should I care about it? If this is how artists feel then bring on the AI.
https://news.ycombinator.com/newsguidelines.html
AI will eventually basically make artists obsolete just like every other job. You should focus on the creative possibilities of the present. Things like tools or ComfyUI nodes or whatever that allow you to do things like "auto complete" digital paintings based on live sketches, change a style, generate variations, etc. Focus on the capabilities of the tools in terms of enhancing or producing art or testing ideas. Show how an artist can train a Lora on their art and then use a scribble ControlNet to instantly go from sketch to a manifestation of a finished digital painting in their own style and evolve it with each stroke.
No it won't. We've hit a wall and the low hanging fruit are gone. OpenAI hit a wall and is searching for enterprise customers to maintain their valuation, and Google and Facebook are calling them out on it. Meanwhile, text is entirely inadequate for manipulating visual things effectively.
AI will supercharge artists that embrace it. Text-to-art is not good enough and real artists will be working with layers, node editors, and in 3D/video modalities.
The trajectory we are on is for AI to be able to do most intellectual jobs in less than ten years and most physical jobs in less than 20. That is speculation but it is based on many decades of increasing performance and capabilities.
Text does have limitations but AI tools and models are not limited to text to image and new models and systems will be created.
I agree that AI will help artists in the short term. But we should anticipate that humans will eventually just be a bottleneck in the creative process.
Try making a Jackson Pollack using AI, AI can only effectively make objective images, given it requiring linking similar images via limited text descriptions.
Making headers for newspaper articles or blog posts on the web might be OK if you don't care much. Check out https://www.quantamagazine.org to see how real artists do things. Their header images are really imaginative given the subject matter, something AI today can't do. It might be instructive to take their articles and try to make header images for them.
If you make videos, then its 1080p which can be done by AI. But video has its own issues with video diffusion generators having limits on continuity. They are getting better, but the longer the clip, the less control you have and the longer it takes to fiddle with the prompt(s). It won't ever replace real movies unless you enjoy the SciFi channel or Sharknado. That would require an entire new kind of AI which we don't have today.
The best tools in this space are spatial editors and node editors. Text is weak sauce.
Also, you can't use text modalities for film and 3D. It has to be art tooling to get good results.
Artists will always have a job. They'll just be doing way more than they were before.
I think style transfer + pose detection + edge detection gives artists a bunch of new tools to play with.
OP I would look into learning comfyui
if the amount of new offer is not paired by demand, there will be pain.
Sure, you still use a prompt in those, but it's not really the focus in many cases -- you just use it to give a very rough guideline of what you're trying to do, then start drawing.
Depending on approach you'd either start sketching your astronaut and see the AI turn the sketch into something polished in real time, or you'd generate an image then polish up the details. I think most artists are more likely to prefer the first approach.
This sentiment is reminiscent to the attitudes around photography when it first became practical. People wondered how photography could be considered a form of art when all one had to do was point and press a button. The amount of effort is minuscule compared to what it takes to depict the same subject using traditional media. That being said, there is a lot of skill necessary to capture a photograph properly; lighting, composition, shutter speed, exposure, and so on. I agree that generative AI images will disrupt the market segment for stock photos and "clip art" used for articles, presentations, et cetera.
There will be a need to study and acquire skills related to the use of generative AI image creation. While technology will make simple prompts "good enough" for most outputs, just as our smartphone cameras make taking a picture "good enough", people will still need to study and practice in order to make high quality output.
Whats the goal here? Do your friends express interest in using AI within their practice? Technical or not, an artist doesn't need to understand it to achieve that... Many years ago before I better understood it, myself and other artist used generative AI to create elements of our works and no one knew or cared that we did.
https://banodoco.ai/
Invoke AI has incredible open source image editing tooling and a fantastic YouTube and Discord that pair with it.
https://youtube.com/@invokeai
Curious Refuge (paid) has a great community and paid lessons for AI filmmaking.
https://curiousrefuge.com/
Reddit is overflowing with AI art communities, many of them technical in nature.
https://www.reddit.com/r/comfyui/
https://www.reddit.com/r/StableDiffusion/
There are a lot of offshoots of these, and Discord will provide the best resources once you get plugged in.
Step 1 - get them to sign up for AI image tools.
* Midjourney is best for quick images
* Playground AI is good if they need to modify images but the quality doesn't need to be perfect
* Leonardo AI (now owned by Canva) is a good full suite
* Photoshop AI feature is best if they already work in photoshop
Then show them how to use these tools! That might require you signing up for these tools first and learning yourself.
Step 2 - For learning about how AI image generators work here's my video list.
1) AltexSoft - has a low viewcount but it's a great overview - https://www.youtube.com/watch?v=Rke0V_VkF3c
2) Jay Alammar - it's technical but also visual and he explains it well - https://www.youtube.com/watch?v=MXmacOUJUaw
3) Gonkee - again, technical, but visual, great - https://www.youtube.com/watch?v=sFztPP9qPRc
Workflow example: good for seeing the workflow of SD as of May 2023 - https://www.youtube.com/watch?v=K0ldxCh3cnI
Too technical for what you're looking for: Computerphile, Ari Seff, Jia-Bin Huang
Step 3 - For assuaging their fears about becoming obsolete - I think the following is a great podcast episode. https://80000hours.org/podcast/episodes/michael-webb-ai-jobs...
But their fears might be valid. A test is perhaps: if their boss spent a few days learning to use AI image generators, would they still need them? For some artists the answer would be no, for many the answer would be yes. It'll change over time as the tools get better, but that's a pretty good proxy. If they're doing things that require more iteration, interacting with users and humans and the physical world, nuanced judgement, in-person work, safer. If they're doing things that are contract based, no iteration, get a request and deliver a result, much less safe.
This would for instance be the Krita plugin and InvokeAI. Both heavily cater to an user with little interest of getting into the weeds of VAEs and UNet models, and is much more at home using a drawing tablet.
Krita is closer to being artist-targeted since it's primarily a drawing application with an AI add-on.
InvokeAI is more on the opposite side, an AI tool with primitive but still usable ability to guide the AI by sketching stuff on a canvas.
The reason why this doesn't appear to be clearer, is that this field if filled with tasteless technology-driven engineers that think they can explain or reduce everything to numbers.
Go talk to your friends, and go to their exhibitions. Witness and celebrate their process. They don't need "courses" on such a misplaced and self-entitled technology.
There are a lot of other interesting Computer Generative Art that are not Diffusions. Maybe those a more genuinely interesting to your artist friends.
The details of how it works mostly won't matter unless you're trying to get really specific with how a plugin works. For a filter in Photoshop, you don't find many tutorials on the underlying algorithms, you usually find guidance on when and why to move the slider.
To OP -- We work with professional artists regularly, and I'm seeing things pick up as more begin to understand the potential for creative control. Artists mainly want to be afforded creative flexibility and control, and need an interface that feels natural for their workflow.
Invoke is OSS, we release continued training/education on a weekly basis (free, on YT) and we'll be releasing a simplified installer soon.
These things hardly matter for artists. Most artists don't even know how a Gaussian blur filter works and they can still produce astonishing artworks.
Not everyone finds solace in this strategy. Understanding how the blade is forged as it pierces you may be a mundane final thought. But if you survive I suppose you can use that knowledge to pierce others and destroy their planned futures. Let them pivot or let them starve?
Pivoting to some hybrid of generative AI with human edits is appealing to software developers but soulless and essentially anethema to many others.
ideally I'd like something that explains _how_ diffusion models work, their probabilistic nature, how they're trained on images/text
How they work is probably out of scope of an artist. They’ll figure it out given some knobs, and honestly you cannot explain any of it, you have to get the feeling. Cause it’s not only probabilistic, but island-y. What worked yesterday may noy work today. You have to train yourself on these parameters.
Comfy
Is basically a bash-like visual programming. Cool for developers and repeatable workflows, but overkill and overwhelming for a beginner.
Problems.
The most problems come from python management. Python versions, libraries, plugins breaking the env, etc. you have to prepare some pre-built folders (or cloud images) for them. So that it just works. Then I’d download a few popular checkpoints andshow them the inpaint (mask) tab in a1111. I think that this tab will create a good first impression required for further interest.
As a sort of a poor artist myself, it was amazing to see how SD can take two sprites and inpaint them together across a masked edge. Or replace a segment with a completely new content. (Although for them it may look meh)
Txt2img is not that wow, cause everyone is already tired of it.
Can’t point to resources, sorry, I learned from the internet by googling all my questions.
I can draw well. But I don't associate my identity with it. So I am not an artist. I write well but I am not a writer. I am happy to delegate these forms of work to AI, the same way I'll delegate laundry to washing machines.
For someone who calls themselves an artist, their identity is centered around their ability to draw.
Photographers will use editing tools. Most don't mind tools. A photo editor enhances the photo, the core still comes from composition, lighting, etc.
I would start here. Show that it could be useful first. How can AI white balance dozens of photos? A favorite use of AI among artists is doing different resolutions, expanding a small image into a capsule or cover image.
The ones building buildings and carving statues want machines to do the work of gathering the resources. Those who make games and movies want graphics and audio.
To the pixel artists, getting their drawing in a game is part of the art, but to the game dev, working with a pixel artist may be a chore.
We'll see a lot of reshifting of these forms of art - the pixel artist will be able to use AI to make games or variations and such, and may find art in becoming an art director instead.
But it’s really hard to overstate just how badly these takes misunderstand art as an entity. So much “as a super brain genius developer, I know that true art is [glib definition that excludes nearly all artists] so any true artist must think X about AI, so if you don’t think that, you’re not a true artist and I can feel good about ignoring any reasonable ethical business boundaries.”
I haven't found any particularly good courses, however I do enjoy this YouTuber, who covers Midjourney and some other generators:
https://www.youtube.com/@WadeMcMaster
The key thing you should try to do is this: make them understand that genAI is a toolset, akin to Photoshop.
I reckon there are some hurdles to overcome before seeing a lot of non-technical generative AI imaging uptake among advanced and professional artists. A) most of these tools UIs aren’t useful to traditional artists in any part of the direct creation process yet, B) the prompt-based workflow, conceptually, doesn’t fit into traditional art processes so it’s essentially starting from scratch, and C) some vocal denizens of the DIY NN scene have done a fine job of making it as unappealing as possible to traditional artists.
I know plenty of artists— both commercial artists and professional fine artists— that use simpler generative tools like midjourney for mood boards, reference, etc. but don’t know a single one that directly uses the output to make art.
One big problem is that the UIs of all local stable diffusion front ends are not designed for people to make art— they’re designed for people to operate a neural network image generator. From a technical perspective, that’s the same thing, but from an interface design perspective, it is a very different goal, and it shows. For people that are enamored with the technology, or for people with a technical background that are used to wielding a bunch of abstract acronyms and don’t have to build up a bunch of base knowledge, that’s great. For people that just want to express themselves and already have another way to do so, it’s a huge, annoying impediment. (And while it’s done with the best of intentions (usually,) assuming non-technical artists will be as enriched by the technical knowledge and tools much as technical people without art expertise comes across as pretty conceited.)
Another problem is that getting an image generator to create things in a way that makes sense in a normal artistic process is difficult. Art, generally, is about building things from broad stroke base to the finest finishing details with direct, granular control, and deciding/discovering what that finished piece will look like while you go, with all of the kismet and happy accidents that go with that process. You don’t usually make huge changes after you’ve polished it up because you probably wouldn’t have gotten that far with an element that didn’t work. When you start with something that has all of the “finished product” detail implemented already, that entire process is turned upside down. It’s distracting. Think about the way Bob Ross worked his way through a painting— do you think he would even want a workflow where he used words to describe a completed painting and then decided things he wanted to change about it? Not being an artist, encountering that tool is incredibly freeing. When you’ve put a bunch of time and practice into figuring out how to wield that artistic perspective and then use the tools you prefer to build and develop your visions from raw ingredients, it’s restrictive, disorienting. The thing you’ve been organically growing into for years that makes your art yours— the way you make basic shapes, flicks of the pencils or brush, ways that you might subconsciously separate tiny little background elements from each other, all of which are equally applicable with digital tools— is missing from this piece and has been replaced with an amalgam of many other artists hands. That’s the reason many people like generative image stuff: you don’t have to understand all of the tiny little components that make a piece what it is and just think about the objects and comparatively very-broad-stroke style. You’ve lost the verbs and adverbs from your process and are left only with nouns and adjectives.
Also, while obviously not representative of the user base on a whole, the active, vocal community of stans that can’t distinguish between Reddit and the rest of their interactions have done a great job of alienating traditional artists. Their ...