Artwork Messing around with AI, A Art thread.

Gen 1

Thegoldenboy2188

Well-known member
So thanks to @Baughn I got my hands on Disco Diffusion. And decided to make an art thread just like them.

Here's what I've generated so far.

download.png


I also tried doing one based of an image.

Original Image:
4fb751d385b9b101a729881241a09227.png




The Armored Titan by Ryan Ottley.
download.png


Also did some stuff on Wombo Dream.

1645499091000.jpg


1645759504799.jpg


1645759545143.jpg
 
Gen 2

Thegoldenboy2188

Well-known member
So here's some more arts I generated.

Using the Google Colab version of Disco Diffusion.

Prompt said:
The Iris looking down on Earth, laughing by Thomas Cole and Zdzisław Beksiński, trending on Artstation

download-3.png



This is my favorite piece of AI generated artwork yet. It seemlessly combined the two art styles together and made this cool ass piece, like a Titan lowering his head to the earth, so tall that the only thing you can see is its nose. I really want this to be in a game or something so I can look around!

Though it wasn't what I actually wanted to generate. Really cool though! Made it my wallpaper.

Also I'll give you a like if you guess what the prompt is referencing.

I also had used the same prompt on GLIDE.

download-4.png


...Nice flowers but not what I wanted or expected. I don't think it knew what the artist names and tag meant.

I also did it on CLIP GUIDE.

download-5.png


...Better, but still not what I wanted. It seems that while it may understand the actual prompt the GLIDE AI doesn't understand the artist's names and tags mean.

Also I disliked how small the images GLIDE generates are, so I used a AI image upscaler to make them bigger.


xcs-RV4nw-4x.png

p9t-Rd-Xca-4x.png



After that, well I was reminded of Nightcafe Studio. Nightcafe Studio is a site that allows for AI art generation using VQGAN+CLIP. I actually made an account there 2 months back but forgot about the site till now.

And not only do they have VQGAN+CLIP they also have Disco Diffusion now! VQGAN+CLIP is called Artistic while Disco Diffusion is called coherent.

So I decided to use the same prompt as before with Nightcafe.

Disco Diffusion Prompt said:
sQRwxKMaK6RNgwVUWAxN.jpg


This is my second favorite art generated. While the Google Colab version gives me a larger-than-life feeling, like a titan or a volcano. This is kinda horrifying. A ghastly yellow Iris looking at it's target.

They also seem similar to each other. Perhaps it's because there the same AI? Though this image is obviously lower quality, probably because of Nightcafe and this not having the huge amount of runtime to render like the Google Colab version.

I also tried this prompt with VQGAN+CLIP.

VQGAN+CLIP Prompt said:
hei1hCSscSD1uqy6h79R.jpg




Definitely my third favorite, the way the sky seems to warp and glitch as if space is breaking apart to reveal that cavern. The red like meat or silk and the white bone-like structures holding it up . It's also the art that's actually most in-line with what I was thinking about and what the prompt was referencing.

Also as is tradition now. Let's let Wombo Dream have it's turn.

1646013539441.jpg


Oh, wow this is... Actually good! It's like the decaying corpse of a monster having been integrated into the land. Awesome!

I could see this, the nose volcano, and the red cave being awesome game biomes, while the ghastly yellow light art being a final boss.
 
Gen 3

Thegoldenboy2188

Well-known member
Okay so I decided to see how good GLIDE is at human faces. The results. Not very good.

Prompt said:
Oil drawing of Leonardo DiCaprio
0-F23-A640-29-D3-43-B0-8-DA6-C38-F4-E579131.png



Uh this isn’t Leonardo DiCaprio. This seems to be Venice.

Prompt said:
Digital Illustration of Leonardo DiCaprio

616138-D4-7-B52-4029-B322-062-B31844-EDF.png


This isn’t Leonardo DiCaprio either.

After this I thought maybe it would do animal’s better?

Prompt said:
3d model of a fox
2-DC6-EB6-D-0-FFA-46-AB-8-A41-D8-A061-C770-F1.png


Prompt said:
3d model of a shiba inu
AB3-D92-F8-C8-EE-4762-9-EFE-557-C8-AEAD500.png


Prompt said:
Manga illustration of a bunny.
588-C9320-CFDD-4907-9-C45-0-ECB45122687.png


GLIDE seems to actually understand animals. But even then it isn’t perfect as for some reason the bunny’s head is fucked up and their’s red marks. The AI put those red marks there for some reason.

I did the same with CLIP-GLIDE it also failed spectacularly.

Prompt said:
Oil drawing of Leonardo DiCaprio

04-E379-C4-5-F81-4550-AAC9-89820-B7-F3-FCD.png


Prompt said:
Digital illustration of Leonardo DiCaprio
74-C6-F6-EF-D36-A-49-DA-8521-72403-DE63-A2-F.png


So it seems that while the GLIDE AI understands animals and objects, it does not understand humans and the names of humans. It must of not been trained on that sort of dataset. It also doesn’t seem to understand what Manga illustration meant.

The final CLIP-GLIDE art I did.

Prompt said:
Low poly render of a dragon
48-E11682-6145-4-FB3-BF42-1-AD9498-CE6-DE.png


One thing I like is that the dragon doesn’t look like a typical dragon but more alien.

Though it’s gray like an untextured model. Probably my fault for making the prompt low poly render.

And finally a DiscoDiffusion generated work.


Prompt said:
When Day Breaks SCP-001 by Junji Ito, black and white
8-F8-D39-BF-98-AF-4456-95-E3-99355-DC1-DFB8.png


Damn, terrifying. Also I’ve been using Disco Diffusion v4.1 but Disco Diffusion v5 is out and can do 3D animations so I’ll be using that for Gen 3.
 
Gen 4

Thegoldenboy2188

Well-known member
So I got Disco Diffusion 5, had a bit of trouble setting it up but I managed to make it work.

Here's something I made for a friend.

Prompt said:
Red Moon by Kentaro Miura, black and white
download-7.png


God that looks so cool, DF5 is already better than I thought.

Then I tried to use initimages.

Prompt said:
Izuku Midoriya by Takashi Takeuchi

Original Image:
Izuku_Midoriya_%28My_Hero_Academia_character%29.png


DF5:
download-8.png


...

WHY IS HE SQUISHED? HE LOOKS LIKE MINETA NOW!

Plus that face is nightmare fuel.

I tried again with another image but.

Original Image:
188


DF5:
download-9.png


Still squished, and his face looks disfigured. It might be because of how big the images are, I'll try using smaller images next time.

Also, I did repeat over on Nightcafe to see if it could do it better.

Prompt said:
CeBpaQyN16LSPxRuFjBB.jpg


Prompt said:
7k0nsoaXNZWU18q1dHHc.jpg


Hm, now that I look at it, DF5's and Nightcafe's Red Moon art is super similar, could it be because it's the same prompt?

Prompt said:
Izuku Midoriya by Takashi Takeuchi
with Disco Diffusion on Nightcafe.
j7vNUaYAykSj5uogwZz8.jpg


Oh god he's horrifying.

And finally, something my friend generated.

Prompt said:
5NQsu5IRtuiZWZYurI9K.jpg
 
Tutorial on how to use Disco Diffusion 5

Thegoldenboy2188

Well-known member
Thought I should do this if other people want to do this kind of stuff.

So this is how to use Disco Diffusion 5.

First you wanna search it up on Google or click this link: https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&cad=rja&uact=8&ved=2ahUKEwiZu6i3n6_2AhUsU98KHayQCy8QFnoECAYQAQ&url=https://colab.research.google.com/github/alembics/disco-diffusion/blob/main/Disco_Diffusion.ipynb&usg=AOvVaw1DGrjjRabdLpbwFl5WnPTF
2022-03-05.png


Once you see the link, click it and it will open Google Colab.

You should see this.
2022-03-05-1.png


Now you can either make a copy, or use it like this. I made a copy since using the Colab like this doesn't actually save your previous prompts or settings.

If you want to make a copy go to file and click save a copy in drive.
2022-03-05-15.png


Once you do you should have this.
2022-03-05-2.png


As you can see on the top it saves the Colab will not save anything.

You can change this by clicking Notebook Settings in yellow.
2022-03-05-3.png


Which will open this, uncheck the Omit code part.
2022-03-05-4.png


And then press save, don't do anything else. It will now save your prompts and images.

After that you want to go to the set up cell.
2022-03-05-6.png


You will see two checkmarked boxes called google_drive and save_models_to_google_drive.

If your using a free google drive account with 15 gb. Uncheck these two, cause it will fill up your drive account, or you can just buy some more storage.

2022-03-05-7.png


But if you don't want to buy storage, uncheck these two.
2022-03-05-8.png


Now go down till you see this section called prompts.
2022-03-05-9.png


You can see something called text_prompts, there's already a prompt there, but you change it.

Like say this:

Then go down to the diffuse section and you'll see this thing called n_batches.

These batches seem to be how many images the ai generates, since it says 50 it will generate 50 images.

Now you can do this, but since we aren't saving anything to google drive you'll probably lose them, plus this is a good way to exhaust your gpu limits.

So just change it to 1.

Now you can go up to runtime and press run all.

If you did everything correctly the play buttons on each cell should start running till they become green checks. it will go down until it starts generating the image.

Then you should see this.

It's the ai making the image, and it shows the time it's taking to make it.

You can also use init_images, which is making the AI generate a image based off another image.

So I'll just get an image off the internet like this:

And download it.

After that i'll open the google colab which you should find in your google drive in a folder called Colab Notebooks and upload it to the Notebook.

To do this press the file button on the side.

And press the upload button. The upload button is the paper icon with the up arrow.

When you upload the image you should see the image in the file section like this.

Then go down to the settings cell and at the bottom you should see this part called init settings.

In the init_images setting it says none, because there is no image.

So then go to the image you uploaded.

And hover your mouse, you should see three checkmarks on the side.


Click them and press copy path.


Once you do that go to init_images and delete the none and paste the path there.


It should look like this.

Now your gonna wanna change the skip_steps setting. Since it says to be 50% of the image steps change it to that.


You can find the steps above, it should be 250. So 50% of 250 is 125. So change the skip_steps setting to 125.


Now go to your text_prompt and change it.

And then press run all.

Now it should generate the image but based of the init_image.

Now one thing you should be wary of is hitting your GPU limit.

What is a GPU limit? Well if you are following this tutorial you should have gotten pop-ups saying that the colab uses high ram.

Don't worry, it isn't using your ram or GPU but Google's. However as google states in it's faq it's resources are not infinite.


Because of this if your running GPU heavy programs like DD5 that require a GPU if you hit a GPU limit you won't be able to run DD5.

However GPU limits are temporary, usually it takes about a day for it to disappear.

But if you don't want to hit a GPU limit you can either get pro versions of Colab, or only generate around 1-3 images a day. As that seems to be the highest I can go before hitting a limit.

If you want to generate more images but hit a gpu limit you can go to Nightcafe.

Nightcafe is an art generation site that uses DD and VQGAN+CLIP as well. However the images it generates seem to be a lower quality, but faster only taking a minute or two compared to the 1 hour to 10 minutes DD5 takes.

Nightcafe also requires credits, each image generation requires 1 credit. Though the site gives credits out freely, so you should have no problem not running out of credits.

And that's it, that's how I use DD5.

It should be noted that I don't own this, these things I learned are stuff that I had learned thanks to Baughn:https://forums.sufficientvelocity.c...art-thread.92461/?post=20770699#post-20770699

there's also stuff like tags, if you want more information you can go to the reddit page or Discord or message the creator on twitter, you should find links in the colab.
 
Gen 7

Thegoldenboy2188

Well-known member
For these images I played around with init-images.

Original Image:

latest


Prompt: Monsterverse Godzilla 2021 by Yusuke Murata, manga
IMG-0232-1.png


Damn! That looks cool as fuck! Like a more metal version of Godzilla Earth.

Also tried to make a black and white version, but it didn't work.

Prompt: Monsterverse Godzilla 2021 by Yusuke Murata, black and white, manga
download-1.png


It didn't work. But looks cool anyway.

Also tried it with Sage Centipede.

Original Image:
Sage-Centipede-full-form.png


Prompt: Sage Centipede by Framestore, 3d render, unreal engine, realistic, real life
download-2.png


Looks as if Sage Centipede just busted through a wall, there's also a bit of color here and there but the AI wasn't able to finish coloring it before the generation was done.

So I did it again with a few changes to the prompt. And setting such as changing the number of steps skipped.

Prompt: Sage Centipede from One Punch Man by Framestore, 3d render, unreal engine, realistic, photorealistic, hyperrealism, real life, color, trending on Artstation
download-3.png


I bit more color, but not a lot. If I really extended the number of steps high, like 1000 steps it could work. However, I would need to adjust the skip_steps as well, and if I put the skip_steps too low the picture wouldn't really follow the init_image as that would be too blurry. But too high and a problem like this would occur.

Also, the amount of ram and time it would take would be way too much or too long for me.

Another thing since I was doing stuff from OPM.

Original Image:
20a7c9af3d34aab87a5f2aea3da4a752.png


Prompt: Monster Garou by Yonje Park
download-4.png


Looks like the AI gave Garou feathers, or like his body's made out of strips that cover him. Though it really isn't in the style of God Of Highschool's artist.

Here's another image, not made with an init_image in fact.

prompt: Monster Garou cutting Sage Centipede in half from One Punch Man by Yonje Park, manhwa, webtoon, The God Of Highschool, Trending on Artstation

download-5.png


Looks like some sort of fusion between Sage Centipede, Orochi, and Garou. Fighting sort of spider thing.

And here are some things I made with Nightcafe.













Damn, I like this, not only is it anime-ish 682 is destroying a building with its teeth!





...This is a stout. Why is it a stout?






Well like I said before, too high to little skip_steps and you can get something unrecognizable from the original image.



Looks less like Sage Centipede being cut in half by Garou and more like Garou losing an arm, if the yellow plant thing is Garou.



Actually looks like Garou, though seems like he's approaching a tomato monster.
 

Vajra

Member
You get interesting results if you add the names of various artists known for their good art and mix in the name of a celebrity.

Emma.png


This was with Waifu Diffusion.

If you get a picture that almost looks good but has something like a wonky face/extra arms, use the seed of the almost good picture and try adding varying numbers of parentheses () or brackets [] around the name of the celebrity.
 
Last edited:

sBeeper

New member
Newly joined, I did make some AI art using Stable Diffusion on google colab, with the trinart 50-50 model.

Results are quite pretty.
1666033045_seed_6140056017128370189_upscaled_2_sharpened_2.png
unknown.png
1666027448_seed_4673709583622011953_upscaled_2_sharpened_2.png
unknown.png
1666020162_seed_6962348051952408638_upscaled_2_sharpened_2.png
1666019733_seed_2209089275255730415_upscaled_2_sharpened_2.png
unknown.png

the prompt I used is "portrait, veil, very beautiful woman with long blonde hair, sharp, white skin, art by greg rutkowski, photorealistic, intricate, elegant, elaborate expensive kimono, highly-detailed, detailed, realistic face, good anatomy, realistic proportions, artstation, pixiv, trending on arstation".

Adding "wife" and "upper body" gave some intriguing results, but I dunno which ones I used these ones on.

All in all, the Ai came a long way, even used these in an artwork of mine.
 

Agent23

Ни шагу назад!
So, this thing popped up in my YT recs while I was browsing for some music:


Some of this stuff looks neat.
 

Culsu

Agent of the Central Plasma
Founder
I've got tons of stuff done in Midjourney. All of these here were done in the v4 version of Midjourney.

Here are a few:

Patrol on Mars
grid_0.png


Last Stand on Mars
grid_0.png


Futuristic Urban Warfare
grid_0.png

grid_0.png


Tank armed with laser cannon
grid_0.png


Busy Medieval Town
grid_0.png


Barbarian fighting a pack of wolves

grid_0.png


Dilgar Warmistress.
This was as close as I got with a reference image of J'hadur
grid_0.png


Soldier in power armor
grid_0.png
 

Agent23

Ни шагу назад!
I've got tons of stuff done in Midjourney. All of these here were done in the v4 version of Midjourney.

Here are a few:

Patrol on Mars
grid_0.png


Last Stand on Mars
grid_0.png


Futuristic Urban Warfare
grid_0.png

grid_0.png


Tank armed with laser cannon
grid_0.png


Busy Medieval Town
grid_0.png


Barbarian fighting a pack of wolves

grid_0.png


Dilgar Warmistress.
This was as close as I got with a reference image of J'hadur
grid_0.png


Soldier in power armor
grid_0.png
Some of these are quite good, others are very weird when you stare at them.

Like the tank, the last stand on mars where they are shooting at nothing, ad the "wolf" with teeth coming out of his head.
 

Culsu

Agent of the Central Plasma
Founder
Midjourney is hit and miss; I've realized that it's very adept at showing a concept, but really sketchy when it's about the details.

Like this. It understands I wanted a space warship in the spirit of the space battleship Yamato, it generally understands that there are the elements of the superstructure, but... that's where it ends. It doesn't get more detailed and real than that.

FWCarto_extreme_wide_shot_Flying_Japanese_battleship_yamato_in__87677662-f297-46e7-b3d3-e82586572a22.png
 

Agent23

Ни шагу назад!
Midjourney is hit and miss; I've realized that it's very adept at showing a concept, but really sketchy when it's about the details.

Like this. It understands I wanted a space warship in the spirit of the space battleship Yamato, it generally understands that there are the elements of the superstructure, but... that's where it ends. It doesn't get more detailed and real than that.

FWCarto_extreme_wide_shot_Flying_Japanese_battleship_yamato_in__87677662-f297-46e7-b3d3-e82586572a22.png
Dunno, the stuff I have seen dome with Novel A.I. from various weeaboos looks better, tbh.

And by stuff I mean waifus.

A lot were hit or miss, and I did not see a "raw" sample, just what they were willing to share, though.
 

Culsu

Agent of the Central Plasma
Founder
Still had someprocessing time left on MidJourney and entered some of my old prompts into the new v4 algorythm.
grid_0.png

FWCarto_extreme_wide_shot_ultra_detailed_Flying_Japanese_battle_98c4bfda-6dab-4464-b23f-3c7ecc6cf3ed.png
 

*THASF*

The Halo and Sonic Fan
Obozny
Various "alternate Master Chief" pieces done in MJ v4, plus a couple extras:

master chief, but his armor was designed in the 1980s by the Soviet Union --v 4

k1pUbei.png

7M4kTBV.png



master chief, but the UNSC has had budget cuts so now he orders his MJOLNIR armor from China off Wish.com, and it looks really cheap and fake --v 4

Gmqm5q9.png


Hey, wait, these are actually awesome.

AjlChq8.png


Wait, this one's just a damn Zaku:

CpNWjio.png


70s science fiction book cover painting of a guy in a desert wearing a space suit with a retro laser pistol, moody --v 4

DSvkf0f.png

oup4aXg.png

I've also been messing around with Stable Diffusion, of course.

Twilight was hungry and emaciated, so I gave her a plate of breaded fish filets.

3vPnXVe.png


Oh no, I gave her too many!

ADpPs16.png


She developed neuropathy from the 'beetus and had to be turned into Twiborg:

OqR87de.png
 

*THASF*

The Halo and Sonic Fan
Obozny
Behold, SWOLEWORLD. Muscletopia is now real.

Statuesque Swole Guy in Front of Stately Building
YNfNVvG.png


Swole Guy, Swole Horse
ozgqpAP.png


The Acolyte of Swole on His Swolegrimage
uI9nsL8.png


Protein Shake Ritual
h5ppUMx.png


Swolnald Trump
nKc7ycT.png


Joe Swoleden
qlwEJo9.png


Donald Swolefeld
SwhQPQP.png


Nancy Swolosi
RDmZk99.png


Jennifer Swolepez
pLcNgsN.png


Swolight Sparkle
MShVAaZ.png
 

Users who are viewing this thread

Top