diff --git a/README.md b/README.md index a55e9f8626..b5d1e2c548 100644 --- a/README.md +++ b/README.md @@ -1,82 +1,139 @@ +

ArtCraft

+

The IDE for artists.

+ + + +https://github.com/user-attachments/assets/7339bd09-3e0d-44a7-a024-af9de64e4c11 +

-

-

The IDE for artists.

- Discord - YouTube - X - LinkedIn + Discord members online + YouTube + X + LinkedIn

---- +

+ Download ArtCraft · + GitHub releases · + Build from source +

-ArtCraft -======== -ArtCraft is the IDE for interactive AI image and video creation. -We turn prompting into *crafting*, so your ideas become a form of tangible expression and computing. -This is Adobe Photoshop for everyone, and we're giving away the source code! +ArtCraft is the IDE for interactive AI image and video creation. Compose in 2D, stage scenes in 3D, and choose the models that fit your work. Turn prompting into *crafting* with visual tools for precise, repeatable results. ## Show, Don't Tell: Advanced Crafting Features -Text-to-image is great, but artists *need control*. It's important to know what your image will look like before you generate it, and it's vitally important to achieve consistency and repeatability. +Artists need control over composition, character identity, and camera placement. Build the scene before you generate it. Click any preview to view it at full size. -| Feature | Demo + Explanation -|-----------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| -| **Image to Location** | ![Video](https://github.com/user-attachments/assets/21f103e3-cc19-4882-a630-9caa1b76ae31) Placing virtual actors into physical environments establishes single-location consistency. You can film multiple shots within a room without having things disappear. | -| **3D Image Compositing** | ![Video](https://github.com/user-attachments/assets/f93a616f-571d-474e-bcc0-53736de7303d) Use images (backdrops, foreground elements, props, etc.) in scenes with depth and blend them naturally together. Just a couple of images usually leads to great compositions. | -| **2D Image Compositing** | ![Video](https://github.com/user-attachments/assets/d6f99391-e496-4c62-9e37-29734ba5f899) Use images, background removal, layers, and simple drawing tools to precisely compose a scene. | -| **Image to 3D Mesh** | ![Video](https://github.com/user-attachments/assets/600a405c-e360-48c1-9b42-6e657ae6243b) It's almost impossible to lay out complicated objects or block complicated scenes; turning images into 3D helps position elements exactingly and intentionally. | -| **Character Posing** | ![Video](https://raw.githubusercontent.com/storytold/github-media/22a27373707b13f48fc56405f1f89ca143c43d5d/character-posing.webp) You can dynamically pose your characters to achieve the precise character, scene, and camera blocking before calling "action". | -| **Scene Blocking w/ Kit Bashing** | ![Video](https://github.com/user-attachments/assets/eef025ac-0346-4a46-a023-d48e23629eb5) Use 3D asset kits to precisely block out your scene: get the correct angles, object positions, and rich depth layering you can't with text prompting. | -| **Character Identity Transfer** | ![Video](https://github.com/user-attachments/assets/629119ee-8c76-4a83-9827-8c6c995a3ec1) Use mannequins as simple 3D ControlNets for posing any character. | -| **Background Removal** | ![Video](https://github.com/user-attachments/assets/90c65057-5531-404f-83af-b34e66e24ec1) Remove backgrounds from images to make them useful in 2D or 3D compositing. They can be props, layers, or backdrops. | -| **Mixed Asset Crafting** | ![Video](https://raw.githubusercontent.com/storytold/github-media/main/ship-editing.gif) You can use image cutouts, worlds, and simple 3D meshes all together to precisely and intentionally lay out your scenes. | -| **Scene Blocking** | (preview coming soon) | -| **Canvas Editing** | (preview coming soon) | -| **Scene Relighting** | (preview coming soon) | +| Feature | Preview | +| ------------------------------------------------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | +| **Image to Location**
Place virtual actors in a consistent environment and plan multiple shots in the same room. | Image to Location demo | +| **3D Image Compositing**
Layer backdrops, foregrounds, and props in 3D to build compositions with depth. | 3D Image Compositing demo | +| **2D Image Compositing**
Compose a scene with image layers, background removal, and drawing tools. | 2D Image Compositing demo | +| **Image to 3D Mesh**
Turn an image into a 3D object you can position, rotate, and frame precisely. | Image to 3D Mesh demo | +| **Character Posing**
Pose characters and set your camera before generating the final shot. | Character Posing demo | +| **Scene Blocking with Kitbashing**
Combine 3D asset kits to control camera angles, object placement, and depth. | Scene Blocking with Kitbashing demo | +| **Character Identity Transfer**
Use a posed mannequin to guide the placement and pose of your character. | Character Identity Transfer demo | +| **Background Removal**
Isolate subjects to use as props, layers, or backdrops in 2D and 3D scenes. | Background Removal demo | +| **Mixed Asset Crafting**
Combine image cutouts, worlds, and 3D meshes in one scene. | Mixed Asset Crafting demo | -Note: all of the above videos were generated for free with Grok Video; the cost to build this README was negligible. +More previews are coming for scene blocking, canvas editing, and scene relighting. ## Quick and Easy Prompting -We haven't abandoned text-to-asset generation for quick prototyping and ideation. We support every popular workflow in a first class fashion. -| Feature | Demo + Explanation -|-----------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------| -| **Text to Image** | ![Video](https://github.com/user-attachments/assets/9cc289cd-faf4-4eaf-aed2-21134cce127c) Text prompt over a dozen different image models. | -| **Image Editing** | ![Video](https://github.com/user-attachments/assets/a06fa6ad-936c-42d0-8767-48fdbb8ff141) Edit with Nano Banana Pro and GPT Image 1.5. | -| **Image Editing** | ![Video](https://github.com/user-attachments/assets/f036e08a-f3a6-417a-98ee-ec7f04b2b5ff) Use inpainting, drawing, masking, etc. to edit images. | -| **Image to Video** | ![Video](https://github.com/user-attachments/assets/2bc6c592-511e-4fba-b40f-03c96699b7f7) Image to video with lots of different options and controls. | -| **Image Inpainting** | (preview coming soon) | -| **Image Ingredients** | (preview coming soon) | +Start with a prompt when you want to explore an idea quickly, then use the canvas and scene tools to refine it. -## Models and Providers Supported within Artcraft +| Feature | Preview | +| ------------------------------------------------------------------------------------------------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | +| **Text to Image**
Explore ideas across a wide range of image models with a text prompt. | Text to Image demo | +| **Prompted Image Editing**
Describe changes to an image with models such as Nano Banana Pro and GPT Image. | Prompted Image Editing demo | +| **Canvas Image Editing**
Use drawing, masks, and inpainting to guide exactly where an image changes. | Canvas Image Editing demo | +| **Image to Video**
Animate an image with your choice of video models and generation controls. | Image to Video demo | -| Provider | Features | -|------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------| -| Artcraft | Nano Banana, Nano Banana Pro, GPT-Image-1 / 1.5, Seedance 1.0 Lite / 1.5 Pro / 2.0, Seedream 4 / 4.5, Flux 1.1 / Kontext, Veo 2 / 3 / 3.1, Kling 1.6 / 2.1 / 2.5 / 2.6, Sora 2 / Pro, Hunyuan 3d 2 / 3 | -| Grok | Grok Imagine, Grok Video | -| Midjourney | Image Gen (all versions) | -| Sora | Sora 1, Sora 2, GPT-Image-1 | -| WorldLabs | Marble (Gaussian Splat World Generation) | +More previews are coming for image inpainting and image ingredients. -We're going to be adding the following providers soon: Kling (via Kling website accounts), Google (via API keys), -Runway (via website account), Luma (via website account). +## Models and Providers Supported within ArtCraft -We're potentially interested in adding other aggregators for those who already have subscriptions and credits at -those providers, for example: OpenArt, FreePik, etc. +| Provider | Models and workflows | +| ------------ | ----------------------------------------------------------------------------------------------- | +| **ArtCraft** | Images, video, music and sound, 3D meshes, and worlds. Browse the complete model catalog below. | +| Grok | Grok Imagine and Grok Video. | +| Midjourney | Midjourney image generation. | +| Sora | Sora 1, Sora 2, and GPT Image 1. | +| World Labs | Marble world generation with Gaussian splats. | + +
+ArtCraft: the full 62-model catalog + + + +† Currently disabled. ‡ Restricted model; not currently available in the desktop app. + +#### Images (16) + +| Family | Models | +| ----------- | ----------------------------------------------------------------------------------- | +| Nano Banana | Nano Banana; Nano Banana 2; Nano Banana Pro | +| GPT Image | GPT Image 1.5; GPT Image 2; GPT Image 2.5 Flare; GPT Image 2.5 Sunburst | +| FLUX | FLUX.1 [dev]; FLUX.1 [schnell]; FLUX 1.1 [pro]; FLUX 1.1 [pro] ultra | +| Seedream | Seedream 4; Seedream 4.5; Seedream 5 Lite; Seedream 5.0 Pro; Seedream 5.0 Pro Ultra | + +#### Video (25) + +| Family | Models | +| -------- | ----------------------------------------------------------------------------------------------------------------------------- | +| Seedance | Seedance 1.0 Lite †; Seedance 1.5 Pro; Seedance 2.0 | +| Kling | Kling 1.6 Pro; Kling 2.1 Pro †; Kling 2.1 Master †; Kling 2.5 Turbo Pro; Kling 2.6 Pro; Kling 3.0 Pro †; Kling 3.0 Standard † | +| Veo | Veo 2 †; Veo 3 †; Veo 3 Fast; Veo 3.1; Veo 3.1 Fast; Veo 3.1 Lite | +| Sora | Sora 2 †; Sora 2 Pro † | +| Vidu | Vidu Q3; Vidu Q3 Turbo | +| MiniMax | MiniMax H3; MiniMax H3 Turbo ‡; MiniMax H3 Ultra ‡ | +| Flux | Flux 3; Flux 3 Draft | + +#### Music and sound (5) + +| Family | Models | +| ---------- | ------------------------------------------------ | +| Suno | Suno Music; Suno Remix; Suno Sounds; Suno Sample | +| Seed Audio | Seed Audio 1.0 | + +#### 3D meshes (11) + +| Family | Models | +| ---------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------- | +| Hunyuan 3D | Hunyuan 3D 2.0; Hunyuan 3D 2.1; Hunyuan 3D 3; Hunyuan 3D 3 Sketch; Hunyuan 3D 3.1 Pro; Hunyuan 3D 3.1 Rapid; Hunyuan 3D 3.1 Part; Hunyuan 3D 3.1 Smart Topology | +| Tripo3D | Tripo3D H3.1 | +| Meshy | Meshy 6 | +| Rodin | Rodin 2.5 Fast | + +#### Worlds and Gaussian splats (5) + +| Family | Models | +| ---------- | --------------------------------------------------------- | +| Marble | Marble 1.0; Marble 1.0 Draft; Marble 1.1; Marble 1.1 Plus | +| TripoSplat | TripoSplat | + +
+ +Additional provider integrations are planned for Kling, Google, Runway, and Luma. We're also interested in supporting existing subscriptions with aggregators such as OpenArt and Freepik. ## Downloads -- [Visit our website for the stable Windows and MacOS releases](https://getartcraft.com/) -- Or you can grab a [more recent Windows and MacOS build directly](https://github.com/storytold/artcraft/releases) -- Linux requires building from source for now +- [Stable releases for Windows and macOS](https://getartcraft.com/) +- [Latest builds on GitHub](https://github.com/storytold/artcraft/releases) +- [Build from source](./_docs/dev_setup.md), including Linux ## Documentation -- [developer documentation](./_docs) -- [tools, scripts, misc](./script) -- [license](./LICENSE.md) -- [roadmap](./ROADMAP.md) - +- [Development setup](./_docs/dev_setup.md) +- [Developer documentation](./_docs) +- [Desktop build and development scripts](./script/artcraft) +- [Roadmap](./ROADMAP.md) +- [License](./LICENSE.md)