WRITING

ComfyUI: generating AI images step by step instead of praying to the prompt

ComfyUI is an open-source application for generating images, video and audio with AI by connecting nodes on a canvas. Why its way of working interests me more than the results.

There are two ways to use AI to create images.

Write a sentence and hope it comes out right.

Or understand each step and control it.

What it is

ComfyUI is an open-source application for generating images, video and audio with diffusion models. Instead of a text box, it gives you a canvas of nodes: one loads the model, another takes the text, another generates, another saves. You connect them with cables, like a modular synthesiser.

Workflows are saved as files you can share, version and run again. You can use it from the interface or through its API. And it runs on your own computer if you have a suitable graphics card.

Why I find it interesting

Not because of the images. Because of the way of working.

Most AI tools hide the process: you type, something comes out and, if you don't like it, you try again. That's fine for playing. For real work it's frustrating, because you don't know what to change to make it better.

ComfyUI does the opposite: it shows you the whole process. If something goes wrong, you know at which step. If something goes right, you can repeat it exactly.

What you can't repeat isn't a process. It's luck.

That idea goes far beyond images. In any line of work, the difference between an amateur and a professional usually isn't talent. It's that the professional can repeat the result.

Who it makes sense for

  • Anyone who needs consistent, repeatable images: product variations, backgrounds, brand styles.
  • Creative teams that want control instead of depending on a closed service.
  • Developers who want to build image generation into their own processes via the API.

Who it doesn't: if you only need an image now and then, the learning curve isn't worth it. A canvas full of nodes is a little intimidating at first.

What to keep in mind

The models you load have their own licences, and not all allow commercial use. Generating images of real people, brands or protected characters raises legal and ethical issues the tool won't solve for you. And the third-party nodes you install are code: only install from sources you trust.

What this repository teaches

That giving users control, even if it's harder at first, creates tools people use for years. Easy hooks people fast. What people understand is what stays.

P.S. Even if you never generate an image, open a ComfyUI workflow and look at it. It's one of the best ways to understand what generative AI actually does inside.