diffusers

$npx mdskill add mkurman/zorai/diffusers

Generate and edit images using Stable Diffusion, Flux, or SDXL.

  • Creates photorealistic images from text prompts or existing images.
  • Depends on HuggingFace Diffusers library and PyTorch runtime.
  • Executes models based on requested operations like inpainting or super-resolution.
  • Delivers rendered images as output files or data structures.

SKILL.md

.github/skills/diffusersView on GitHub ↗
---
name: diffusers
description: "HuggingFace Diffusers library for diffusion models: text-to-image, image-to-image, inpainting, super-resolution. Supports Stable Diffusion, Flux, SDXL, and custom pipelines."
tags: [diffusers, stable-diffusion, text-to-image, image-generation, huggingface, pytorch, zorai]
---

## Overview

HuggingFace Diffusers provides diffusion models for text-to-image, image-to-image, inpainting, and super-resolution. Supports Stable Diffusion, Flux, and SDXL with full pipeline customization.

## Installation

```bash
uv pip install diffusers transformers accelerate
```

## Text-to-Image

```python
from diffusers import StableDiffusionPipeline
import torch

pipe = StableDiffusionPipeline.from_pretrained(
    "runwayml/stable-diffusion-v1-5",
    torch_dtype=torch.float16,
).to("cuda")

image = pipe("a photo of a cat wearing a space suit").images[0]
image.save("cat_astronaut.png")
```

## SDXL

```python
from diffusers import DiffusionPipeline

pipe = DiffusionPipeline.from_pretrained(
    "stabilityai/stable-diffusion-xl-base-1.0",
    torch_dtype=torch.float16,
).to("cuda")

image = pipe(prompt="a cinematic shot of a mountain", num_inference_steps=30).images[0]
```

## Inpainting

```python
from diffusers import StableDiffusionInpaintPipeline

pipe = StableDiffusionInpaintPipeline.from_pretrained(
    "runwayml/stable-diffusion-v1-5", torch_dtype=torch.float16,
).to("cuda")

image = pipe(prompt="cat", image=init_image, mask_image=mask_image).images[0]
```

## Workflow

1. Install with uv pip install diffusers
2. Choose pipeline: StableDiffusionPipeline, StableDiffusionXLPipeline, FluxPipeline
3. Load model with .from_pretrained(model_id)
4. Generate with pipe(prompt).images[0]
5. Customize: num_inference_steps, guidance_scale, negative_prompt
6. Save with .save() or convert to PIL for further processing

More from mkurman/zorai

SkillDescription
account-management>
agile-scrum>
albumentationsFast image augmentation library (Albumentations). 70+ transforms for classification, segmentation, object detection, keypoints, and pose estimation. Optimized OpenCV-based pipeline with unified API across all CV tasks. Supports images, masks, bounding boxes, and keypoints simultaneously. Note: classic Albumentations (MIT) is no longer maintained; successor AlbumentationsX uses AGPL-3.0. For torchvision-native augmentations, use torchvision.transforms.v2.
aml-complianceAnti-Money Laundering (AML) and Know Your Customer (KYC) compliance workflow. Sanctions screening, PEP detection, transaction monitoring, suspicious activity reporting (SAR), and OFAC compliance.
anki-connectThis skill is for interacting with Anki through AnkiConnect, and should be used whenever a user asks to interact with Anki, including to read or modify decks, notes, cards, models, media, or sync operations.
approval-checkpoint-long-taskCanonical long-task pack for daemon-managed work with deliberate approval checkpoints, status summaries, rollback notes, and mobile-safe governance-aware updates.
auditing-goal-artifactsUse when reviewing recent zorai goal run outputs, closure markers, ledgers, or evidence bundles to judge whether completion is credible or to identify remaining uncertainty.
autogenAutoGen (Microsoft) — multi-agent conversation framework. Agent-to-agent chat, code generation & execution, tool use, group chat, and human-in-the-loop. Build collaborative AI systems with specialized agents.
backtraderPython backtesting framework for trading strategies. Data feeds, brokers, analyzers, and live trading support. Strategy development with commission models, slippage, and signal-based execution.
beautiful-mermaidRender Mermaid diagrams as SVG and PNG using the Beautiful Mermaid library. Use when the user asks to render a Mermaid diagram.