124 lines
3.7 KiB
Markdown
124 lines
3.7 KiB
Markdown
|
|
# ComfyUI Docker Setup with GGUF Support and ComfyUI Manager
|
|
|
|
This guide provides detailed steps to build and run **ComfyUI** with **GGUF support** and **ComfyUI Manager** using Docker. The GGUF format is optimized for quantized models, and ComfyUI Manager is included for easy node management.
|
|
|
|
## Prerequisites
|
|
|
|
Before starting, ensure you have the following installed on your system:
|
|
|
|
- **Docker**
|
|
- **NVIDIA GPU with CUDA support** (if using GPU acceleration)
|
|
- **Create Directory structure for git repo Models and Checkpoints**
|
|
|
|
```bash
|
|
mkdir -p ~/dev-ai/vison/models/checkpoints
|
|
```
|
|
|
|
### 1. Clone the ComfyUI Repository
|
|
|
|
First, navigate to `~/dev-ai/vison` directory and clone the ComfyUI repository to your local machine:
|
|
|
|
```bash
|
|
cd ~/dev-ai/vison
|
|
```
|
|
|
|
```bash
|
|
git clone https://github.com/comfyanonymous/ComfyUI.git
|
|
cd ComfyUI
|
|
```
|
|
|
|
### 2. Create the Dockerfile
|
|
|
|
Copy the provided `Dockerfile` in the root of your ComfyUI directory. This file contains the necessary configurations for building the Docker container with GGUF support.
|
|
|
|
### 3. Build the Docker Image
|
|
|
|
```bash
|
|
docker build -t comfyui-gguf:latest .
|
|
```
|
|
|
|
This will create a Docker image named `comfyui-gguf:latest` with both **ComfyUI Manager** and **GGUF support** built in.
|
|
|
|
### 4. Run the Docker Container
|
|
|
|
Once the image is built, you can run the Docker container with volume mapping for your models.
|
|
|
|
```bash
|
|
docker run --name comfyui -p 8188:8188 --gpus all \
|
|
-v /home/mukul/dev-ai/vison/models:/app/models \
|
|
-d comfyui-gguf:latest
|
|
```
|
|
|
|
This command maps your local `models` directory to `/app/models` inside the container and exposes ComfyUI on port `8188`.
|
|
|
|
### 5. Download and Place Checkpoint Models
|
|
|
|
Download and place your civitai checkpoint models in the `checkpoints` directory inside the container:
|
|
https://civitai.com/models/139562/realvisxl-v50
|
|
|
|
To use GGUF models or other safetensor models, follow the steps below to download them directly into the `checkpoints` directory.
|
|
|
|
1. **Navigate to the Checkpoints Directory**:
|
|
```bash
|
|
cd /home/mukul/dev-ai/vison/models/checkpoints
|
|
```
|
|
|
|
2. **Download `flux1-schnell-fp8.safetensors`**:
|
|
```bash
|
|
wget https://huggingface.co/Comfy-Org/flux1-schnell/resolve/main/flux1-schnell-fp8.safetensors?download=true -O flux1-schnell-fp8.safetensors
|
|
```
|
|
|
|
3. **Download `flux1-dev-fp8.safetensors`**:
|
|
```bash
|
|
wget https://huggingface.co/Comfy-Org/flux1-dev/resolve/main/flux1-dev-fp8.safetensors?download=true -O flux1-dev-fp8.safetensors
|
|
```
|
|
|
|
These commands will place the corresponding `.safetensors` files into the `checkpoints` directory.
|
|
|
|
### 6. Access ComfyUI
|
|
|
|
After starting the container, access the ComfyUI interface in your web browser:
|
|
|
|
```bash
|
|
http://<your-server-ip>:8188
|
|
```
|
|
|
|
Replace `<your-server-ip>` with your server's IP address or use `localhost` if you're running it locally.
|
|
|
|
### 7. Using GGUF Models
|
|
|
|
In the ComfyUI interface:
|
|
- Use the **UnetLoaderGGUF** node (found in the `bootleg` category) to load GGUF models.
|
|
- Ensure your GGUF files are correctly named and placed in the `/app/models/checkpoints` directory for detection by the loader node.
|
|
|
|
### 8. Managing Nodes with ComfyUI Manager
|
|
|
|
With **ComfyUI Manager** built into the image:
|
|
- **Install** missing nodes as needed when uploading workflows.
|
|
- **Enable/Disable** conflicting nodes from the ComfyUI Manager interface.
|
|
|
|
### 9. Stopping and Restarting the Docker Container
|
|
|
|
To stop the running container:
|
|
|
|
```bash
|
|
docker stop comfyui
|
|
```
|
|
|
|
To restart the container:
|
|
|
|
```bash
|
|
docker start comfyui
|
|
```
|
|
|
|
### 10. Logs and Troubleshooting
|
|
|
|
To view the container logs:
|
|
|
|
```bash
|
|
docker logs comfyui
|
|
```
|
|
|
|
This will provide details if anything goes wrong or if you encounter issues with GGUF models or node management.
|