OpenWebUI¶

OpenWebUI provides a feature-rich web interface for interacting with large language models, similar to ChatGPT but self-hosted.

Features¶

• Chat interface with conversation history
• Multiple model support
• Document upload and RAG capabilities
• User management and authentication
• Customizable system prompts
• API access for integrations

Architecture¶

The OpenWebUI deployment includes:

Prerequisites¶

• Foundation complete
• DNS record for OpenWebUI
• Reverse proxy configured

System Requirements¶

Installation¶

Deploy VM¶

From tappaas-cicd:

cd ~/TAPPaaS/src/apps/openwebui
./install.sh

DNS Configuration¶

Add DNS record:

Reverse Proxy¶

Configure Caddy in OPNsense:

chat.yourdomain.com {
    reverse_proxy openwebui.mgmt.internal:8080
}

Configuration¶

Initial Setup¶

Access OpenWebUI at https://chat.yourdomain.com

1. Create admin account on first access
2. Configure authentication settings
3. Add LLM connections

Connect to LiteLLM¶

Configure OpenWebUI to use LiteLLM as backend:

1. Navigate to Settings → Connections
2. Add OpenAI-compatible endpoint:
3. URL: http://litellm.mgmt.internal:4000/v1
4. API Key: Your LiteLLM master key

Connect to Ollama¶

For local models via Ollama:

1. Navigate to Settings → Connections
2. Add Ollama endpoint:
3. URL: http://ollama.mgmt.internal:11434

User Management¶

Create Users¶

1. Navigate to Admin → Users
2. Click Add User
3. Set username, email, and role

Roles¶

Backup¶

Automated backups are configured for:

Manual Backup¶

# Backup PostgreSQL
pg_dump -U openwebui openwebui > backup.sql

# Backup Redis
redis-cli BGSAVE

Maintenance¶

View Logs¶

# OpenWebUI logs
podman logs openwebui

# PostgreSQL logs
journalctl -u postgresql

Update¶

To update OpenWebUI:

cd ~/TAPPaaS/src/apps/openwebui
./update.sh

Troubleshooting¶

Cannot Connect to LLM¶

• Verify LiteLLM/Ollama is running
• Check network connectivity
• Verify API key is correct
• Check firewall rules

Slow Performance¶

• Increase VM resources
• Check Redis caching status
• Review PostgreSQL performance

Authentication Issues¶

• Verify user credentials
• Check authentication provider settings
• Review application logs

Security Notes¶

Next Steps¶

• Configure LiteLLM for multi-provider access
• Add local models with Ollama