Open WebUI on AWS by FOSSonCloud
Ordinary Experts · Software Development
Certification per AWS Marketplace.
Evidence tier Source Confirmed · 4 captures on record
What the publisher says
As described on AWS Marketplace.
Open WebUI on AWS provides a production-ready deployment of Open WebUI with vLLM for GPU-accelerated large language model inference.
KEY FEATURES
Show the rest of the publisher’s description (39 more lines)
- Open WebUI Interface - Modern, ChatGPT-style web interface for interacting with LLMs
- vLLM Backend - High-performance inference server with OpenAI-compatible API
- Flexible Model Support - Pre-tested models including Qwen 2.5 Coder (7B/14B/32B), Microsoft Phi-4, and NVIDIA Nemotron reasoning models
- GPU-Optimized - Runs on NVIDIA L4 (G6) and L40S (G6e) instances for cost-optimized or performance-optimized deployments
- Secure by Default - HTTPS via ALB, private VPC networking, and AWS Secrets Manager for credential management
- Persistent Storage - EBS-backed data volume survives instance replacements
- Developer Ready - OpenAI-compatible API works with tools like aider, LangChain, and any OpenAI SDK
SUPPORTED MODELS
- Qwen/Qwen2.5-Coder-7B-Instruct (coding, recommended for development)
- Qwen/Qwen2.5-Coder-14B-Instruct, Qwen/Qwen2.5-Coder-32B-Instruct (larger coding models)
- microsoft/phi-4 (general purpose, 14B)
- microsoft/Phi-4-mini-reasoning (fast reasoning, 3.8B)
- nvidia/OpenReasoning-Nemotron-7B/14B/32B (reasoning models)
- Custom models via ModelOverride parameter
INFRASTRUCTURE
CloudFormation deploys: VPC (or uses existing), Application Load Balancer with ACM certificate, Auto Scaling Group with GPU instance, Route53 DNS record, CloudWatch Logs, EBS
persistent storage with automated backups, and AWS Secrets Manager integration.
IAM PERMISSIONS
EC2 Instance Role permissions:
- AmazonSSMManagedInstanceCore - Systems Manager Session Manager access
- CloudWatch Logs/Metrics - Stream logs and publish custom metrics
- EC2 Volume Operations - Attach persistent EBS data volume
- Secrets Manager - Manage application secrets (WEBUI_SECRET_KEY)
- SSM Parameter Store - Read optional custom configuration
Lambda Role (subnet-to-AZ mapping):
- AWSLambdaBasicExecutionRole - CloudWatch Logs access
- ec2:DescribeSubnets - Determine AZ for EBS volume placement
All IAM roles follow least-privilege principles.
EXTERNAL CONNECTIONS
This product connects to external services during deployment and operation:
- Hugging Face (huggingface.co): Downloads the selected LLM model on first instance boot. Model sizes range from 4GB to 60GB depending on selection.
- No customer data is transmitted to external services.
- All inference is performed locally on the EC2 instance.
GETTING STARTED
- Launch the CloudFormation stack with your DNS and certificate details
- Wait for deployment (model download takes 10-60 minutes depending on size)
- Access Open WebUI at your configured hostname
- Create your admin account on first login
- Generate API keys in Settings > Account for external tool integration
Highlights
Highlighted by the publisher on AWS Marketplace.
GPU-Accelerated Inference - Run LLMs on NVIDIA L4/L40S GPUs with vLLM for production-grade throughput and low latency
Open WebUI Interface - Modern chat interface with conversation history, model switching, user management, and API key generation
OpenAI-Compatible API - Integrate with existing tools like aider, LangChain, Continue.dev, or any OpenAI SDK client
Agent build and provenance
See the full provenance
The layer-by-layer build, the evidence behind each claim, the risk basis and the cross-marketplace links are open to any account. Some rows are disclosed, some the source leaves Unknown; a free account shows you which.
Plans and pricing as listed
32 listed- Hrs
- Hrs
- Hrs
- Hrs
- Hrs
- Hrs
- Hrs
- Hrs
- Hrs
- Hrs
- Hrs
- Hrs
Refund terms
As stated by the publisher on AWS Marketplace.
We do not currently support refunds, but you can cancel at any time.
Sources
Linked repositories
1 repoUnknown means this listing does not publish a repository. It is not a statement that the code is closed, and a linked repository is not a claim that the publisher wrote it: the registry computes that relationship privately and does not publish it.
Evidence risk is the share of the build you cannot see before you deploy, not a security rating. Sign in to see the layer-by-layer basis for this band.

