Jan

• Open-source platform for running large language models locally.
• Supports LlamaCPP and MLX-based local inference backends.
• OpenAI-compatible API for application and service integration.
• Fully self-hosted AI inference with no mandatory cloud AI dependency.
• Supports CPU-based local model inference with compatible hardware acceleration.
• Jan CLI provides headless model serving for server and cloud deployments.
• Models can be managed and loaded directly from the Jan data environment.
• Suitable for AI assistants, chatbots, coding agents, and automation workflows.
• Supports integration with AI development tools and applications through its API.
• Suitable for private AI, research, development, testing, and enterprise deployments.
• Can be deployed on virtual machines, dedicated servers, and cloud infrastructure.
• Provides local AI inference while maintaining control over models and application data.

Jan Usage:

$ sudo su

$ cd /tmp

# Check Jan Installation

$ dpkg -l | grep -i jan

$ dpkg-query -W -f='${Package} ${Version} ${Architecture}\n' jan

# Check Jan CLI

$ /usr/lib/Jan/resources/bin/jan-cli --version

# Create Jan CLI Command

$ sudo ln -sf /usr/lib/Jan/resources/bin/jan-cli /usr/local/bin/jan

# Verify Jan CLI

$ which jan

$ jan --version

# Check Available Commands

$ jan --help

Disclaimer:

Jan is an open-source AI software project developed and maintained by the Jan community. Jan and related trademarks belong to their respective owners. This software is not affiliated with or endorsed by any third-party software, operating system, cloud provider, model provider, AI service, or platform mentioned for compatibility, integration, or deployment purposes.