DROPGoogle launches Gemini 3.8 Flash TTS and Flash-Lite TTS///DROPGemini Omni brings 1080p generation to Google Vids///BREAKClaude Opus 5.5 is here: 1M context, $4 input / $20 output///BREAKOpenAI adds GPT-6 Sol and Luna to the GPT-6 family///PAPEROpus 5.5's system card documents gains—and evaluation limits///BREAKGrok 4.7 launches at $2 input / $6 output per million tokens///DROPGrok Voice Transcribe 2.0 targets difficult real-world audio///TRENDGoogle steers new Gemini API projects to 3.8 Flash or 3.5 Flash-Lite///DROPGoogle launches Gemini 3.8 Flash TTS and Flash-Lite TTS///DROPGemini Omni brings 1080p generation to Google Vids///BREAKClaude Opus 5.5 is here: 1M context, $4 input / $20 output///BREAKOpenAI adds GPT-6 Sol and Luna to the GPT-6 family///PAPEROpus 5.5's system card documents gains—and evaluation limits///BREAKGrok 4.7 launches at $2 input / $6 output per million tokens///DROPGrok Voice Transcribe 2.0 targets difficult real-world audio///TRENDGoogle steers new Gemini API projects to 3.8 Flash or 3.5 Flash-Lite///
DARC.DEV
All guides
ChecklistLevel · Build#Local AI#Privacy#Deployment

Local AI without hidden cloud dependencies

A practical deployment audit for Ollama, LM Studio and Open WebUI: model weights, embeddings, network tools, API exposure and maintenance.

DCDariusz Czechowicz23 Sept 20263 min readPractical guide
Local AI without hidden cloud dependencies
Source-checked Sources & corrections
4 practical sections · checklist · sources

Practical guide. Provider claims are attributed to the sources below. This page does not claim a new independent DARC benchmark.

For: Builders who need control over where data is processed

Before you start: A machine with sufficient RAM/VRAM · An approved model license

⚡ TL;DR — the 30-second version

  • Audit embeddings and tools as well as inference.
  • Plan full memory requirements, not just active parameters.
  • Test offline behavior and secure the serving endpoint.

Running a model on your own machine can keep inference local, but a document assistant may still call a cloud embedding service, a search API or a remote tool. Modern local-model products also expose cloud options. Audit the whole path from file ingestion to output.

The current Ollama docs explicitly distinguish local and cloud models. LM Studio exposes local APIs and MCP integrations. Open WebUI's air-gapped guidance lists the functions that still require external services. These are useful starting points for a deployment checklist.

“Local inference is a location. Privacy is a property of the entire workflow.”
— Editorial interpretation

Field guide / 01

01 / Inventory every network dependency

List model downloads, runtime updates, embeddings, rerankers, authentication, telemetry, web search and tool servers. Mark which are used during setup and which are used for every request. A one-time model download is different from uploading every document for embedding.

Repeat the exercise after adding plugins. A previously local workflow can change when a convenient connector is enabled.

Field guide / 02

02 / Budget weights and working memory

Estimate raw weight memory from parameter count and precision, then add runtime overhead and context state. Quantization reduces weight storage but does not remove KV cache or concurrency costs. An active-parameter count for an MoE model is not its full storage requirement.

Use the Lab memory estimator as a lower-bound planning tool, not a fit guarantee. Confirm with the runtime's actual loaded-memory measurement before committing to hardware.

Field guide / 03

03 / Secure the local API

Verify the bind address and authentication before making inference available to another device. An unauthenticated server on a trusted-looking network can still be reached by malicious local software or an overly broad network rule.

Separate ordinary users from model-management and administrative operations. Test whether an untrusted caller can download models, alter prompts or access another user's documents.

Field guide / 04

04 / Test offline and plan updates

Disconnect outbound access in a test environment and run representative tasks. Document which fail and why. Do not label the setup air-gapped if it requires a cloud model, remote search or external identity service for the core workflow.

Keep model/license versions, backup rules and a runtime update process. Local control includes the obligation to patch the software and delete data when it is no longer needed.

Before you ship

0/5

Use this as a review aid. Checks reset when you leave this page.

Put it into practiceEstimate model memory requirements

Sources & verification

Last checked 23 Sept 2026. Publication dates and access conditions belong to the linked originals.

  1. 01Ollama — local and cloud models, API and integrationsOllama↗
  2. 02LM Studio — local APIs and SDKsLM Studio↗
  3. 03Open WebUI — offline operation and network boundariesOpen WebUI↗
  4. 04Qwen3.8-Flash-Next official model cardQwen↗
Editorial policy and correction log →
#Local AI#Privacy#Deployment