Docs
search
⌘Ctrlk
Try It!myAgents+Smarter AISupportRoadmap
Docs
  • bolt-automyAgents+
  • πŸ’² Pricing+ (50% off!) πŸ’²arrow-up-right
  • rocket-launchSmarter AI
  • ⚑ Take Back Control ⚑
  • lightbulb-onHiring | Join Us!
  • 🚫 NO to War/Genocide
  • 🚫 NO Local Files Destroyedarrow-up-right
  • 🚫 NO LLM Telemetry Out
  • 🚫 NO Prompt Leakage
  • 🚫 NO Coding | Secured
  • πŸƒ 100% GREEN Datacenter
  • πŸƒ 100% GREEN AI APIsarrow-up-right
  • πŸƒ 100% GREEN Apps
  • πŸƒ 100% GREEN Commitment
  • βœ… EARN Carbon Cash
  • βœ… EARN Monetize Agents
  • βœ… Embed Anywhere
  • βœ… Connect Everything
  • ⚑ Agent Templates
  • ⚑ HIPAA SOC2 PCI DSS
  • ⚑ Humans-in-the-Loop
  • ⚑ Compliant Subprocessors
  • ⚑ End2End Agent Verifier
  • ⚑ End2End Security
  • ⚑ End2End Guardrails
  • ⚑ End2End Tested
  • ⚑ End2End Bias Protected
  • ⚑ End2End Responsible AI
  • serverPlatform+
    • myAgents+
    • Smarter AI+
    • About
    • Take Back Control
    • We Support Humanity
    • No To War/Genocide
    • OpenAI Usage
    • Green AI Datacenter
    • We Help Climate!
    • Responsible AI
    • Subprocessors
    • Earn Carbon Cash
    • Productivity+
    • Privacy+
    • Security+
    • 100% Working Software!
    • Build Custom AI SaaS
    • AI Knowledge+
      • fingerprint...unique features!
      • userReal Humans-in-the-Loop (HITL)
      • u...agents use-cases
      • plus...learn more
      • rectangle-terminal...AI prompt secret!
      • cloud-rainbow...GOLD standard prompt
      • hand...STOP AI hallucinationarrow-up-right
      • hHumansintheloop.orgarrow-up-right
      • questionWhy Cloud & NOT Local-Only AI Workspaces?arrow-up-right
      • left-from-bracketSystem Prompt Leakagearrow-up-right
      • user-ninjaGPT Data Thiefarrow-up-right
      • sSwiss public bodies to avoid using hyperscale clouds and SaaS services due to security concernsarrow-up-right
      • AI Economical Impact (HITL)arrow-up-right
      • AI Agents in Finance (perspective)
      • AI Scaling (coin flip!)arrow-up-right
      • Small Language Modelsarrow-up-right
      • SLM Paper (Cornell U)arrow-up-right
      • Unicorn or Rabbit?arrow-up-right
      • Local LLMs
        • up-right-and-down-left-from-center...why 256k Context?
        • server...Ollamaarrow-up-right
        • m...Mixtral 8x7B
        • d...Dockerarrow-up-right
        • c...CDNarrow-up-right
      • 5Top 5 AI Papers
      • pOur AI Papers
    • User Guides+arrow-up-right
    • Opensource+
    • Affiliates+
    • Pricing+ (50% off!)arrow-up-right
    • Cloud Deploy
    • Contracting+
    • Book-a-Callarrow-up-right
    • Systems Uptime Statusarrow-up-right
    • Roadmap | Changelogarrow-up-right
    • Supportarrow-up-right
  • diamonds-4Affiliates+
  • shield-checkPrivacy+
  • rssNews+
  • gearHire Usarrow-up-right
  • circle-userAbout
  • circle-userTeam
  • paper-planeContact Usarrow-up-right
  • calendar-plusBook-a-Callarrow-up-right
  • product-huntProduct Huntarrow-up-right
  • youtubeYouTubearrow-up-right
  • linkedinLinkedInarrow-up-right
  • githubGithubarrow-up-right
  • πŸ₯° Support Us! πŸ₯° arrow-up-right
gitbookPowered by GitBook
block-quoteOn this pagechevron-down
  1. serverPlatform+chevron-right
  2. AI Knowledge+

Local LLMs

🟒 Smarter AI 🟒

up-right-and-down-left-from-center...why 256k Context?chevron-rightserver...Ollamachevron-rightm...Mixtral 8x7Bchevron-rightd...Dockerchevron-rightc...CDNchevron-right
PreviousAI Agents in Finance (perspective)chevron-leftNext...why 256k Context?chevron-right