Docs
search
Ctrlk
Try It!myAgents+Smarter AISupportRoadmap
  • bolt-automyAgents+
  • πŸ’² Pricing+ (50% off!) πŸ’²arrow-up-right-from-square
  • rocket-launchSmarter AIchevron-right
  • ⚑ Take Back Control ⚑arrow-up-right-from-square
  • lightbulb-onHiring | Join Us!arrow-up-right-from-square
  • 🚫 NO to War/Genocidearrow-up-right-from-square
  • 🚫 NO LLM Telemetry Outarrow-up-right-from-square
  • 🚫 NO Prompt Leakagearrow-up-right-from-square
  • 🚫 NO Codingarrow-up-right-from-square
  • πŸƒ 100% GREEN Datacenterarrow-up-right-from-square
  • πŸƒ 100% GREEN AI APIsarrow-up-right-from-square
  • πŸƒ 100% GREEN Appsarrow-up-right-from-square
  • πŸƒ 100% GREEN Commitmentarrow-up-right-from-square
  • βœ… EARN Carbon Casharrow-up-right-from-square
  • βœ… EARN Monetize Agentsarrow-up-right-from-square
  • βœ… Embed Anywherearrow-up-right-from-square
  • βœ… Connect Everythingarrow-up-right-from-square
  • ⚑ HIPAA SOC2 PCI DSSarrow-up-right-from-square
  • ⚑ Humans-in-the-Looparrow-up-right-from-square
  • ⚑ Compliant Subprocessorsarrow-up-right-from-square
  • ⚑ End2End Agent Verifierarrow-up-right-from-square
  • ⚑ End2End Securityarrow-up-right-from-square
  • ⚑ End2End Guardrailsarrow-up-right-from-square
  • ⚑ End2End Testedarrow-up-right-from-square
  • ⚑ End2End Bias Protectedarrow-up-right-from-square
  • ⚑ End2End Responsible AIarrow-up-right-from-square
  • serverPlatform+chevron-right
    • myAgents+arrow-up-right-from-square
    • Smarter AI+arrow-up-right-from-square
    • Aboutchevron-right
    • Take Back Controlarrow-up-right-from-square
    • We Support Humanityarrow-up-right-from-square
    • No To War/Genocidechevron-right
    • OpenAI Usage
    • Green AI Datacenterarrow-up-right-from-square
    • We Help Climate!chevron-right
    • Responsible AIarrow-up-right-from-square
    • Subprocessorschevron-right
    • Earn Carbon Cash
    • Productivity+arrow-up-right-from-square
    • Privacy+arrow-up-right-from-square
    • Security+chevron-right
    • 100% Working Software!arrow-up-right-from-square
    • Build Custom AI SaaSarrow-up-right-from-square
    • AI Knowledge+chevron-right
      • fingerprint...unique features!arrow-up-right-from-square
      • userReal Humans-in-the-Loop (HITL)arrow-up-right-from-square
      • u...agents use-casesarrow-up-right-from-square
      • plus...learn morearrow-up-right-from-square
      • rectangle-terminal...AI prompt secret!
      • cloud-rainbow...GOLD standard prompt
      • hand...STOP AI hallucinationarrow-up-right-from-square
      • hHumansintheloop.orgarrow-up-right-from-square
      • questionWhy Cloud & NOT Local-Only AI Workspaces?arrow-up-right-from-square
      • left-from-bracketSystem Prompt Leakagearrow-up-right-from-square
      • user-ninjaGPT Data Thiefarrow-up-right-from-square
      • sSwiss public bodies to avoid using hyperscale clouds and SaaS services due to security concernsarrow-up-right-from-square
      • AI Economical Impact (HITL)arrow-up-right-from-square
      • AI Agents in Finance (perspective)
      • AI Scaling (coin flip!)arrow-up-right-from-square
      • Small Language Modelsarrow-up-right-from-square
      • SLM Paper (Cornell U)arrow-up-right-from-square
      • Unicorn or Rabbit?arrow-up-right-from-square
      • Local LLMschevron-right
        • up-right-and-down-left-from-center...why 256k Context?
        • server...Ollamaarrow-up-right-from-square
        • m...Mixtral 8x7B
        • d...Dockerarrow-up-right-from-square
        • c...CDNarrow-up-right-from-square
      • 5Top 5 AI Papers
      • pOur AI Papers
    • User Guides+arrow-up-right-from-square
    • Opensource+chevron-right
    • Affiliates+arrow-up-right-from-square
    • Pricing+ (50% off!)arrow-up-right-from-square
    • Cloud Deploychevron-right
    • Contracting+arrow-up-right-from-square
    • Book-a-Callarrow-up-right-from-square
    • Systems Uptime Statusarrow-up-right-from-square
    • Roadmap | Changelogarrow-up-right-from-square
    • Supportarrow-up-right-from-square
  • diamonds-4Affiliates+
  • shield-checkPrivacy+chevron-right
  • rssNews+chevron-right
  • gearHire Usarrow-up-right-from-square
  • circle-userAboutarrow-up-right-from-square
  • circle-userTeamarrow-up-right-from-square
  • paper-planeContact Usarrow-up-right-from-square
  • calendar-plusBook-a-Callarrow-up-right-from-square
  • product-huntProduct Huntarrow-up-right-from-square
  • youtubeYouTubearrow-up-right-from-square
  • linkedinLinkedInarrow-up-right-from-square
  • githubGithubarrow-up-right-from-square
  • πŸ₯° Support Us! πŸ₯° arrow-up-right-from-square
gitbookPowered by GitBook
block-quoteOn this pagechevron-down
  1. serverPlatform+chevron-right
  2. AI Knowledge+

Local LLMs

🟒 Smarter AI 🟒

up-right-and-down-left-from-center...why 256k Context?chevron-rightserver...Ollamachevron-rightm...Mixtral 8x7Bchevron-rightd...Dockerchevron-rightc...CDNchevron-right
PreviousAI Agents in Finance (perspective)chevron-leftNext...why 256k Context?chevron-right