(https://github.githubassets.com) (https://avatars.githubusercontent.com) (https://github-cloud.s3.amazonaws.com) (https://user-images.githubusercontent.com/) (https://github.githubassets.com) (https://avatars.githubusercontent.com)   (https://github.githubassets.com/assets/react-e27d1b3e03961e68.js)  (https://github.githubassets.com/assets/react-compiler-runtime-4610bd6d3de9c049.js)  (https://github.githubassets.com/assets/scheduler-58b860b049ca307c.js)  (https://github.githubassets.com/assets/react-dom-e5fd46a22d5c4058.js)  (https://github.githubassets.com/assets/react-dom-client-1b4a3ee065998cea.js)  (https://github.githubassets.com/assets/react-is-e0b593954b4706d8.js)  (https://github.githubassets.com/assets/react-jsx-runtime-4915cb0f5b3aff04.js)  (https://github.githubassets.com/assets/react-reconciler-8e99e505c4429605.js)  (../../github.githubassets.com/assets/light-99f877e9ddfc0e51.css)  (../../github.githubassets.com/assets/light_high_contrast-48fdd0811afbab3c.css)  (../../github.githubassets.com/assets/dark-79ad2ace604703b3.css)  (../../github.githubassets.com/assets/dark_high_contrast-24484a076f02295f.css)                (../../github.githubassets.com/assets/primer-primitives-ed9ca172356fd545.css)  (../../github.githubassets.com/assets/primer-4136ede8b2650a2d.css)  (../../github.githubassets.com/assets/global-54ba76e934a49d7c.css)  (../../github.githubassets.com/assets/github-7338c07b3a07b8be.css)  (../../github.githubassets.com/assets/repository-11ee8a031c040c1a.css)  (../../github.githubassets.com/assets/code-2d56bdb0166c0238.css)  (https://github.githubassets.com/assets/wp-runtime-3bc4845c5796d329.js)  (https://github.githubassets.com/assets/app-foundation-69691b300d797200.js)  (https://github.githubassets.com/assets/app-runtime-9d34ae1c49571756.js)  (https://github.githubassets.com/assets/fetch-utilities-4b62182bc6e3c348.js)  (https://github.githubassets.com/assets/ser-91fba67ac4479923.js)  (https://github.githubassets.com/assets/tp-18fbcd3be071aa02.js)  (../../github.githubassets.com/assets/app-runtime.c97ea7e7b9bd7544.module.css)  (https://github.githubassets.com/assets/catalyst-86a8f5de995615f8.js)  (https://github.githubassets.com/assets/selector-observer-e88088f989b27670.js)  (https://github.githubassets.com/assets/relative-time-element-fa0968675d128a19.js)  (https://github.githubassets.com/assets/by-6b3c07383371bf58.js)  (https://github.githubassets.com/assets/ja9-36f036c13c2e3a4c.js)  (https://github.githubassets.com/assets/kwb-985b266c34021458.js)  (https://github.githubassets.com/assets/r1-b075aab3204f32f9.js)  (https://github.githubassets.com/assets/jz5-7c5d1669717041f8.js)  (https://github.githubassets.com/assets/hj-5126390ff433704d.js)  (https://github.githubassets.com/assets/j05-1b324859b9512e2d.js)  (https://github.githubassets.com/assets/runtime-helpers-5ca1e1883536e092.js)  (https://github.githubassets.com/assets/aria-live-edd4f18194230d9e.js)  (https://github.githubassets.com/assets/hotkey-5109c77d7ac61078.js)  (https://github.githubassets.com/assets/react-core-682155419c984691.js)  (https://github.githubassets.com/assets/a9-059e9811745f26d7.js)  (https://github.githubassets.com/assets/ur-024971cb63acad59.js)  (https://github.githubassets.com/assets/4t-364e19c63d726e9a.js)  (https://github.githubassets.com/assets/6ny-c969fbae697a356f.js)  (https://github.githubassets.com/assets/yhq-3a209035a30b1a09.js)  (https://github.githubassets.com/assets/z1v-da5b33b877bfa358.js)  (https://github.githubassets.com/assets/wo-8044e1bac6e0c328.js)  (https://github.githubassets.com/assets/9y-cd2a0ff87351e9aa.js)  (https://github.githubassets.com/assets/j0-41a4cf04cbd99503.js)  (https://github.githubassets.com/assets/0p-81491ed0d9d666e2.js)  (../../github.githubassets.com/assets/react-core.4a0933a4f8e47de3.module.css)  (https://github.githubassets.com/assets/n9c-16e227ac48072d2b.js)  (https://github.githubassets.com/assets/ic-991f04433f366e7b.js)  (https://github.githubassets.com/assets/primer-react-266c7f3600a53b8a.js)  (https://github.githubassets.com/assets/ncx-9a860680a5f230b9.js)  (https://github.githubassets.com/assets/j6-363f0ebf4f62f310.js)  (https://github.githubassets.com/assets/t7l-bf6f21d7e7a43c35.js)  (https://github.githubassets.com/assets/4u-3fb51fd5b58f1705.js)  (https://github.githubassets.com/assets/ws-f1530f278b2b86e5.js)  (https://github.githubassets.com/assets/s07-40c12c0b9c65754d.js)  (https://github.githubassets.com/assets/n4u-6317ce1c31aed1db.js)  (https://github.githubassets.com/assets/j8-275aa078fdc35661.js)  (https://github.githubassets.com/assets/la-d2cd96f070e6b52a.js)  (https://github.githubassets.com/assets/wb-7be2a2dbb2126c50.js)  (https://github.githubassets.com/assets/u4s-e1b03c520769e58b.js)  (https://github.githubassets.com/assets/ad7-a8f276eb7d45b3e8.js)  (https://github.githubassets.com/assets/w4-b7e7b91d8bc34ed2.js)  (https://github.githubassets.com/assets/ojg-6604ac9ae112ae6a.js)  (https://github.githubassets.com/assets/gzu-b0e631d87d54c83d.js)  (https://github.githubassets.com/assets/bi0-a78ba744687848c2.js)  (https://github.githubassets.com/assets/on-898389fbf97246b6.js)  (https://github.githubassets.com/assets/b1-a53093be1dda5853.js)  (https://github.githubassets.com/assets/0l5-d2057e622f6442d6.js)  (https://github.githubassets.com/assets/c2z-c10e51960850b47e.js)  (https://github.githubassets.com/assets/f9-038758dcbfe08dab.js)  (https://github.githubassets.com/assets/sp-741a59f220bc8fca.js)  (https://github.githubassets.com/assets/0k-b7df0a74912a42bf.js)  (https://github.githubassets.com/assets/og-72a377e4a14147a1.js)  (https://github.githubassets.com/assets/b9-4fd36ab02c30bf52.js)  (https://github.githubassets.com/assets/ec-cbba6ef3015afe55.js)  (https://github.githubassets.com/assets/dsj-cb1e4ddbce4f007b.js)  (https://github.githubassets.com/assets/du-9695d8032ef894d8.js)  (https://github.githubassets.com/assets/20-0591acfe230f4c33.js)  (https://github.githubassets.com/assets/ql0-d154b9935a526802.js)  (https://github.githubassets.com/assets/wp-9f5235d335ab624b.js)  (https://github.githubassets.com/assets/gc4-2487b0aac2401bb1.js)  (https://github.githubassets.com/assets/uwi-5f891f97d90c7d42.js)  (https://github.githubassets.com/assets/th-5bd53302e6db9640.js)  (https://github.githubassets.com/assets/7cw-bd83282679153bed.js)  (https://github.githubassets.com/assets/1h-21d80ca86288dc09.js)  (https://github.githubassets.com/assets/hrn-4ce15d4b78df776c.js)  (https://github.githubassets.com/assets/8u-60a1b724e3da8ce5.js)  (https://github.githubassets.com/assets/40-0b2be0da8366d3b3.js)  (https://github.githubassets.com/assets/y8-e5d822e97df8fa57.js)  (https://github.githubassets.com/assets/xc-065e7847e4da513d.js)  (https://github.githubassets.com/assets/7o-1da8cccac226f750.js)  (../../github.githubassets.com/assets/primer-react-css.46296dcf75e7a0b0.module.css)  (../../github.githubassets.com/assets/ql0.bdd6be015c087bbc.module.css)  (../../github.githubassets.com/assets/1h.89f839adbc6b191e.module.css)  (../../github.githubassets.com/assets/xc.877a51df9233c9c4.module.css)  (../../github.githubassets.com/assets/7o.472d89161e62ff5e.module.css)  (../../github.githubassets.com/assets/code-view.560fee39da3f7be8.module.css)  (https://github.githubassets.com/assets/75-4f764d8afd9136da.js)  (../../github.githubassets.com/assets/primer-react-css.46296dcf75e7a0b0.module.css)  (../../github.githubassets.com/assets/notifications-subscriptions-menu.66d511713aaeb2dc.module.css)  GitHub - magnitudedev/magnitude: Open source inference engine for agents that optimizes itself for your exact hardware. Compiles and tunes its kernels on your device, so open models run up to 2x faster than llama.cpp. Works on Apple Silicon, NVIDIA, AMD, or nothing but a CPU. · GitHub      (repo_source) (https://github.githubassets.com/)   (https://github.com/opensearch.xml) (GitHub) (https://github.com/fluidicon.png) (GitHub)                        (https://github.githubassets.com/assets/pinned-octocat-093da3e6fa40.svg) (https://github.githubassets.com/favicons/favicon.png) (../../github.githubassets.com/favicons/favicon.svg)  (../manifest.json)   (magnitude.html#start-of-content) Skip to content   (https://github.githubassets.com/assets/l7j-2ddd8b435dadae28.js)  (https://github.githubassets.com/assets/keyboard-shortcuts-dialog-dffe4810a910c406.js)  (../../github.githubassets.com/assets/primer-react-css.46296dcf75e7a0b0.module.css)  (../../github.githubassets.com/assets/keyboard-shortcuts-dialog.9a52dd29cb9104d4.module.css)    (https://github.githubassets.com/assets/pw-4f91498888595802.js)  (https://github.githubassets.com/assets/app-install-banner-partial-7ddeb0ca45c51569.js)  (../../github.githubassets.com/assets/primer-react-css.46296dcf75e7a0b0.module.css)  (../../github.githubassets.com/assets/app-install-banner-partial.847e0c6b35761a2f.module.css)    (https://github.githubassets.com/assets/ak-e62e69106ade8d4b.js)  (https://github.githubassets.com/assets/rwd-f09a89144136eafb.js)  (https://github.githubassets.com/assets/fz5-23f28c0f388769c9.js)  (https://github.githubassets.com/assets/jag-4f408bf2b7f99c87.js)  (https://github.githubassets.com/assets/p1-76a75a6081059b19.js)  (https://github.githubassets.com/assets/3d8-bbc4e3ce35fac150.js)  (https://github.githubassets.com/assets/tua-88f94f65812643db.js)  (https://github.githubassets.com/assets/t1-6f4306b54886c418.js)  (https://github.githubassets.com/assets/marketing-header-68411ca59af258e4.js)  (../../github.githubassets.com/assets/primer-react-css.46296dcf75e7a0b0.module.css)  (../../github.githubassets.com/assets/primer-react-brand-css.05b219cdb8e80c43.module.css)  (../../github.githubassets.com/assets/t1.7eb91edfb3032751.module.css)  Navigation Menu       (https://github.com/)    (https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fmagnitudedev%2Fmagnitude) Sign in         Appearance settings   Platform   AI CODE CREATION (https://github.com/features/copilot)    GitHub Copilot Write better code with AI    (https://github.com/features/ai/github-app)   GitHub Copilot app Direct agents from issue to merge    (https://github.com/mcp)    MCP Registry Integrate external tools       DEVELOPER WORKFLOWS (https://github.com/features/actions)   Actions Automate any workflow    (https://github.com/features/codespaces)    Codespaces Instant dev environments    (https://github.com/features/issues)    Issues Plan and track work    (https://github.com/features/code-review)   Code Review Manage code changes    (https://github.com/features/code-quality)    Code Quality Enforce quality at merge       APPLICATION SECURITY (https://github.com/security/advanced-security)   GitHub Advanced Security Find and fix vulnerabilities    (https://github.com/security/advanced-security/code-security)   Code security Secure your code as you build    (https://github.com/security/advanced-security/secret-protection)   Secret protection Stop leaks before they start       EXPLORE (https://github.com/why-github) Why GitHub   (https://docs.github.com) Documentation     (https://github.blog) Blog     (https://github.blog/changelog) Changelog     (https://github.com/marketplace) Marketplace       (https://github.com/features) View all features         Solutions   BY COMPANY SIZE (https://github.com/enterprise) Enterprises   (https://github.com/team) Small and medium teams   (https://github.com/enterprise/startups) Startups   (https://github.com/solutions/industry/nonprofits) Nonprofits      BY USE CASE (https://github.com/solutions/use-case/app-modernization) App Modernization   (https://github.com/solutions/use-case/devsecops) DevSecOps   (https://github.com/solutions/use-case/devops) DevOps   (https://github.com/solutions/use-case/ci-cd) CI/CD   (https://github.com/solutions/use-case) View all use cases         BY INDUSTRY (https://github.com/solutions/industry/healthcare) Healthcare   (https://github.com/solutions/industry/financial-services) Financial services   (https://github.com/solutions/industry/manufacturing) Manufacturing   (https://github.com/solutions/industry/government) Government   (https://github.com/solutions/industry) View all industries          (https://github.com/solutions) View all solutions         Resources   EXPLORE BY TOPIC (https://github.com/resources/articles?topic=ai) AI   (https://github.com/resources/articles?topic=software-development) Software Development   (https://github.com/resources/articles?topic=devops) DevOps   (https://github.com/resources/articles?topic=security) Security   (https://github.com/resources/articles) View all topics         EXPLORE BY TYPE (https://github.com/customer-stories) Customer stories   (https://github.com/resources/events) Events & webinars   (https://github.com/resources/whitepapers) Ebooks & reports   (https://github.com/solutions/executive-insights) Business insights   (https://skills.github.com) GitHub Skills        SUPPORT & SERVICES (https://docs.github.com) Documentation     (https://support.github.com) Customer support     (https://github.com/orgs/community/discussions) Community forum   (https://github.com/trust-center) Trust center   (https://github.com/partners) Partners       (https://github.com/resources) View all resources         Open Source   COMMUNITY (https://github.com/open-source/sponsors)   GitHub Sponsors Fund open source developers       PROGRAMS (https://securitylab.github.com) Security Lab     (https://maintainers.github.com) Maintainer Community     (https://stars.github.com) GitHub Stars     (https://archiveprogram.github.com) Archive Program        REPOSITORIES (https://github.com/topics) Topics   (https://github.com/trending) Trending   (https://github.com/collections) Collections          Enterprise   ENTERPRISE SOLUTIONS (https://github.com/enterprise)   Enterprise platform AI-powered developer platform       AVAILABLE ADD-ONS (https://github.com/security/advanced-security)   GitHub Advanced Security Enterprise-grade security features    (https://github.com/features/copilot/copilot-business)    Copilot for Business Enterprise-grade AI features    (https://github.com/enterprise/premium-support)   Premium Support Enterprise-grade 24/7 support           (https://github.com/pricing) Pricing      Search /       (https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fmagnitudedev%2Fmagnitude) Sign in    (https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=magnitudedev%2Fmagnitude) Sign up         Appearance settings            You signed in with another tab or window. (magnitude.html) Reload to refresh your session. You signed out in another tab or window. (magnitude.html) Reload to refresh your session. You switched accounts on another tab or window. (magnitude.html) Reload to refresh your session.    Dismiss alert       (https://github.com/magnitudedev) magnitudedev   / (magnitude.html) magnitude   Public   (https://github.com/login?return_to=%2Fmagnitudedev%2Fmagnitude)   Notifications  You must be signed in to change notification settings  (https://github.com/login?return_to=%2Fmagnitudedev%2Fmagnitude)   Fork (397) 397   (https://github.com/login?return_to=%2Fmagnitudedev%2Fmagnitude)   Star  (5,671) 5.7k        (magnitude.html)   Code (Not available)    (https://github.com/magnitudedev/magnitude/issues)    Issues (21) 21   (https://github.com/magnitudedev/magnitude/pulls)   Pull requests (7) 7   (https://github.com/magnitudedev/magnitude/discussions)   Discussions (Not available)    (https://github.com/magnitudedev/magnitude/actions)   Actions (Not available)    (https://github.com/magnitudedev/magnitude/projects)   Projects (Not available)    (https://github.com/magnitudedev/magnitude/security)   Security and quality (0) 0   (https://github.com/magnitudedev/magnitude/pulse)   Insights (Not available)        Additional navigation options (magnitude.html)    Code    (https://github.com/magnitudedev/magnitude/issues)     Issues    (https://github.com/magnitudedev/magnitude/pulls)    Pull requests    (https://github.com/magnitudedev/magnitude/discussions)    Discussions    (https://github.com/magnitudedev/magnitude/actions)    Actions    (https://github.com/magnitudedev/magnitude/projects)    Projects    (https://github.com/magnitudedev/magnitude/security)    Security and quality    (https://github.com/magnitudedev/magnitude/pulse)    Insights                (magnitude.html)          main           (https://github.com/magnitudedev/magnitude/branches)    Branches   (https://github.com/magnitudedev/magnitude/tags)    Tags    (https://github.com/magnitudedev/magnitude/branches)    (https://github.com/magnitudedev/magnitude/tags)          (Go to file) ()      Go to file        Code         Open more actions menu     Latest commit   History (https://github.com/magnitudedev/magnitude/commits/main/)    1,050 Commits     (https://github.com/magnitudedev/magnitude/commits/main/)      1,050 Commits      Folders and files Name  Name  (Last commit message) Last commit message   (Last commit date) Last commit date       (This path skips through empty directories) (https://github.com/magnitudedev/magnitude/tree/main/.agents/skills) .agents/ skills         (This path skips through empty directories) (https://github.com/magnitudedev/magnitude/tree/main/.agents/skills) .agents/ skills               (.changeset) (https://github.com/magnitudedev/magnitude/tree/main/.changeset) .changeset        (.changeset) (https://github.com/magnitudedev/magnitude/tree/main/.changeset) .changeset              (.github) (https://github.com/magnitudedev/magnitude/tree/main/.github) .github        (.github) (https://github.com/magnitudedev/magnitude/tree/main/.github) .github              (assets) (https://github.com/magnitudedev/magnitude/tree/main/assets) assets        (assets) (https://github.com/magnitudedev/magnitude/tree/main/assets) assets              (cli) (https://github.com/magnitudedev/magnitude/tree/main/cli) cli        (cli) (https://github.com/magnitudedev/magnitude/tree/main/cli) cli              (design) (https://github.com/magnitudedev/magnitude/tree/main/design) design        (design) (https://github.com/magnitudedev/magnitude/tree/main/design) design              (desktop) (https://github.com/magnitudedev/magnitude/tree/main/desktop) desktop        (desktop) (https://github.com/magnitudedev/magnitude/tree/main/desktop) desktop              (docs) (https://github.com/magnitudedev/magnitude/tree/main/docs) docs        (docs) (https://github.com/magnitudedev/magnitude/tree/main/docs) docs              (inference-v2) (https://github.com/magnitudedev/magnitude/tree/main/inference-v2) inference-v2        (inference-v2) (https://github.com/magnitudedev/magnitude/tree/main/inference-v2) inference-v2              (inference-v3) (https://github.com/magnitudedev/magnitude/tree/main/inference-v3) inference-v3        (inference-v3) (https://github.com/magnitudedev/magnitude/tree/main/inference-v3) inference-v3              (inference-v4) (https://github.com/magnitudedev/magnitude/tree/main/inference-v4) inference-v4        (inference-v4) (https://github.com/magnitudedev/magnitude/tree/main/inference-v4) inference-v4              (inference) (https://github.com/magnitudedev/magnitude/tree/main/inference) inference        (inference) (https://github.com/magnitudedev/magnitude/tree/main/inference) inference              (info) (https://github.com/magnitudedev/magnitude/tree/main/info) info        (info) (https://github.com/magnitudedev/magnitude/tree/main/info) info              (This path skips through empty directories) (https://github.com/magnitudedev/magnitude/tree/main/integrations/pi) integrations/ pi         (This path skips through empty directories) (https://github.com/magnitudedev/magnitude/tree/main/integrations/pi) integrations/ pi               (old-inference) (https://github.com/magnitudedev/magnitude/tree/main/old-inference) old-inference        (old-inference) (https://github.com/magnitudedev/magnitude/tree/main/old-inference) old-inference              (packages) (https://github.com/magnitudedev/magnitude/tree/main/packages) packages        (packages) (https://github.com/magnitudedev/magnitude/tree/main/packages) packages              (patches) (https://github.com/magnitudedev/magnitude/tree/main/patches) patches        (patches) (https://github.com/magnitudedev/magnitude/tree/main/patches) patches              (scripts) (https://github.com/magnitudedev/magnitude/tree/main/scripts) scripts        (scripts) (https://github.com/magnitudedev/magnitude/tree/main/scripts) scripts              (This path skips through empty directories) (https://github.com/magnitudedev/magnitude/tree/main/specs/26-09-23) specs/ 26-09-23         (This path skips through empty directories) (https://github.com/magnitudedev/magnitude/tree/main/specs/26-09-23) specs/ 26-09-23               (web) (https://github.com/magnitudedev/magnitude/tree/main/web) web        (web) (https://github.com/magnitudedev/magnitude/tree/main/web) web              (.dockerignore) (https://github.com/magnitudedev/magnitude/blob/main/.dockerignore) .dockerignore        (.dockerignore) (https://github.com/magnitudedev/magnitude/blob/main/.dockerignore) .dockerignore              (.gitignore) (https://github.com/magnitudedev/magnitude/blob/main/.gitignore) .gitignore        (.gitignore) (https://github.com/magnitudedev/magnitude/blob/main/.gitignore) .gitignore              (.gitmodules) (https://github.com/magnitudedev/magnitude/blob/main/.gitmodules) .gitmodules        (.gitmodules) (https://github.com/magnitudedev/magnitude/blob/main/.gitmodules) .gitmodules              (AGENTS.md) (https://github.com/magnitudedev/magnitude/blob/main/AGENTS.md) AGENTS.md        (AGENTS.md) (https://github.com/magnitudedev/magnitude/blob/main/AGENTS.md) AGENTS.md              (CONTRIBUTING.md) (https://github.com/magnitudedev/magnitude/blob/main/CONTRIBUTING.md) CONTRIBUTING.md        (CONTRIBUTING.md) (https://github.com/magnitudedev/magnitude/blob/main/CONTRIBUTING.md) CONTRIBUTING.md              (LICENSE) (https://github.com/magnitudedev/magnitude/blob/main/LICENSE) LICENSE        (LICENSE) (https://github.com/magnitudedev/magnitude/blob/main/LICENSE) LICENSE              (README.md) (https://github.com/magnitudedev/magnitude/blob/main/README.md) README.md        (README.md) (https://github.com/magnitudedev/magnitude/blob/main/README.md) README.md              (bun.lock) (https://github.com/magnitudedev/magnitude/blob/main/bun.lock) bun.lock        (bun.lock) (https://github.com/magnitudedev/magnitude/blob/main/bun.lock) bun.lock              (bunfig.toml) (https://github.com/magnitudedev/magnitude/blob/main/bunfig.toml) bunfig.toml        (bunfig.toml) (https://github.com/magnitudedev/magnitude/blob/main/bunfig.toml) bunfig.toml              (package.json) (https://github.com/magnitudedev/magnitude/blob/main/package.json) package.json        (package.json) (https://github.com/magnitudedev/magnitude/blob/main/package.json) package.json              (tsconfig.json) (https://github.com/magnitudedev/magnitude/blob/main/tsconfig.json) tsconfig.json        (tsconfig.json) (https://github.com/magnitudedev/magnitude/blob/main/tsconfig.json) tsconfig.json              (turbo.json) (https://github.com/magnitudedev/magnitude/blob/main/turbo.json) turbo.json        (turbo.json) (https://github.com/magnitudedev/magnitude/blob/main/turbo.json) turbo.json              (vitest.workspace.ts) (https://github.com/magnitudedev/magnitude/blob/main/vitest.workspace.ts) vitest.workspace.ts        (vitest.workspace.ts) (https://github.com/magnitudedev/magnitude/blob/main/vitest.workspace.ts) vitest.workspace.ts            View all files       Repository files navigation  (magnitude.html#)    README   (magnitude.html#)    Contributing   (magnitude.html#)    Apache-2.0 license     Moreitems               (Magnitude icon)    Magnitude (magnitude.html#magnitude)     Run open models as fast as your hardware allows  (https://magnitude.dev/download) (Download Magnitude)  (https://docs.magnitude.dev) (Documentation)  (https://discord.gg/EHt48pPWdC) (Discord)  (https://x.com/usemagnitude) (Follow Magnitude on Twitter)  (https://github.com/magnitudedev/magnitude/stargazers) (GitHub Repo stars)   Magnitude is an open source inference engine for agents that optimizes itself for your exact hardware. It compiles and tunes its kernels on your device, so open models run up to 2x faster than llama.cpp. One click connects the agent you already use (Pi, OpenCode, Hermes, Codex, and more). Works on Apple Silicon, NVIDIA, AMD, or nothing but a CPU. (https://magnitude.dev/download) Download Magnitude for macOS, Windows, or Linux   ⭐ Help us reach more developers and grow the Magnitude community. Star this repo!   demo-9-29.mp4     Get started (magnitude.html#get-started)     (https://magnitude.dev/download) Download Magnitude , install it, and open the app. Choose a recommended model in Discover and download it. Connect your agent in Connections and start using it.  The desktop app includes the magnitude CLI. No separate installation is needed. Why Magnitude? (magnitude.html#why-magnitude)     Up to 2x faster than llama.cpp: 92% faster decode on Metal, 19% on CUDA Tuned on your device: kernels are tuned on your hardware before a model runs Built for the best models: hand-optimized kernels for popular open-weight families Memory that flexes: 27% less memory per agent, freed when agents stop Fast concurrent sessions: sessions share prefix caches to prevent slowdown Works with your agent: one click to connect Pi, OpenCode, Hermes, Codex, and more Free, private, open source: no token costs, nothing leaves your machine, Apache 2.0  Up to 2x faster than llama.cpp (magnitude.html#up-to-2x-faster-than-llamacpp)     (Magnitude vs llama.cpp: 9% faster prefill and 92% faster decode on Metal, 23% faster prefill and 19% faster decode on CUDA)   FAQ (magnitude.html#faq)     What is Magnitude? (magnitude.html#what-is-magnitude)     An open source inference engine that optimizes itself for your hardware. It ships as a desktop app that runs open models and connects them to the agent you already use. How is it faster than llama.cpp, Ollama, or LM Studio? (magnitude.html#how-is-it-faster-than-llamacpp-ollama-or-lm-studio)     They ship kernels precompiled for broad classes of hardware. Magnitude compiles and tunes its kernels on your actual device before a model runs, so they fit your exact chip. (magnitude.html#up-to-2x-faster-than-llamacpp) See the benchmarks against llama.cpp.  What hardware do I need? (magnitude.html#what-hardware-do-i-need)     Any Apple Silicon, NVIDIA, or AMD GPU, or nothing but a CPU. There is no fixed minimum. Smaller machines run smaller models, and more memory lets you run larger ones. What operating systems does it support? (magnitude.html#what-operating-systems-does-it-support)     macOS, Linux, and Windows. Which models does it support? (magnitude.html#which-models-does-it-support)     See the full list at (https://magnitude.dev/models) magnitude.dev/models . We write optimized kernels for the most popular open-weight families, which is how we beat generalist engines. Which agents work with it? (magnitude.html#which-agents-work-with-it)     One click connects Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, and Cline. Anything else works through the OpenAI-compatible API. Is it private? (magnitude.html#is-it-private)     Yes. Prompts, files, and models stay on your machine. No internet needed once a model is downloaded.          About  Open source inference engine for agents that optimizes itself for your exact hardware. Compiles and tunes its kernels on your device, so open models run up to 2x faster than llama.cpp. Works on Apple Silicon, NVIDIA, AMD, or nothing but a CPU.   (https://magnitude.dev) (https://magnitude.dev) magnitude.dev   Resources  (magnitude.html#readme-ov-file)   Readme   (magnitude.html#Apache-2.0-1-ov-file)   Apache-2.0 license   Contributing  (magnitude.html#contributing-ov-file)   Contributing   (https://github.com/magnitudedev/magnitude/activity)   Activity   (https://github.com/magnitudedev/magnitude/custom-properties)   Custom properties    Stars    5.7k stars  Watchers    22 watching  Forks  (https://github.com/magnitudedev/magnitude/forks)   397  forks     (https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fmagnitudedev%2Fmagnitude&report=magnitudedev+%28user%29) Report repository    Releases     Packages    Contributors    Languages                            Footer (https://github.com)    © 2026 GitHub, Inc.   Footer navigation (https://docs.github.com/site-policy/github-terms/github-terms-of-service) Terms  (https://docs.github.com/site-policy/privacy-policies/github-privacy-statement) Privacy  (https://github.com/security) Security  (https://www.githubstatus.com/) Status  (https://github.community/) Community  (https://docs.github.com/) Docs  (https://support.github.com?tags=dotcom-footer) Contact  Manage cookies    Do not share my personal information              You can’t perform that action at this time.