(https://cdn.prod.website-files.com)  PrismML — Introducing Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint           (../../cdn.prod.website-files.com/697a3312d33c2cc715ec3899/css/prism-4ce871.webflow.shared.9bae20672.css)  (../../cdn.prod.website-files.com/697a3312d33c2cc715ec3899/69cc251464287abfc0e45c9b_fav dark.png)  (../../cdn.prod.website-files.com/697a3312d33c2cc715ec3899/69cc25182b2bda813d563ff3_fav light.png)  (https://cdn.prod.website-files.com/697a3312d33c2cc715ec3899/69cc2465f1715bb4a2a56ca1_webclip.png)  (https://prismml.com/news/rss.xml) (RSS Feed)  (../../cdn.prod.website-files.com/697a3312d33c2cc715ec3899/69cc265eaa7943f831491f97_fav-light-48.png) (../../cdn.prod.website-files.com/697a3312d33c2cc715ec3899/69cc265eaa7943f831491f97_fav-light-48.png) (../../cdn.prod.website-files.com/697a3312d33c2cc715ec3899/69cc265e96209c5fe2833789_fav-light-96.png) (../../cdn.prod.website-files.com/697a3312d33c2cc715ec3899/69cc265e2bd7afe8b30d9ca8_fav-light-192.png) (../../cdn.prod.website-files.com/697a3312d33c2cc715ec3899/69cc265e96209c5fe2833789_fav-light-96.png)    (https://prismml.com/) ()   (bonsai-2-27b.html#) ()   (bonsai-2-27b.html#) ()    (https://prismml.com/about) About  (https://prismml.com/blog) Blog  (https://prismml.com/news) News  (https://prismml.com/careers) Careers  (bonsai-2-27b.html#) Contact  (https://docs.prismml.com/) Docs  (https://www.linkedin.com/company/prismml/) ()   (https://x.com/PrismML) ()        Models  (https://huggingface.co/collections/prism-ml/bonsai-2) Bonsai 2 27B (https://huggingface.co/collections/prism-ml/bonsai-27b) Bonsai 27B (https://huggingface.co/prism-ml/Ternary-Bonsai-8B-gguf) Bonsai 8B (https://huggingface.co/prism-ml/Ternary-Bonsai-4B-gguf) Bonsai 4B (https://huggingface.co/prism-ml/Ternary-Bonsai-1.7B-gguf) Bonsai 1.7B (https://huggingface.co/prism-ml/bonsai-image-ternary-4B-mlx-2bit) Bonsai Image   (https://prismml.com/about) About  (https://prismml.com/blog) Blog  (https://prismml.com/news) News  (https://prismml.com/careers) Careers  (https://docs.prismml.com/) Docs  (https://www.linkedin.com/company/prismml/) ()   (https://x.com/PrismML) ()       (bonsai-2-27b.html) LAUNCH   1001011100 11010 1 001  ()        (https://prismml.com/blog) ()  Back to all posts   Introducing Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint  September 17, 2026 • PrismML   Two months ago, we released our first Bonsai 27B models and showed that a 27B-class multimodal model could be compressed enough to run efficiently on a local device. Today, we’re releasing Ternary Bonsai 2 27B, our most capable model yet. Based on Qwen3.8 27B, Ternary Bonsai 2 27B brings stronger reasoning, coding, vision, and agentic capability to the Bonsai series while preserving the deployment profile that defines it: a dramatically smaller memory footprint, high local throughput, and better energy efficiency. Ternary Bonsai 2 27B uses ternary {−1, 0, +1} weights with FP16 group-wise scaling, for 1.76 effective bits per weight and a total model footprint of 5.9GB . The low-bit representation is applied end to end across the language model. It supports a 262K-token context window , multimodal text-and-image input, and is released under the Apache 2.0 license. Against its full-precision counterpart, Ternary Bonsai 2 27B is more than 9x smaller while retaining 98.2% of aggregate benchmark performance . At this level of retention, compression becomes a deployment unlock: nearly the same capability, in a footprint that can run in far more places. What changed from the first Bonsai 27B release  Our first Bonsai 27B release was an important milestone, offering a practical way to run 27B-class intelligence on local devices. Bonsai 2 27B focuses on the next step: improving the model quality and runtime performance needed for real-world local applications. Compared with the previous Bonsai 27B generation, Bonsai 2 27B brings: a stronger base model, Qwen3.8 27B higher aggregate capability retention of 98.2% against the full-precision model improved reasoning, coding, vision, and long-horizon agentic performance  Higher capability at the same deployment point  Across a benchmark suite spanning reasoning, math, coding, instruction following, vision, and agentic tool use, Ternary Bonsai 2 27B scores 83.9 , retaining 98.2% of Qwen3.8 27B’s aggregate performance.  Capability Ternary Bonsai 227B Qwen3.827B Qwen3.627B   Agentic & Tool Calling τ²-bench, BFCLv3  77.57 79.74 80.05  Coding HumanEval+, LiveCodeBench v6, MBPP+, BigCodeBench  81.58 82.17 82.57  Instruction Following IFBench, IFEval  82.66 81.25 74.53  Knowledge & Reasoning MMLU-Redux, GPQA Diamond, AA-LCR  83.95 86.66 84.71  Math AIME 2026, AIME 2025, GSM8K, MATH-500  96.57 97.06 94.64  Vision CharXiv, A-OKVQA, OmniDocBench v1.6, RealWorldQA, OCRBench v2  78.59 81.64 79.82  Overall 83.9 85.4 83.6       ‍Figure I:  Benchmark scores of Ternary Bonsai 2 27B (thinking mode) compared with the full-precision Qwen3.8 27B and Qwen3.6 27B baselines. Full per-benchmark results are in the  (https://github.com/PrismML-Eng/Bonsai-demo/blob/main/bonsai-2-27b-whitepaper.pdf) whitepaper  . ‍ The key result is not only the aggregate score, but where the capability is retained. Coding agents, tool-use systems, multimodal workflows, and long-horizon tasks are particularly sensitive to model degradation because small errors can compound over many steps. Bonsai 2 27B preserves much of the full-precision model’s performance in exactly these areas while operating at a fraction of the memory footprint. Compared with the full-precision model and other low-bit alternatives, Bonsai 2 27B stands out as an outlier on intelligence density. Many low-bit alternatives become deployable only by giving up meaningful capability in coding, vision, or agentic tool use. Bonsai 2 27B pushes the frontier toward both higher capability and lower memory usage. ()   Figure II:  Intelligence density (per GB) of Ternary Bonsai 2 27B compared to other models in the same parameter class.  (Ternary Bonsai 2 27B with Cline (RTX 5090))   Demo I: Coding agents with Cline, powered by Ternary Bonsai 2 27B on NVIDIA GeForce RTX 5090.  (Computer Use with Ternary Bonsai 2 27B (RTX 5090))   Demo II: Computer use powered by Ternary Bonsai 2 27B model on NVIDIA GeForce RTX 5090.   ‹  ›        With Bonsai 2 27B, local models can start to take on real knowledge work: coding-agent loops, computer-use workflows, private document analysis, multimodal debugging, and hybrid orchestration where local models handle sensitive or high-frequency tasks while escalating selectively to the cloud. Throughput and energy efficiency  Ternary Bonsai 2 27B reaches up to 143 tokens/second on NVIDIA GeForce RTX 5090 and 46.8 tokens/second on M5 Max. On an RTX 4090, Ternary Bonsai 2 27B consumes just 0.714 mWh/token, making it 40% more energy-efficient than an 8B model running in full-precision. For coding assistants, higher throughput means faster edit-debug loops. For multimodal agents, it means quicker iterations over screenshots, documents, and tool calls. For private local workflows, better energy efficiency means more useful inference on the same device, longer battery life, and a more realistic path to assistants that can stay available in the background without constantly calling the cloud. Why this release matters  Compared to Ternary Bonsai 27B, the new Ternary Bonsai 2 27B has closed the retention gap between the full precision model from 95% to over 98%. This is a significant improvement that makes the current release practically “lossless”. It further cements the notion that low-bit models can be the best way to deploy AI.  That has implications well beyond local inference. Low-bit models can change the economics and architecture of AI systems across devices, workstations, and datacenters: fitting larger models into the same memory envelope, serving more users on the same hardware, reducing energy per inference, and enabling hybrid systems that dynamically decide what should run locally and what should run in the cloud. The question will increasingly be not just how capable a model is, but how much useful intelligence can be delivered within a given memory, compute, and power budget. If capability can continue to scale while those requirements fall dramatically, the deployment envelope for future models expands across the stack: from personal devices to large-scale datacenters. Platform Coverage  Bonsai 2 27B runs on NVIDIA GPUs via CUDA and on Apple devices (Mac, iPhone, iPad) via MLX, through custom low-bit kernels. Model weights are available today under the Apache 2.0 License. Full technical details of our compression, evaluation, and benchmarking processes are available in our (https://github.com/PrismML-Eng/Bonsai-demo/blob/main/bonsai-2-27b-whitepaper.pdf) whitepaper . Work with Us  We work with teams to tailor Bonsai models to their applications, from post-training on domain-specific data to optimizing inference for target hardware. If you’re building AI products with tight memory, latency, or power requirements, we’d love to explore how Bonsai can help. Reach out at (mailto:contact@prismml.com) contact@prismml.com . Join Us  PrismML emerged from a team of Caltech researchers and was founded with support from Khosla Ventures, Cerberus, and Google, with continuing support from Samsung. We've spent years tackling one of the field's hardest problems: compressing neural networks without sacrificing their reasoning ability. If you want to help build the next generation of state-of-the-art AI, we'd love to hear from you. Check out our (https://prismml.com/careers) careers page .  (https://prismml.com/blog) ()  Back to all posts     (https://prismml.com/news/bonsai-27b) Announcing Bonsai 27B: The First 27B-Class Model to Run on a Phone July 14, 2026 Today we're announcing Bonsai 27B, our multimodal flagship: ternary at 5.9GB for laptops, 1-bit at 3.9GB for an iPhone 17 Pro, with a 262K-token context.   (https://prismml.com/news/prismml-launches-bonsai-2-27b) PrismML Launches Bonsai 2 27B, Its Most Capable Model Yet September 17, 2026 New flagship model brings 27B-class reasoning, coding, vision, and agentic capability into a dramatically smaller, faster deployment footprint     (Email)  (Get updates)   Thanks, we’ll keep you posted!  Something went wrong.   Resources (https://huggingface.co/spaces/webml-community/ternary-bonsai-2-webgpu-kernels) ()  Demo  (https://github.com/PrismML-Eng/Bonsai-demo/blob/main/bonsai-2-27b-whitepaper.pdf) ()  Whitepaper  (https://docs.prismml.com/) ()  Docs    Models (https://huggingface.co/collections/prism-ml/bonsai-2) ()  Hugging Face  (https://github.com/PrismML-Eng/Bonsai-demo/) ()  GitHub    Follow (https://x.com/PrismML) ()  X  (http://discord.gg/prismml) ()  Discord  (https://www.linkedin.com/company/prismml) ()  LinkedIn           (https://prismml.com/about) About  (bonsai-2-27b.html#) ()   Get updates on new releases and company news: (Email)  (Get news)   Thanks, we’ll keep you posted!  Something went wrong.   © 2026 Prism ML, Inc. All rights reserved.   Models (bonsai-2-27b.html#) Bonsai 27B  (bonsai-2-27b.html#) Bonsai 8B  (bonsai-2-27b.html#) Bonsai 4B  (bonsai-2-27b.html#) Bonsai 1.7B  (bonsai-2-27b.html#) Bonsai Image   Company (https://prismml.com/about) About  (https://prismml.com/blog) Blog  (https://prismml.com/news) News   Contact (https://prismml.com/careers) Careers  (bonsai-2-27b.html#) Contact   Legal (https://prismml.com/terms) Terms  (https://prismml.com/privacy) Privacy   Follow (https://www.linkedin.com/company/prismml/) ()   (https://x.com/PrismML) ()        Contact us (bonsai-2-27b.html#) ()    Have a question, partnership idea, or a project that needs efficient intelligence? Reach out—we’d love to hear from you.  (First Name)  (Last Name)   (Email)  (Phone number (optional))  (Message)  (Send message)   Thanks, your message has been received!  Oops! Something went wrong while submitting the form.