(https://github.githubassets.com) (https://avatars.githubusercontent.com) (https://github-cloud.s3.amazonaws.com) (https://user-images.githubusercontent.com/) (https://github.githubassets.com) (https://avatars.githubusercontent.com) (https://github.githubassets.com/assets/react-e27d1b3e03961e68.js) (https://github.githubassets.com/assets/react-compiler-runtime-4610bd6d3de9c049.js) (https://github.githubassets.com/assets/scheduler-58b860b049ca307c.js) (https://github.githubassets.com/assets/react-dom-e5fd46a22d5c4058.js) (https://github.githubassets.com/assets/react-dom-client-1b4a3ee065998cea.js) (https://github.githubassets.com/assets/react-is-e0b593954b4706d8.js) (https://github.githubassets.com/assets/react-jsx-runtime-4915cb0f5b3aff04.js) (https://github.githubassets.com/assets/react-reconciler-8e99e505c4429605.js) (../../github.githubassets.com/assets/light-99f877e9ddfc0e51.css) (../../github.githubassets.com/assets/light_high_contrast-48fdd0811afbab3c.css) (../../github.githubassets.com/assets/dark-79ad2ace604703b3.css) (../../github.githubassets.com/assets/dark_high_contrast-24484a076f02295f.css) (../../github.githubassets.com/assets/primer-primitives-ed9ca172356fd545.css) (../../github.githubassets.com/assets/primer-4136ede8b2650a2d.css) (../../github.githubassets.com/assets/global-54ba76e934a49d7c.css) (../../github.githubassets.com/assets/github-7338c07b3a07b8be.css) (../../github.githubassets.com/assets/repository-11ee8a031c040c1a.css) (../../github.githubassets.com/assets/code-2d56bdb0166c0238.css) (https://github.githubassets.com/assets/wp-runtime-cc56059fbecc88bd.js) (https://github.githubassets.com/assets/app-foundation-69691b300d797200.js) (https://github.githubassets.com/assets/app-runtime-9d34ae1c49571756.js) (https://github.githubassets.com/assets/fetch-utilities-4b62182bc6e3c348.js) (https://github.githubassets.com/assets/ser-91fba67ac4479923.js) (https://github.githubassets.com/assets/tp-18fbcd3be071aa02.js) (../../github.githubassets.com/assets/app-runtime.c97ea7e7b9bd7544.module.css) (https://github.githubassets.com/assets/catalyst-86a8f5de995615f8.js) (https://github.githubassets.com/assets/selector-observer-e88088f989b27670.js) (https://github.githubassets.com/assets/relative-time-element-fa0968675d128a19.js) (https://github.githubassets.com/assets/by-6b3c07383371bf58.js) (https://github.githubassets.com/assets/ja9-36f036c13c2e3a4c.js) (https://github.githubassets.com/assets/kwb-985b266c34021458.js) (https://github.githubassets.com/assets/r1-b075aab3204f32f9.js) (https://github.githubassets.com/assets/jz5-7c5d1669717041f8.js) (https://github.githubassets.com/assets/hj-5126390ff433704d.js) (https://github.githubassets.com/assets/j05-1b324859b9512e2d.js) (https://github.githubassets.com/assets/runtime-helpers-5ca1e1883536e092.js) (https://github.githubassets.com/assets/aria-live-edd4f18194230d9e.js) (https://github.githubassets.com/assets/hotkey-5109c77d7ac61078.js) (https://github.githubassets.com/assets/react-core-682155419c984691.js) (https://github.githubassets.com/assets/a9-059e9811745f26d7.js) (https://github.githubassets.com/assets/ur-024971cb63acad59.js) (https://github.githubassets.com/assets/4t-364e19c63d726e9a.js) (https://github.githubassets.com/assets/6ny-c969fbae697a356f.js) (https://github.githubassets.com/assets/yhq-3a209035a30b1a09.js) (https://github.githubassets.com/assets/z1v-da5b33b877bfa358.js) (https://github.githubassets.com/assets/wo-8044e1bac6e0c328.js) (https://github.githubassets.com/assets/9y-cd2a0ff87351e9aa.js) (https://github.githubassets.com/assets/j0-41a4cf04cbd99503.js) (https://github.githubassets.com/assets/0p-81491ed0d9d666e2.js) (../../github.githubassets.com/assets/react-core.4a0933a4f8e47de3.module.css) (https://github.githubassets.com/assets/n9c-16e227ac48072d2b.js) (https://github.githubassets.com/assets/ic-991f04433f366e7b.js) (https://github.githubassets.com/assets/primer-react-266c7f3600a53b8a.js) (https://github.githubassets.com/assets/ncx-9a860680a5f230b9.js) (https://github.githubassets.com/assets/j6-363f0ebf4f62f310.js) (https://github.githubassets.com/assets/t7l-bf6f21d7e7a43c35.js) (https://github.githubassets.com/assets/4u-3fb51fd5b58f1705.js) (https://github.githubassets.com/assets/ws-f1530f278b2b86e5.js) (https://github.githubassets.com/assets/s07-40c12c0b9c65754d.js) (https://github.githubassets.com/assets/n4u-6317ce1c31aed1db.js) (https://github.githubassets.com/assets/j8-275aa078fdc35661.js) (https://github.githubassets.com/assets/la-d2cd96f070e6b52a.js) (https://github.githubassets.com/assets/wb-7be2a2dbb2126c50.js) (https://github.githubassets.com/assets/u4s-e1b03c520769e58b.js) (https://github.githubassets.com/assets/ad7-a8f276eb7d45b3e8.js) (https://github.githubassets.com/assets/w4-b7e7b91d8bc34ed2.js) (https://github.githubassets.com/assets/ojg-6604ac9ae112ae6a.js) (https://github.githubassets.com/assets/gzu-b0e631d87d54c83d.js) (https://github.githubassets.com/assets/bi0-a78ba744687848c2.js) (https://github.githubassets.com/assets/on-898389fbf97246b6.js) (https://github.githubassets.com/assets/b1-a53093be1dda5853.js) (https://github.githubassets.com/assets/0l5-d2057e622f6442d6.js) (https://github.githubassets.com/assets/c2z-c10e51960850b47e.js) (https://github.githubassets.com/assets/f9-038758dcbfe08dab.js) (https://github.githubassets.com/assets/sp-741a59f220bc8fca.js) (https://github.githubassets.com/assets/0k-b7df0a74912a42bf.js) (https://github.githubassets.com/assets/og-72a377e4a14147a1.js) (https://github.githubassets.com/assets/b9-4fd36ab02c30bf52.js) (https://github.githubassets.com/assets/ec-cbba6ef3015afe55.js) (https://github.githubassets.com/assets/dsj-cb1e4ddbce4f007b.js) (https://github.githubassets.com/assets/du-9695d8032ef894d8.js) (https://github.githubassets.com/assets/20-0591acfe230f4c33.js) (https://github.githubassets.com/assets/ql0-d154b9935a526802.js) (https://github.githubassets.com/assets/wp-9f5235d335ab624b.js) (https://github.githubassets.com/assets/gc4-2487b0aac2401bb1.js) (https://github.githubassets.com/assets/uwi-5f891f97d90c7d42.js) (https://github.githubassets.com/assets/th-5bd53302e6db9640.js) (https://github.githubassets.com/assets/7cw-bd83282679153bed.js) (https://github.githubassets.com/assets/1h-21d80ca86288dc09.js) (https://github.githubassets.com/assets/hrn-4ce15d4b78df776c.js) (https://github.githubassets.com/assets/8u-60a1b724e3da8ce5.js) (https://github.githubassets.com/assets/40-0b2be0da8366d3b3.js) (https://github.githubassets.com/assets/y8-e5d822e97df8fa57.js) (https://github.githubassets.com/assets/xc-065e7847e4da513d.js) (https://github.githubassets.com/assets/7o-1da8cccac226f750.js) (../../github.githubassets.com/assets/primer-react-css.46296dcf75e7a0b0.module.css) (../../github.githubassets.com/assets/ql0.bdd6be015c087bbc.module.css) (../../github.githubassets.com/assets/1h.89f839adbc6b191e.module.css) (../../github.githubassets.com/assets/xc.877a51df9233c9c4.module.css) (../../github.githubassets.com/assets/7o.472d89161e62ff5e.module.css) (../../github.githubassets.com/assets/code-view.cdc2a6706d8dc951.module.css) (https://github.githubassets.com/assets/75-4f764d8afd9136da.js) (../../github.githubassets.com/assets/primer-react-css.46296dcf75e7a0b0.module.css) (../../github.githubassets.com/assets/notifications-subscriptions-menu.ae213882982d9603.module.css) GitHub - maanHimself/OpenDLSS-NR: A Vulkan reimplementation of NVIDIA's DLSS 5 Neural Rendering network, bit-exact against the original. · GitHub (repo_source) (https://github.githubassets.com/) (https://github.com/opensearch.xml) (GitHub) (https://github.com/fluidicon.png) (GitHub) (https://github.githubassets.com/assets/pinned-octocat-093da3e6fa40.svg) (https://github.githubassets.com/favicons/favicon.png) (../../github.githubassets.com/favicons/favicon.svg) (../manifest.json) (OpenDLSS-NR.html#start-of-content) Skip to content (https://github.githubassets.com/assets/l7j-2ddd8b435dadae28.js) (https://github.githubassets.com/assets/keyboard-shortcuts-dialog-1a481fdbb4a746ca.js) (../../github.githubassets.com/assets/primer-react-css.46296dcf75e7a0b0.module.css) (../../github.githubassets.com/assets/keyboard-shortcuts-dialog.d3ca20448fe5ff5d.module.css) (https://github.githubassets.com/assets/pw-4f91498888595802.js) (https://github.githubassets.com/assets/app-install-banner-partial-b655f1ad5a8e9bd3.js) (../../github.githubassets.com/assets/primer-react-css.46296dcf75e7a0b0.module.css) (../../github.githubassets.com/assets/app-install-banner-partial.55817499da6548b8.module.css) (https://github.githubassets.com/assets/ak-e62e69106ade8d4b.js) (https://github.githubassets.com/assets/rwd-f09a89144136eafb.js) (https://github.githubassets.com/assets/fz5-23f28c0f388769c9.js) (https://github.githubassets.com/assets/jag-4f408bf2b7f99c87.js) (https://github.githubassets.com/assets/p1-76a75a6081059b19.js) (https://github.githubassets.com/assets/3d8-bbc4e3ce35fac150.js) (https://github.githubassets.com/assets/tua-88f94f65812643db.js) (https://github.githubassets.com/assets/t1-6f4306b54886c418.js) (https://github.githubassets.com/assets/marketing-header-016e207704d3edb8.js) (../../github.githubassets.com/assets/primer-react-css.46296dcf75e7a0b0.module.css) (../../github.githubassets.com/assets/primer-react-brand-css.05b219cdb8e80c43.module.css) (../../github.githubassets.com/assets/t1.7eb91edfb3032751.module.css) Navigation Menu (https://github.com/) (https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FmaanHimself%2FOpenDLSS-NR) Sign in Appearance settings Platform AI CODE CREATION (https://github.com/features/copilot) GitHub Copilot Write better code with AI (https://github.com/features/ai/github-app) GitHub Copilot app Direct agents from issue to merge (https://github.com/mcp) MCP Registry Integrate external tools DEVELOPER WORKFLOWS (https://github.com/features/actions) Actions Automate any workflow (https://github.com/features/codespaces) Codespaces Instant dev environments (https://github.com/features/issues) Issues Plan and track work (https://github.com/features/code-review) Code Review Manage code changes (https://github.com/features/code-quality) Code Quality Enforce quality at merge APPLICATION SECURITY (https://github.com/security/advanced-security) GitHub Advanced Security Find and fix vulnerabilities (https://github.com/security/advanced-security/code-security) Code security Secure your code as you build (https://github.com/security/advanced-security/secret-protection) Secret protection Stop leaks before they start EXPLORE (https://github.com/why-github) Why GitHub (https://docs.github.com) Documentation (https://github.blog) Blog (https://github.blog/changelog) Changelog (https://github.com/marketplace) Marketplace (https://github.com/features) View all features Solutions BY COMPANY SIZE (https://github.com/enterprise) Enterprises (https://github.com/team) Small and medium teams (https://github.com/enterprise/startups) Startups (https://github.com/solutions/industry/nonprofits) Nonprofits BY USE CASE (https://github.com/solutions/use-case/app-modernization) App Modernization (https://github.com/solutions/use-case/devsecops) DevSecOps (https://github.com/solutions/use-case/devops) DevOps (https://github.com/solutions/use-case/ci-cd) CI/CD (https://github.com/solutions/use-case) View all use cases BY INDUSTRY (https://github.com/solutions/industry/healthcare) Healthcare (https://github.com/solutions/industry/financial-services) Financial services (https://github.com/solutions/industry/manufacturing) Manufacturing (https://github.com/solutions/industry/government) Government (https://github.com/solutions/industry) View all industries (https://github.com/solutions) View all solutions Resources EXPLORE BY TOPIC (https://github.com/resources/articles?topic=ai) AI (https://github.com/resources/articles?topic=software-development) Software Development (https://github.com/resources/articles?topic=devops) DevOps (https://github.com/resources/articles?topic=security) Security (https://github.com/resources/articles) View all topics EXPLORE BY TYPE (https://github.com/customer-stories) Customer stories (https://github.com/resources/events) Events & webinars (https://github.com/resources/whitepapers) Ebooks & reports (https://github.com/solutions/executive-insights) Business insights (https://skills.github.com) GitHub Skills SUPPORT & SERVICES (https://docs.github.com) Documentation (https://support.github.com) Customer support (https://github.com/orgs/community/discussions) Community forum (https://github.com/trust-center) Trust center (https://github.com/partners) Partners (https://github.com/resources) View all resources Open Source COMMUNITY (https://github.com/open-source/sponsors) GitHub Sponsors Fund open source developers PROGRAMS (https://securitylab.github.com) Security Lab (https://maintainers.github.com) Maintainer Community (https://stars.github.com) GitHub Stars (https://archiveprogram.github.com) Archive Program REPOSITORIES (https://github.com/topics) Topics (https://github.com/trending) Trending (https://github.com/collections) Collections Enterprise ENTERPRISE SOLUTIONS (https://github.com/enterprise) Enterprise platform AI-powered developer platform AVAILABLE ADD-ONS (https://github.com/security/advanced-security) GitHub Advanced Security Enterprise-grade security features (https://github.com/features/copilot/copilot-business) Copilot for Business Enterprise-grade AI features (https://github.com/enterprise/premium-support) Premium Support Enterprise-grade 24/7 support (https://github.com/pricing) Pricing Search / (https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FmaanHimself%2FOpenDLSS-NR) Sign in (https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=maanHimself%2FOpenDLSS-NR) Sign up Appearance settings You signed in with another tab or window. (OpenDLSS-NR.html) Reload to refresh your session. You signed out in another tab or window. (OpenDLSS-NR.html) Reload to refresh your session. You switched accounts on another tab or window. (OpenDLSS-NR.html) Reload to refresh your session. Dismiss alert (https://github.com/maanHimself) maanHimself / (OpenDLSS-NR.html) OpenDLSS-NR Public (https://github.com/login?return_to=%2FmaanHimself%2FOpenDLSS-NR) Notifications You must be signed in to change notification settings (https://github.com/login?return_to=%2FmaanHimself%2FOpenDLSS-NR) Fork (58) 58 (https://github.com/login?return_to=%2FmaanHimself%2FOpenDLSS-NR) Star (566) 566 (OpenDLSS-NR.html) Code (Not available) (https://github.com/maanHimself/OpenDLSS-NR/issues) Issues (0) 0 (https://github.com/maanHimself/OpenDLSS-NR/pulls) Pull requests (0) 0 (https://github.com/maanHimself/OpenDLSS-NR/actions) Actions (Not available) (https://github.com/maanHimself/OpenDLSS-NR/projects) Projects (Not available) (https://github.com/maanHimself/OpenDLSS-NR/security) Security and quality (0) 0 (https://github.com/maanHimself/OpenDLSS-NR/pulse) Insights (Not available) Additional navigation options (OpenDLSS-NR.html) Code (https://github.com/maanHimself/OpenDLSS-NR/issues) Issues (https://github.com/maanHimself/OpenDLSS-NR/pulls) Pull requests (https://github.com/maanHimself/OpenDLSS-NR/actions) Actions (https://github.com/maanHimself/OpenDLSS-NR/projects) Projects (https://github.com/maanHimself/OpenDLSS-NR/security) Security and quality (https://github.com/maanHimself/OpenDLSS-NR/pulse) Insights (OpenDLSS-NR.html) main (https://github.com/maanHimself/OpenDLSS-NR/branches) Branches (https://github.com/maanHimself/OpenDLSS-NR/tags) Tags (https://github.com/maanHimself/OpenDLSS-NR/branches) (https://github.com/maanHimself/OpenDLSS-NR/tags) (Go to file) () Go to file Code Open more actions menu Latest commit History (https://github.com/maanHimself/OpenDLSS-NR/commits/main/) 4 Commits (https://github.com/maanHimself/OpenDLSS-NR/commits/main/) 4 Commits Folders and files Name Name (Last commit message) Last commit message (Last commit date) Last commit date (demo) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/demo) demo (demo) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/demo) demo (docs) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/docs) docs (docs) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/docs) docs (This path skips through empty directories) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/ports/browser-webgpu) ports/ browser-webgpu (This path skips through empty directories) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/ports/browser-webgpu) ports/ browser-webgpu (scripts) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/scripts) scripts (scripts) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/scripts) scripts (shaders) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/shaders) shaders (shaders) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/shaders) shaders (src) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/src) src (src) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/src) src (third_party) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/third_party) third_party (third_party) (https://github.com/maanHimself/OpenDLSS-NR/tree/main/third_party) third_party (.gitattributes) (https://github.com/maanHimself/OpenDLSS-NR/blob/main/.gitattributes) .gitattributes (.gitattributes) (https://github.com/maanHimself/OpenDLSS-NR/blob/main/.gitattributes) .gitattributes (.gitignore) (https://github.com/maanHimself/OpenDLSS-NR/blob/main/.gitignore) .gitignore (.gitignore) (https://github.com/maanHimself/OpenDLSS-NR/blob/main/.gitignore) .gitignore (LICENSE) (https://github.com/maanHimself/OpenDLSS-NR/blob/main/LICENSE) LICENSE (LICENSE) (https://github.com/maanHimself/OpenDLSS-NR/blob/main/LICENSE) LICENSE (NOTICE) (https://github.com/maanHimself/OpenDLSS-NR/blob/main/NOTICE) NOTICE (NOTICE) (https://github.com/maanHimself/OpenDLSS-NR/blob/main/NOTICE) NOTICE (README.md) (https://github.com/maanHimself/OpenDLSS-NR/blob/main/README.md) README.md (README.md) (https://github.com/maanHimself/OpenDLSS-NR/blob/main/README.md) README.md View all files Repository files navigation (OpenDLSS-NR.html#) README (OpenDLSS-NR.html#) MIT license Moreitems OpenDLSS-NR (OpenDLSS-NR.html#opendlss-nr) A Vulkan reimplementation of NVIDIA's DLSS 5 Neural Rendering network, bit-exact against the original. The same 71-block Swin / ViT network as DLSS-NR build 310.8.0, running FP8 on the tensor cores. The intermediates match too, not just the final image: all 75 block boundaries, byte for byte. ports/browser-webgpu/ is a second, independent implementation: the same bytes in a browser, with no tensor cores and no FP8. You supply the weights , as a model directory in the layout described below. The network (OpenDLSS-NR.html#the-network) A U-net of shifted-window transformer blocks with a global ViT at the bottom: 71 blocks over six pooling levels, FP8 (E4M3) activations with FP16 accumulation, 141 MiB of weights. It is a generative neural rendering network (NVIDIA's term): it re-renders the frame the engine already drew, generating detail from injected noise and adjusting tone, structure and skin under a style setting. Input and output are the same resolution; it is not an upscaler. (https://github.com/maanHimself/OpenDLSS-NR/blob/main/docs/images/cowboy-gramps-nr-on.jpg) (The same frame with neural rendering off (left) and on (right)) The WebGPU port at 2048x1152, NR off on the left and on on the right. Scene: (https://www.blendkit.com/asset-gallery-detail/96dce188-9c9c-4699-a45a-48663fbbbcb7/) Cowboy Gramps by Muhammed Ismayil, CC0. It takes one rendered frame (a low dynamic range proxy of it, three lanes of Gaussian noise, the previous frame's output reprojected, and five conditioning scalars) and produces four f32 channels per pixel: an RGB residual and one temporal-blend logit. (https://github.com/maanHimself/OpenDLSS-NR/blob/main/docs/network.md) docs/network.md is the graph in full. NVIDIA describes the model in its report, (https://research.nvidia.com/labs/adlr/DLSS5/files/DLSS5_Report.pdf) DLSS 5: Generative Neural Rendering ((https://research.nvidia.com/labs/adlr/DLSS5/) project page ). Build and run (OpenDLSS-NR.html#build-and-run) powershell -File scripts\fetch_tools.ps1 [-Npm] # once: tools\ (glslang, Vulkan-Headers, volk, CMake, Ninja) powershell -File scripts\build.ps1 # shaders, PTX, build\dlss5vk.exe powershell -File scripts\fetch_filament.ps1 # once, for the demo: third_party\filament (+ the patch) powershell -File scripts\build_filament.ps1 # once, for the demo: third_party\filament-install powershell -File scripts\build_demo.ps1 # build\demo\dlss5-demo.exe build\dlss5vk.exe bench --model