(https://github.githubassets.com) (https://avatars.githubusercontent.com) (https://github-cloud.s3.amazonaws.com) (https://user-images.githubusercontent.com/) (https://github.githubassets.com) (https://avatars.githubusercontent.com)   (https://github.githubassets.com/assets/react-e27d1b3e03961e68.js)  (https://github.githubassets.com/assets/react-compiler-runtime-4610bd6d3de9c049.js)  (https://github.githubassets.com/assets/scheduler-58b860b049ca307c.js)  (https://github.githubassets.com/assets/react-dom-e5fd46a22d5c4058.js)  (https://github.githubassets.com/assets/react-dom-client-1b4a3ee065998cea.js)  (https://github.githubassets.com/assets/react-is-e0b593954b4706d8.js)  (https://github.githubassets.com/assets/react-jsx-runtime-4915cb0f5b3aff04.js)  (https://github.githubassets.com/assets/react-reconciler-8e99e505c4429605.js)  (../../github.githubassets.com/assets/light-99f877e9ddfc0e51.css)  (../../github.githubassets.com/assets/light_high_contrast-48fdd0811afbab3c.css)  (../../github.githubassets.com/assets/dark-79ad2ace604703b3.css)  (../../github.githubassets.com/assets/dark_high_contrast-24484a076f02295f.css)                (../../github.githubassets.com/assets/primer-primitives-ed9ca172356fd545.css)  (../../github.githubassets.com/assets/primer-4136ede8b2650a2d.css)  (../../github.githubassets.com/assets/global-54ba76e934a49d7c.css)  (../../github.githubassets.com/assets/github-7338c07b3a07b8be.css)  (../../github.githubassets.com/assets/repository-11ee8a031c040c1a.css)  (../../github.githubassets.com/assets/code-2d56bdb0166c0238.css)  (https://github.githubassets.com/assets/wp-runtime-3b7cb7feb7ee2efc.js)  (https://github.githubassets.com/assets/app-foundation-69691b300d797200.js)  (https://github.githubassets.com/assets/app-runtime-a39028f798daf65d.js)  (https://github.githubassets.com/assets/fetch-utilities-4b62182bc6e3c348.js)  (https://github.githubassets.com/assets/ser-91fba67ac4479923.js)  (https://github.githubassets.com/assets/tp-18fbcd3be071aa02.js)  (../../github.githubassets.com/assets/app-runtime.70b2cadcfd63fdd3.module.css)  (https://github.githubassets.com/assets/catalyst-86a8f5de995615f8.js)  (https://github.githubassets.com/assets/selector-observer-e88088f989b27670.js)  (https://github.githubassets.com/assets/relative-time-element-7cdf4e0db98b997c.js)  (https://github.githubassets.com/assets/by-6b3c07383371bf58.js)  (https://github.githubassets.com/assets/ja9-36f036c13c2e3a4c.js)  (https://github.githubassets.com/assets/kwb-985b266c34021458.js)  (https://github.githubassets.com/assets/r1-b075aab3204f32f9.js)  (https://github.githubassets.com/assets/jz5-7c5d1669717041f8.js)  (https://github.githubassets.com/assets/hj-5126390ff433704d.js)  (https://github.githubassets.com/assets/j05-1b324859b9512e2d.js)  (https://github.githubassets.com/assets/runtime-helpers-5ca1e1883536e092.js)  (https://github.githubassets.com/assets/aria-live-edd4f18194230d9e.js)  (https://github.githubassets.com/assets/hotkey-5109c77d7ac61078.js)  (https://github.githubassets.com/assets/react-core-b0e16c869bda7bb7.js)  (https://github.githubassets.com/assets/a9-059e9811745f26d7.js)  (https://github.githubassets.com/assets/ur-024971cb63acad59.js)  (https://github.githubassets.com/assets/4t-364e19c63d726e9a.js)  (https://github.githubassets.com/assets/6ny-c969fbae697a356f.js)  (https://github.githubassets.com/assets/yhq-3a209035a30b1a09.js)  (https://github.githubassets.com/assets/z1v-da5b33b877bfa358.js)  (https://github.githubassets.com/assets/wo-f3e3b96584d99034.js)  (https://github.githubassets.com/assets/9y-cd2a0ff87351e9aa.js)  (https://github.githubassets.com/assets/j0-41a4cf04cbd99503.js)  (https://github.githubassets.com/assets/0p-81491ed0d9d666e2.js)  (../../github.githubassets.com/assets/react-core.c096e568423212a2.module.css)  (https://github.githubassets.com/assets/n9c-16e227ac48072d2b.js)  (https://github.githubassets.com/assets/ic-991f04433f366e7b.js)  (https://github.githubassets.com/assets/primer-react-78d44c43a701cdea.js)  (https://github.githubassets.com/assets/ncx-9a860680a5f230b9.js)  (https://github.githubassets.com/assets/j6-363f0ebf4f62f310.js)  (https://github.githubassets.com/assets/t7l-bf6f21d7e7a43c35.js)  (https://github.githubassets.com/assets/4u-3fb51fd5b58f1705.js)  (https://github.githubassets.com/assets/ws-f1530f278b2b86e5.js)  (https://github.githubassets.com/assets/s07-40c12c0b9c65754d.js)  (https://github.githubassets.com/assets/n4u-6317ce1c31aed1db.js)  (https://github.githubassets.com/assets/j8-275aa078fdc35661.js)  (https://github.githubassets.com/assets/la-d2cd96f070e6b52a.js)  (https://github.githubassets.com/assets/wb-7be2a2dbb2126c50.js)  (https://github.githubassets.com/assets/u4s-e1b03c520769e58b.js)  (https://github.githubassets.com/assets/ad7-a8f276eb7d45b3e8.js)  (https://github.githubassets.com/assets/w4-b7e7b91d8bc34ed2.js)  (https://github.githubassets.com/assets/ojg-6604ac9ae112ae6a.js)  (https://github.githubassets.com/assets/gzu-1271d909f47ee6ff.js)  (https://github.githubassets.com/assets/bi0-a78ba744687848c2.js)  (https://github.githubassets.com/assets/on-898389fbf97246b6.js)  (https://github.githubassets.com/assets/b1-29e9e07f80dbb401.js)  (https://github.githubassets.com/assets/0l5-ff65210c0318d88e.js)  (https://github.githubassets.com/assets/c2z-c10e51960850b47e.js)  (https://github.githubassets.com/assets/f9-038758dcbfe08dab.js)  (https://github.githubassets.com/assets/sp-741a59f220bc8fca.js)  (https://github.githubassets.com/assets/0k-b7df0a74912a42bf.js)  (https://github.githubassets.com/assets/og-72a377e4a14147a1.js)  (https://github.githubassets.com/assets/b9-4fd36ab02c30bf52.js)  (https://github.githubassets.com/assets/ec-cbba6ef3015afe55.js)  (https://github.githubassets.com/assets/dsj-cb1e4ddbce4f007b.js)  (https://github.githubassets.com/assets/du-fee6a27cf2b1eb08.js)  (https://github.githubassets.com/assets/20-f2b863c2469b50ab.js)  (https://github.githubassets.com/assets/ql0-d154b9935a526802.js)  (https://github.githubassets.com/assets/wp-9f5235d335ab624b.js)  (https://github.githubassets.com/assets/gc4-2487b0aac2401bb1.js)  (https://github.githubassets.com/assets/uwi-c01250da81079ca2.js)  (https://github.githubassets.com/assets/th-1e27aaf4def14b35.js)  (https://github.githubassets.com/assets/7cw-3e82d4840187e34e.js)  (https://github.githubassets.com/assets/1h-eb7c8217a1053a61.js)  (https://github.githubassets.com/assets/hrn-0d09fb5712661e17.js)  (https://github.githubassets.com/assets/8u-60a1b724e3da8ce5.js)  (https://github.githubassets.com/assets/8g-fd155f72f8d85581.js)  (https://github.githubassets.com/assets/y8-eb1c57f803818971.js)  (https://github.githubassets.com/assets/xc-065e7847e4da513d.js)  (https://github.githubassets.com/assets/7o-7a1d1517bebcab66.js)  (../../github.githubassets.com/assets/primer-react-css.76a197f9dce25e3c.module.css)  (../../github.githubassets.com/assets/ql0.bdd6be015c087bbc.module.css)  (../../github.githubassets.com/assets/1h.5a6b66cbf9536bc6.module.css)  (../../github.githubassets.com/assets/xc.877a51df9233c9c4.module.css)  (../../github.githubassets.com/assets/7o.c13170c6f009f769.module.css)  (../../github.githubassets.com/assets/code-view.bd31ffd1b9f67379.module.css)  (https://github.githubassets.com/assets/75-4f764d8afd9136da.js)  (../../github.githubassets.com/assets/primer-react-css.76a197f9dce25e3c.module.css)  (../../github.githubassets.com/assets/notifications-subscriptions-menu.13f0e5227566a812.module.css)  GitHub - lostmsu/TurboGPT: Train a tiny GPT in under a minute (CUDA only) · GitHub      (repo_source) (https://github.githubassets.com/)   (https://github.com/opensearch.xml) (GitHub) (https://github.com/fluidicon.png) (GitHub)                        (https://github.githubassets.com/assets/pinned-octocat-093da3e6fa40.svg) (https://github.githubassets.com/favicons/favicon.png) (../../github.githubassets.com/favicons/favicon.svg)  (../manifest.json)   (TurboGPT.html#start-of-content) Skip to content   (https://github.githubassets.com/assets/l7j-2ddd8b435dadae28.js)  (https://github.githubassets.com/assets/keyboard-shortcuts-dialog-a500ae615883f118.js)  (../../github.githubassets.com/assets/primer-react-css.76a197f9dce25e3c.module.css)  (../../github.githubassets.com/assets/keyboard-shortcuts-dialog.0c81ae7fbf6833e3.module.css)    (https://github.githubassets.com/assets/pw-4f91498888595802.js)  (https://github.githubassets.com/assets/app-install-banner-partial-ae3e603693814bcf.js)  (../../github.githubassets.com/assets/primer-react-css.76a197f9dce25e3c.module.css)  (../../github.githubassets.com/assets/app-install-banner-partial.9e0438543cd0de64.module.css)    (https://github.githubassets.com/assets/ak-e62e69106ade8d4b.js)  (https://github.githubassets.com/assets/vaq-d86e3178a07e9aa0.js)  (https://github.githubassets.com/assets/fz5-23f28c0f388769c9.js)  (https://github.githubassets.com/assets/jag-4f408bf2b7f99c87.js)  (https://github.githubassets.com/assets/p1-76a75a6081059b19.js)  (https://github.githubassets.com/assets/3d8-bbc4e3ce35fac150.js)  (https://github.githubassets.com/assets/tua-18c20c09a9dc80b9.js)  (https://github.githubassets.com/assets/t-914b0a3dabe220ba.js)  (https://github.githubassets.com/assets/marketing-header-87dc5b09b97888d6.js)  (../../github.githubassets.com/assets/primer-react-css.76a197f9dce25e3c.module.css)  (../../github.githubassets.com/assets/primer-react-brand-css.6a01c236ff527e7e.module.css)  (../../github.githubassets.com/assets/t.d7f0479eca0d90af.module.css)  Navigation Menu       (https://github.com/)    (https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Flostmsu%2FTurboGPT) Sign in         Appearance settings   Platform   AI CODE CREATION (https://github.com/features/copilot)    GitHub Copilot Write better code with AI    (https://github.com/features/ai/github-app)   GitHub Copilot app Direct agents from issue to merge    (https://github.com/mcp)    MCP Registry Integrate external tools       DEVELOPER WORKFLOWS (https://github.com/features/actions)   Actions Automate any workflow    (https://github.com/features/codespaces)    Codespaces Instant dev environments    (https://github.com/features/issues)    Issues Plan and track work    (https://github.com/features/code-review)   Code Review Manage code changes    (https://github.com/features/code-quality)    Code Quality Enforce quality at merge       APPLICATION SECURITY (https://github.com/security/advanced-security)   GitHub Advanced Security Find and fix vulnerabilities    (https://github.com/security/advanced-security/code-security)   Code security Secure your code as you build    (https://github.com/security/advanced-security/secret-protection)   Secret protection Stop leaks before they start       EXPLORE (https://github.com/why-github) Why GitHub   (https://docs.github.com) Documentation     (https://github.blog) Blog     (https://github.blog/changelog) Changelog     (https://github.com/marketplace) Marketplace       (https://github.com/features) View all features         Solutions   BY COMPANY SIZE (https://github.com/enterprise) Enterprises   (https://github.com/team) Small and medium teams   (https://github.com/enterprise/startups) Startups   (https://github.com/solutions/industry/nonprofits) Nonprofits      BY USE CASE (https://github.com/solutions/use-case/app-modernization) App Modernization   (https://github.com/solutions/use-case/devsecops) DevSecOps   (https://github.com/solutions/use-case/devops) DevOps   (https://github.com/solutions/use-case/ci-cd) CI/CD   (https://github.com/solutions/use-case) View all use cases         BY INDUSTRY (https://github.com/solutions/industry/healthcare) Healthcare   (https://github.com/solutions/industry/financial-services) Financial services   (https://github.com/solutions/industry/manufacturing) Manufacturing   (https://github.com/solutions/industry/government) Government   (https://github.com/solutions/industry) View all industries          (https://github.com/solutions) View all solutions         Resources   EXPLORE BY TOPIC (https://github.com/resources/articles?topic=ai) AI   (https://github.com/resources/articles?topic=software-development) Software Development   (https://github.com/resources/articles?topic=devops) DevOps   (https://github.com/resources/articles?topic=security) Security   (https://github.com/resources/articles) View all topics         EXPLORE BY TYPE (https://github.com/customer-stories) Customer stories   (https://github.com/resources/events) Events & webinars   (https://github.com/resources/whitepapers) Ebooks & reports   (https://github.com/solutions/executive-insights) Business insights   (https://skills.github.com) GitHub Skills        SUPPORT & SERVICES (https://docs.github.com) Documentation     (https://support.github.com) Customer support     (https://github.com/orgs/community/discussions) Community forum   (https://github.com/trust-center) Trust center   (https://github.com/partners) Partners       (https://github.com/resources) View all resources         Open Source   COMMUNITY (https://github.com/open-source/sponsors)   GitHub Sponsors Fund open source developers       PROGRAMS (https://securitylab.github.com) Security Lab     (https://maintainers.github.com) Maintainer Community     (https://stars.github.com) GitHub Stars     (https://archiveprogram.github.com) Archive Program        REPOSITORIES (https://github.com/topics) Topics   (https://github.com/trending) Trending   (https://github.com/collections) Collections          Enterprise   ENTERPRISE SOLUTIONS (https://github.com/enterprise)   Enterprise platform AI-powered developer platform       AVAILABLE ADD-ONS (https://github.com/security/advanced-security)   GitHub Advanced Security Enterprise-grade security features    (https://github.com/features/copilot/copilot-business)    Copilot for Business Enterprise-grade AI features    (https://github.com/enterprise/premium-support)   Premium Support Enterprise-grade 24/7 support           (https://github.com/pricing) Pricing      Search /       (https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Flostmsu%2FTurboGPT) Sign in    (https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=lostmsu%2FTurboGPT) Sign up         Appearance settings            You signed in with another tab or window. (TurboGPT.html) Reload to refresh your session. You signed out in another tab or window. (TurboGPT.html) Reload to refresh your session. You switched accounts on another tab or window. (TurboGPT.html) Reload to refresh your session.    Dismiss alert       (https://github.com/lostmsu) lostmsu   / (TurboGPT.html) TurboGPT   Public   (https://github.com/login?return_to=%2Flostmsu%2FTurboGPT)   Notifications  You must be signed in to change notification settings  (https://github.com/login?return_to=%2Flostmsu%2FTurboGPT)   Fork (0) 0   (https://github.com/login?return_to=%2Flostmsu%2FTurboGPT)   Star  (9) 9        (TurboGPT.html)   Code (Not available)    (https://github.com/lostmsu/TurboGPT/issues)    Issues (0) 0   (https://github.com/lostmsu/TurboGPT/pulls)   Pull requests (0) 0   (https://github.com/lostmsu/TurboGPT/actions)   Actions (Not available)    (https://github.com/lostmsu/TurboGPT/projects)   Projects (Not available)    (https://github.com/lostmsu/TurboGPT/security)   Security and quality (0) 0   (https://github.com/lostmsu/TurboGPT/pulse)   Insights (Not available)        Additional navigation options (TurboGPT.html)    Code    (https://github.com/lostmsu/TurboGPT/issues)     Issues    (https://github.com/lostmsu/TurboGPT/pulls)    Pull requests    (https://github.com/lostmsu/TurboGPT/actions)    Actions    (https://github.com/lostmsu/TurboGPT/projects)    Projects    (https://github.com/lostmsu/TurboGPT/security)    Security and quality    (https://github.com/lostmsu/TurboGPT/pulse)    Insights                (TurboGPT.html)          master           (https://github.com/lostmsu/TurboGPT/branches)    Branches   (https://github.com/lostmsu/TurboGPT/tags)    Tags    (https://github.com/lostmsu/TurboGPT/branches)    (https://github.com/lostmsu/TurboGPT/tags)          (Go to file) ()      Go to file        Code         Open more actions menu     Latest commit   History (https://github.com/lostmsu/TurboGPT/commits/master/)    9 Commits     (https://github.com/lostmsu/TurboGPT/commits/master/)      9 Commits      Folders and files Name  Name  (Last commit message) Last commit message   (Last commit date) Last commit date       (cuda) (https://github.com/lostmsu/TurboGPT/tree/master/cuda) cuda        (cuda) (https://github.com/lostmsu/TurboGPT/tree/master/cuda) cuda              (tests) (https://github.com/lostmsu/TurboGPT/tree/master/tests) tests        (tests) (https://github.com/lostmsu/TurboGPT/tree/master/tests) tests              (.clang-format) (https://github.com/lostmsu/TurboGPT/blob/master/.clang-format) .clang-format        (.clang-format) (https://github.com/lostmsu/TurboGPT/blob/master/.clang-format) .clang-format              (.gitignore) (https://github.com/lostmsu/TurboGPT/blob/master/.gitignore) .gitignore        (.gitignore) (https://github.com/lostmsu/TurboGPT/blob/master/.gitignore) .gitignore              (LICENSE) (https://github.com/lostmsu/TurboGPT/blob/master/LICENSE) LICENSE        (LICENSE) (https://github.com/lostmsu/TurboGPT/blob/master/LICENSE) LICENSE              (README.md) (https://github.com/lostmsu/TurboGPT/blob/master/README.md) README.md        (README.md) (https://github.com/lostmsu/TurboGPT/blob/master/README.md) README.md              (build.ps1) (https://github.com/lostmsu/TurboGPT/blob/master/build.ps1) build.ps1        (build.ps1) (https://github.com/lostmsu/TurboGPT/blob/master/build.ps1) build.ps1              (checkpoint.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/checkpoint.cpp) checkpoint.cpp        (checkpoint.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/checkpoint.cpp) checkpoint.cpp              (checkpoint.h) (https://github.com/lostmsu/TurboGPT/blob/master/checkpoint.h) checkpoint.h        (checkpoint.h) (https://github.com/lostmsu/TurboGPT/blob/master/checkpoint.h) checkpoint.h              (config.h) (https://github.com/lostmsu/TurboGPT/blob/master/config.h) config.h        (config.h) (https://github.com/lostmsu/TurboGPT/blob/master/config.h) config.h              (dataset.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/dataset.cpp) dataset.cpp        (dataset.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/dataset.cpp) dataset.cpp              (dataset.h) (https://github.com/lostmsu/TurboGPT/blob/master/dataset.h) dataset.h        (dataset.h) (https://github.com/lostmsu/TurboGPT/blob/master/dataset.h) dataset.h              (default.nix) (https://github.com/lostmsu/TurboGPT/blob/master/default.nix) default.nix        (default.nix) (https://github.com/lostmsu/TurboGPT/blob/master/default.nix) default.nix              (experiment.h) (https://github.com/lostmsu/TurboGPT/blob/master/experiment.h) experiment.h        (experiment.h) (https://github.com/lostmsu/TurboGPT/blob/master/experiment.h) experiment.h              (loss_summary.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/loss_summary.cpp) loss_summary.cpp        (loss_summary.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/loss_summary.cpp) loss_summary.cpp              (loss_summary.h) (https://github.com/lostmsu/TurboGPT/blob/master/loss_summary.h) loss_summary.h        (loss_summary.h) (https://github.com/lostmsu/TurboGPT/blob/master/loss_summary.h) loss_summary.h              (model.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/model.cpp) model.cpp        (model.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/model.cpp) model.cpp              (model.h) (https://github.com/lostmsu/TurboGPT/blob/master/model.h) model.h        (model.h) (https://github.com/lostmsu/TurboGPT/blob/master/model.h) model.h              (optim.h) (https://github.com/lostmsu/TurboGPT/blob/master/optim.h) optim.h        (optim.h) (https://github.com/lostmsu/TurboGPT/blob/master/optim.h) optim.h              (report.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/report.cpp) report.cpp        (report.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/report.cpp) report.cpp              (report.h) (https://github.com/lostmsu/TurboGPT/blob/master/report.h) report.h        (report.h) (https://github.com/lostmsu/TurboGPT/blob/master/report.h) report.h              (revision.h) (https://github.com/lostmsu/TurboGPT/blob/master/revision.h) revision.h        (revision.h) (https://github.com/lostmsu/TurboGPT/blob/master/revision.h) revision.h              (runtime.h) (https://github.com/lostmsu/TurboGPT/blob/master/runtime.h) runtime.h        (runtime.h) (https://github.com/lostmsu/TurboGPT/blob/master/runtime.h) runtime.h              (sampling.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/sampling.cpp) sampling.cpp        (sampling.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/sampling.cpp) sampling.cpp              (sampling.h) (https://github.com/lostmsu/TurboGPT/blob/master/sampling.h) sampling.h        (sampling.h) (https://github.com/lostmsu/TurboGPT/blob/master/sampling.h) sampling.h              (tensorboard.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/tensorboard.cpp) tensorboard.cpp        (tensorboard.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/tensorboard.cpp) tensorboard.cpp              (tensorboard.h) (https://github.com/lostmsu/TurboGPT/blob/master/tensorboard.h) tensorboard.h        (tensorboard.h) (https://github.com/lostmsu/TurboGPT/blob/master/tensorboard.h) tensorboard.h              (train.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/train.cpp) train.cpp        (train.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/train.cpp) train.cpp              (trainer.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/trainer.cpp) trainer.cpp        (trainer.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/trainer.cpp) trainer.cpp              (trainer.h) (https://github.com/lostmsu/TurboGPT/blob/master/trainer.h) trainer.h        (trainer.h) (https://github.com/lostmsu/TurboGPT/blob/master/trainer.h) trainer.h              (training_log.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/training_log.cpp) training_log.cpp        (training_log.cpp) (https://github.com/lostmsu/TurboGPT/blob/master/training_log.cpp) training_log.cpp              (training_log.h) (https://github.com/lostmsu/TurboGPT/blob/master/training_log.h) training_log.h        (training_log.h) (https://github.com/lostmsu/TurboGPT/blob/master/training_log.h) training_log.h              (utils.h) (https://github.com/lostmsu/TurboGPT/blob/master/utils.h) utils.h        (utils.h) (https://github.com/lostmsu/TurboGPT/blob/master/utils.h) utils.h            View all files       Repository files navigation  (TurboGPT.html#)    README   (TurboGPT.html#)    MIT license     Moreitems               turboGPT (TurboGPT.html#turbogpt)     Tiny byte-level GPT training in CUDA C++. MIT. Build (TurboGPT.html#build)     Linux/NixOS: nix-build -o build/nix-result  Windows, Visual Studio 2022 C++ tools, and CUDA 13.4: .\build.ps1 - CudaArch 86   CudaArch is the GPU compute capability from (https://developer.nvidia.com/cuda-gpus) NVIDIA's CUDA GPU list . Run (TurboGPT.html#run)     .\build\turbogpt.exe -- data hn1g.txt -- log- to runs/ ctx4  The run stores its checkpoint at runs/ctx4/ctx4.pt , containing model, optimizer, scheduler, and trainer state.
Use --load CHECKPOINT.pt to resume it. runs/ctx4/report.json is derived from the log directory. Logs are TensorBoard-compatible:
one report per batch, capped at 8Mi reports, and flushed with periodic or final checkpoints. Result (TurboGPT.html#result)     hn1g after 1.5G training tokens: 2.5295 BPB .  Tests (TurboGPT.html#tests)     python tests\verify.py           About  Train a tiny GPT in under a minute (CUDA only) Resources  (TurboGPT.html#readme-ov-file)   Readme   (TurboGPT.html#MIT-1-ov-file)   MIT license   (https://github.com/lostmsu/TurboGPT/activity)   Activity   Stars    9 stars  Watchers    0 watching  Forks  (https://github.com/lostmsu/TurboGPT/forks)   0  forks   (https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Flostmsu%2FTurboGPT&report=lostmsu+%28user%29) Report repository    Releases     Packages    Contributors    Languages                            Footer (https://github.com)    © 2026 GitHub, Inc.   Footer navigation (https://docs.github.com/site-policy/github-terms/github-terms-of-service) Terms  (https://docs.github.com/site-policy/privacy-policies/github-privacy-statement) Privacy  (https://github.com/security) Security  (https://www.githubstatus.com/) Status  (https://github.community/) Community  (https://docs.github.com/) Docs  (https://support.github.com?tags=dotcom-footer) Contact  Manage cookies    Do not share my personal information              You can’t perform that action at this time.