{
    "byline": null,
    "charset": "UTF-8",
    "dir": null,
    "excerpt": "This is a brief guide to my new art project microgpt, a single file of 200 lines of pure Python with no dependencies that trains and inferences a GPT. This file contains the full algorithmic content of what is needed: dataset of documents, tokenizer, autograd engine, a GPT-2-like neural network architecture, the Adam optimizer, training loop, and inference loop. Everything else is just efficiency. I cannot simplify this any further. This script is the culmination of multiple projects (micrograd, makemore, nanogpt, etc.) and a decade-long obsession to simplify LLMs to their bare essentials, and I think it is beautiful \ud83e\udd79. It even breaks perfectly across 3 columns:",
    "lang": null,
    "length": 35064,
    "publishedTime": null,
    "siteName": null,
    "title": ""
}