Someone built a visualization of what 1 million tokens actually looks like

Comments

• undefinedTruth@lemmy.zip ⁨1⁩ ⁨hour⁩ ago

  75,000 lines of code. At about 13 tokens a line, a whole production codebase fits in one window: every file and every test, read together.

  How cute. If you are dealing with production codebases that are only 75K lines including the test you are a very lucky person.

  source
• inari@piefed.zip ⁨1⁩ ⁨hour⁩ ago

  Lol this page ends with a sales pitch

  source