Ask HN: You have model orders of magnitudes faster than transformer, so?

Summary

Hypothetically speaking: if you have cpu friendly ultimate "content generator" what would you do? Not saying it's the holy grail btw: so not "break satoshi's wallet", not "cure cancer" or turn mercury -> gold but say it has the power of common gpt 5+ except you don't need H100s to train it or 64gb ram but just boring old hp pc. And: context is very long + inference/generation is very fast. It may prove couple of unsolved mathematical conjecture here and there and it can make games with some effo

Analysis

5D Score