Glimpse of the future: How hyperspeed inference allows for new class of ai driven apps

I will be expanding on a project I started a few months ago using the Cerebras inference engine, which offers speeds up to 1000 tokens/s, to demonstrate how AI models running at this rate requires new ways of thinking about AI app design and UX. The demo will show how an OS might work where AI tools are generated on demand.