Nate
·shared a media post in group #Artificial Intelligence
The first public demo using Groq: a lightning-fast AI Answers Engine.
It writes factual, cited answers with hundreds of words in less than a second.
More than 3/4 of the time is spent searching, not generating!
The LLM runs in a fraction of a second.
Wild tech you have to try: https://groq.com
They are serving Mixtral at nearly 500 tok/s.
Answers are pretty much instantaneous.
Opens up new use-cases, and completely changes the UX possibilities of existing ones.
