Feed aggregator

While using LLMs I realized 2 points:

- I often still prefer Google, because I feel like I can get an answer quicker - I'd rather ask a smaller LLM a few questions than gpt-4 just one - The latency of LLMs is often enough to lose your momentum or abort the generation

So I asked myself how I could built the fastest LLM prompt for the CLI? My best guess is to use the fastest language (Rust ) and the fastest LLM (Mixtral powered by https://groq.com)

And it's a game changer for me! At this speed it can replace most Googling, reading man pages, looking stuff up, … I can't wait to extend it with more features! =)

Do you any ideas how to get it even faster?

Comments URL: https://news.ycombinator.com/item?id=39858881

Points: 1

# Comments: 0

Article URL: https://amontalenti.com/2024/03/26/the-smartphone-app-audit

Comments URL: https://news.ycombinator.com/item?id=39858866

Points: 1

# Comments: 0

Article URL: https://www.thedrive.com/news/nobody-told-ev-owners-how-quickly-they-burn-through-tires

Comments URL: https://news.ycombinator.com/item?id=39858860

Points: 2

# Comments: 0

Article URL: https://www.jdsupra.com/legalnews/utah-passes-artificial-intelligence-1386840/

Comments URL: https://news.ycombinator.com/item?id=39858852

Points: 7

# Comments: 2

Article URL: https://arstechnica.com/gadgets/2024/03/netflix-ad-spend-led-to-facebook-dm-access-end-of-facebook-streaming-biz-lawsuit/

Comments URL: https://news.ycombinator.com/item?id=39858850

Points: 25

# Comments: 0

Article URL: https://theglobeataglance.com/

Comments URL: https://news.ycombinator.com/item?id=39858824

Points: 1

# Comments: 1

Article URL: https://github.com/joaomdmoura/crewAI

Comments URL: https://news.ycombinator.com/item?id=39858794

Points: 2

# Comments: 0

Article URL: https://bigthink.com/neuropsych/frans-de-waal-dies-at-75/

Comments URL: https://news.ycombinator.com/item?id=39858790

Points: 1

# Comments: 0

Full-size mattresses are great for smaller spaces, single sleepers and kids or teens. Here are the best full mattresses, tested and reviewed by our sleep experts.

While online disinformation is nothing new, artificial intelligence could take it to frighting new levels, the former secretary of state says.

Article URL: https://archiveofourown.org/works/54711364

Comments URL: https://news.ycombinator.com/item?id=39858478

Points: 1

# Comments: 0

Deals on the latest Apple Watch Ultra 2 and OG Apple Watch Ultra are hard to come by, but that doesn't mean they don't exist.

Article URL: https://twitter.com/andercot/status/1773459918693274090

Comments URL: https://news.ycombinator.com/item?id=39858439

Points: 1

# Comments: 0