Hacker News

For example, it could highlight important tokens in the context window as it outputs each word in its reply.

Comments URL: https://news.ycombinator.com/item?id=39963146

Points: 1

# Comments: 1

Article URL: https://www.rubick.com/evil-staging-gauntlet-programs/

Comments URL: https://news.ycombinator.com/item?id=39963140

Points: 1

# Comments: 0

Article URL: https://jacobbartlett.substack.com/p/the-case-against-unowned-self

Comments URL: https://news.ycombinator.com/item?id=39963135

Points: 1

# Comments: 0

I'm running a relatively simple app right now that makes use of EKS clusters for GPU workloads. Right now everything's pretty simple and working great, despite all of the warnings about k8s being complicated.

However, everything I have is currently scaled up and down manually. Looking into HPA it doesn't seem like it's a tool built for GPU tasks where each pod can only handle at most one unit of work at a time. I have both async GPU workers and a small flask API that uses GPUs. These are currently all using g4dn.xlarge EC2s. Essentially I want a scaling scheme where the number of nodes approximates the number of concurrent requests, up to a maximum.

I did look into simpler solutions like Replicate etc. but found they would be too limiting and a little bit over-simplified for us.

Edit: I know I should probably use k8s Jobs for the async worker stuff, but when I looked into it there seemed to be more operational complexity than I can handle. I'm a solo dev and set up workers that poll a Postgres job queue so they can manage themselves instead of there being yet another service to schedule and maintain k8s Jobs.

Comments URL: https://news.ycombinator.com/item?id=39963105

Points: 1

# Comments: 2

Article URL: https://renewablesnow.com/news/chevron-plans-5-mw-green-hydrogen-production-in-california-850408/

Comments URL: https://news.ycombinator.com/item?id=39963098

Points: 1

# Comments: 0

Article URL: https://lauratacho.com/blog/using-metrics-to-measure-individual-developer-performance

Comments URL: https://news.ycombinator.com/item?id=39963094

Points: 1

# Comments: 0

Article URL: https://qz.com/boeing-engine-cowling-southwest-faa-1851393993

Comments URL: https://news.ycombinator.com/item?id=39963068

Points: 3

# Comments: 1

Article URL: https://www.ft.com/content/26e54895-a37d-4ab1-baad-701d5ddcf150

Comments URL: https://news.ycombinator.com/item?id=39963060

Points: 3

# Comments: 0

Article URL: https://lareviewofbooks.org/article/the-bulgarian-computers-global-reach-on-victor-petrovs-balkan-cyberia/

Comments URL: https://news.ycombinator.com/item?id=39962737

Points: 2

# Comments: 0

Article URL: https://www.youtube.com/watch?v=tJc-ZtO5b_E

Comments URL: https://news.ycombinator.com/item?id=39962725

Points: 1

# Comments: 0

Article URL: https://en.wikipedia.org/wiki/IBM_System/360

Comments URL: https://news.ycombinator.com/item?id=39962714

Points: 1

# Comments: 0

Article URL: https://www.youtube.com/watch?v=TPKDkGQff28

Comments URL: https://news.ycombinator.com/item?id=39962692

Points: 1

# Comments: 0

Article URL: https://explorersweb.com/sperm-whales-attack-orcas-with-poo/

Comments URL: https://news.ycombinator.com/item?id=39962680

Points: 1

# Comments: 0

Article URL: https://archlinux.org/news/increasing-the-default-vmmax_map_count-value/

Comments URL: https://news.ycombinator.com/item?id=39962675

Points: 1

# Comments: 0

Article URL: https://www.forbes.com/sites/carltonreid/2024/04/06/french-revolution-cyclists-now-outnumber-motorists-in-paris/

Comments URL: https://news.ycombinator.com/item?id=39962666

Points: 3

# Comments: 0

Article URL: https://ipetkov.dev/blog/tips-and-tricks-for-nix-flakes/

Comments URL: https://news.ycombinator.com/item?id=39962649

Points: 1

# Comments: 0

Article URL: https://bsky.app/profile/mosseri.bsky.social/post/3kpimfpxjkh2r

Comments URL: https://news.ycombinator.com/item?id=39962644

Points: 1

# Comments: 0

There were no successful entrants to this contest: https://news.ycombinator.com/item?id=39949966

I myself was not able to complete the challenge in two attempts.

I record my attempts here: https://www.reddit.com/r/RoboInnovateChallenge/comments/1bwzpkg/prealpha_challenge_1_bring_fruit_to_mouth/kyi4cr7/

And a video walkthrough is available here: (pending)

The $10 prize pool will be rolled over into Challenge 2, which will be slightly more complicated.

Comments URL: https://news.ycombinator.com/item?id=39962620

Points: 1

# Comments: 0

Article URL: https://utcc.utoronto.ca/~cks/space/blog/programming/AutoconfNotReplaceable

Comments URL: https://news.ycombinator.com/item?id=39962617

Points: 3

# Comments: 1

Article URL: https://www.youtube.com/watch?v=UQuIVsNzqDk

Comments URL: https://news.ycombinator.com/item?id=39962615

Points: 1

# Comments: 0