Hacker News

Subscribe to Hacker News feed
Hacker News RSS
Updated: 7 min 41 sec ago

Marvel Fusion: Laser-driven fusion

Wed, 04/23/2025 - 5:48pm

Article URL: https://marvelfusion.com/

Comments URL: https://news.ycombinator.com/item?id=43776979

Points: 1

# Comments: 1

Categories: Hacker News

Yagri: You are gonna read it

Wed, 04/23/2025 - 5:47pm

Article URL: https://www.scottantipa.com/yagri

Comments URL: https://news.ycombinator.com/item?id=43776967

Points: 4

# Comments: 0

Categories: Hacker News

Git Koans

Wed, 04/23/2025 - 5:42pm
Categories: Hacker News

Show HN: Fast and Quality Code Chunking with Chonkie

Wed, 04/23/2025 - 5:41pm

Hi HN,

We’re Chonkie (https://github.com/chonkie-inc/chonkie) — we build open source tools that help split documents into meaningful chunks for use with AI models.

When you use LLMs over large documents or codebases, you often need to break them into smaller parts to fit the model’s context window. Our chunkers do this in a smart way: they preserve structure and meaning, so only the most relevant pieces are passed into the model. This reduces hallucinations, avoids confusion, and improves performance and accuracy.

Today we’re launching our Code Chunker — a fast, structure-aware way to break down source code into high-quality, token-aware chunks.

How it works:

(See the code: https://github.com/chonkie-inc/chonkie/blob/main/src/chonkie...)

Code Chunker uses tree-sitter (https://tree-sitter.github.io/tree-sitter/) to parse your code into an abstract syntax tree (AST). It then recursively merges and groups nodes in a way that respects both code structure and token limits.

It supports all languages that tree-sitter supports, and is designed to preserve formatting and semantics. Large functions or class definitions won’t be split in the middle of a block — instead, we dive recursively into the AST to produce clean, coherent chunks that fit your configured token budget.

What it’s useful for:

- Embedding-based code search - RAG (retrieval-augmented generation) over codebases - Long-context analysis of code - Preparing repos for fine-tuning or pretraining Try it out:

- Open source package: https://docs.chonkie.ai/chunkers/code-chunker - Hosted playground (free with account): https://cloud.chonkie.ai Happy Chonking!

Comments URL: https://news.ycombinator.com/item?id=43776908

Points: 1

# Comments: 0

Categories: Hacker News

How is π.com a valid domain name?

Wed, 04/23/2025 - 5:39pm

Article URL: https://www.xn--1xa.com/

Comments URL: https://news.ycombinator.com/item?id=43776891

Points: 2

# Comments: 4

Categories: Hacker News

FontDiffuser: Text to Font

Wed, 04/23/2025 - 4:56pm
Categories: Hacker News

Pages