Hacker News

Article URL: https://costhawk.ai/leaderboard

Comments URL: https://news.ycombinator.com/item?id=48152675

Points: 2

# Comments: 0

Article URL: https://www.jccf.ca/stop-bill-c-22-stop-surveillance-in-canada/

Comments URL: https://news.ycombinator.com/item?id=48152663

Points: 2

# Comments: 0

Article URL: https://gepa-ai.github.io/gepa/blog/2026/05/11/learning-fast-and-slow/

Comments URL: https://news.ycombinator.com/item?id=48152625

Points: 2

# Comments: 0

Article URL: https://www.theatlantic.com/politics/2026/05/honduras-deportations-without-children/687153/

Comments URL: https://news.ycombinator.com/item?id=48152620

Points: 2

# Comments: 0

Article URL: https://medium.com/@alanscottencinas/i-was-drowning-running-14-markets-alone-so-i-built-a-0-41-day-ai-employee-23f7ddf0f4a1

Comments URL: https://news.ycombinator.com/item?id=48152618

Points: 1

# Comments: 0

Article URL: https://www.nature.com/articles/s41586-026-10506-7

Comments URL: https://news.ycombinator.com/item?id=48152616

Points: 1

# Comments: 0

Article URL: https://marginalrevolution.com/marginalrevolution/2026/05/what-ive-been-reading-288.html

Comments URL: https://news.ycombinator.com/item?id=48152612

Points: 2

# Comments: 0

Article URL: https://www.youtube.com/watch?v=BBLDgsU7Zn4

Comments URL: https://news.ycombinator.com/item?id=48152133

Points: 1

# Comments: 0

Article URL: https://twitter.com/wgmorrow/status/2055100442737037566

Comments URL: https://news.ycombinator.com/item?id=48152123

Points: 1

# Comments: 0

Article URL: https://www.moreisdifferent.com/2015/07/16/why-physicsts-still-use-fortran/

Comments URL: https://news.ycombinator.com/item?id=48152122

Points: 2

# Comments: 0

When landing data I prefer to keep it as close to the original source as possible. Most of the Python data ingestion programs I saw treated Python more like SQL instead of harnessing object orientation. This was my attempt at translating my object-orented columnar approach to Python. I originally did it with Requests and Pandas but the overhead costs did not seem worth it. Claude helped refactor for async and Pydantic.

Now HTTPX’s async capabilities and Pydantic’s class building took this project over the top. By harnessing their abilities I shifted the codebase from data mapper to pipeline orchestrator. I added every format I could that seemed to have an established Python library. Right now I believe I support : JSON, NDJSON, XML, CSV, TSV, PSV, SQLite, and HTML out of the box. Optional extras (~30 MB pyarrow) unlock Parquet, Feather, ORC; Avro and XLSX have their own extras. I also added every compression I could find. Benchmarks at least for a windows machine are on par with other elt packages.

By focusing on function wrappers to make the developer’s syntax as easy as possible for the original data mapping calls, I established simple automated pipelines with one cli command and one JSON reference file. The JSON is basically the same syntax you would use in Python.

Both stream and fjord accept inflow and outflow Python code. Inflow code allows you to set custom conversion functions and mappings for the incoming data. The outflow code allows you to manipulate the exporting data into a new object new entirely.

Also, because your pipeline is basically created by a JSON file. You should eventually be able to automate the creation of the entire pipeline. Enjoy.

https://github.com/PyPlumber/Incorporator/

How you use it: Declare a subclass with no fields, point it at a URL, and it infers a Pydantic model from the response at runtime — with full strict typing, dot-notation, and an optional registry lookup by any key. class Launch(Incorporator): pass launches = await Launch.incorp( inc_url="https://ll.thespacedevs.com/2.2.0/launch/upcoming/" )

These functions handle the rest of your data mapping and export format needs: - test() lets the framework write the call kwargs for you - refresh() re-fetches with the seed call's params auto-replayed - export() serialises to any of the 13 formats

Then these functions create a pipeline. - stream() runs a chunked daemon with bounded memory. Can be used in two modes: pass-through or stateful (in RAM) updates to be manipulated in real-time. - fjord() fans out N sources and fuses them through a user reducer. This accepts multiple sources and exports.

After that all works copy the parameters into pipeline.json and the command can be as simple: incorporator validate pipeline.json incorporator fjord pipeline.json –logs

Comments URL: https://news.ycombinator.com/item?id=48152115

Points: 1

# Comments: 0

Article URL: https://nymag.com/intelligencer/article/carter-case-lawsuit-new-york-city-education-special-education-tuition.html

Comments URL: https://news.ycombinator.com/item?id=48152105

Points: 1

# Comments: 0

Article URL: https://optimisingnutrition.com/satiety-index/

Comments URL: https://news.ycombinator.com/item?id=48152079

Points: 1

# Comments: 0

Article URL: https://www.historytoday.com/archive/feature/heirs-and-spares-early-modern-france

Comments URL: https://news.ycombinator.com/item?id=48152047

Points: 1

# Comments: 0

Article URL: https://stockwire.work/

Comments URL: https://news.ycombinator.com/item?id=48152035

Points: 1

# Comments: 0

Article URL: https://www.youtube.com/watch?v=oV9rvDllKEg

Comments URL: https://news.ycombinator.com/item?id=48152005

Points: 1

# Comments: 0

Article URL: https://www.theverge.com/ai-artificial-intelligence/931122/openai-chatgpt-financial-accounts-plaid-connection

Comments URL: https://news.ycombinator.com/item?id=48151992

Points: 2

# Comments: 0

Article URL: https://blog.jgc.org/2026/05/the-aperiodic-table.html

Comments URL: https://news.ycombinator.com/item?id=48151990

Points: 1

# Comments: 0

Article URL: https://journal.stuffwithstuff.com/2015/02/01/what-color-is-your-function/

Comments URL: https://news.ycombinator.com/item?id=48151943

Points: 1

# Comments: 0

Article URL: https://hackaday.com/2026/05/15/using-a-nintendo-switch-to-speed-up-a-3d-printer/

Comments URL: https://news.ycombinator.com/item?id=48151937

Points: 2

# Comments: 0