Data●●●Banger
HN-fdw – All of Hacker News, queryable from Postgres, with zero copies
Zero-copy Postgres queries against 47M rows using DuckDB FDW and HTTP range requests.
WizardryBig BrainDark Horse
tamnd
202mo ago
Back to browse
Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m
by tamnd·Mar 14, 2026·408 points·167 comments
AI Analysis
●●SolidNiche GemSolve My Problem
47M HN items in Parquet, auto-updating every 5 minutes on Hugging Face.
Strengths
- •Parquet format optimized for analytics and ML pipelines
- •Auto-updates every 5 minutes—always current
- •Hosted on Hugging Face with built-in dataset viewer and API access
Weaknesses
- •HN data already available via BigQuery and official Firebase dump
- •Parquet format is nice but not groundbreaking for data engineers
Category
Target Audience
Data scientists, ML researchers, HN analysts
Similar To
Google BigQuery public datasets · Firebase HN dump · Hugging Face datasets
Similar Projects
Data●●●Banger
The complete Open Library catalog in clean, analysis-ready Parquet
Clean Parquet dump of 55M Open Library rows saves weeks of data cleaning.
Solve My ProblemBig Brain
tamnd
102mo ago
Other●Mid
A daily archive of the top stories on Hacker News, organized by date
Curated HN links in a README—Colin Percival already did this in 2010.
Cozy
tamnd
112mo ago
Open Source●●●Banger
Self-hosted static archive of 20 years of Hacker News
Runs 22GB of HN history entirely in-browser using lazy-loaded SQLite shards over WebAssembly.
Rabbit HoleZero to OneWizardry
keepamovin
1125d ago
Developer Tools●●Solid
Web Push Notifications for Hacker News
Real-time HN push notifications powered by Val Town and Firebase SSE.
Niche GemShip It
kinlan
512mo ago
Other●Mid
Mobile Hacker News Reader – real time, dark mode
Yet another HN reader in a space with dozens of established options.
Cozy
weekendproject
402mo ago