Back to browse

I mapped 8.5M research papers into an interactive atlas

by leonickson·Jul 9, 2026·2 points·0 comments

AI Analysis

●●●BangerRabbit HoleWizardryBig Brain

8.5M papers in a WebGL map with MCP server access for AI agents.

Strengths
  • UMAP embeddings at 8.5M paper scale with real-time WebGL rendering is genuinely impressive.
  • PubTator entity normalization links genes, drugs, diseases to real IDs not regex.
  • MCP server integration lets AI agents query the entire corpus without PDF pasting.
Weaknesses
  • Browser extension marked unavailable on Chrome Web Store limits adoption.
  • Competes with Semantic Scholar and Connected Papers who have more established networks.
Category
Target Audience

Researchers, academics, and AI developers working with scientific literature

Similar To

Semantic Scholar · Connected Papers · Elicit

Post Description

Reading a paper means opening a PDF, then hunting separately for the code, the citations, whether it replicated, and what genes/drugs it touches. I spent a few months trying to fix that.

Two parts:

1. The map: I embedded 8.5M papers (arXiv, PubMed Central, bioRxiv, medRxiv), ran UMAP to lay them out in 2D, and render them with a WebGL scatterplot. Every dot is a paper — click it for an LLM TLDR, key findings, citations, peer reviews (where they exist), and similar work. Zoom in and the clusters are labeled by topic.

2. Rich paper pages + an MCP server: each paper is rebuilt with linked genes/proteins/diseases/drugs (normalized to real IDs via PubTator, not regex), clinical trials, 3D structures, code, and a citation graph. It's all exposed as an MCP server too, so you can point Claude or an agent at 8.5M papers instead of pasting PDFs.

Stack: Next.js, Postgres (Neon), Cloudflare R2 for content, embeddings + UMAP/HDBSCAN for the map, a WebGL renderer. The hard part was the ingestion pipeline — 45+ heterogeneous sources normalized into one schema — and keeping entity links accurate, since papers use names not accession IDs (so curated link tables + PubTator beat regex every time).

Free, no signup to explore. I'd love feedback on the map UX and whether the TLDRs/entity links hold up for papers you know well.

Known limits: Google indexing is still slow so title-search isn't great yet, some older arXiv figures are missing, and peer-review coverage is partial.

Similar Projects

Data●●●Banger

Map of 5000 YC Startups

2D embedding visualization makes browsing 5000 YC companies genuinely explorable.

Rabbit HoleBig BrainEye Candy
mdb19
101mo ago