Tracking a real golf ball in mixed reality at 90 FPS using Quest 3 GPU

Name: Tracking a real golf ball in mixed reality at 90 FPS using Quest 3 GPU
Availability: InStock
Author: LeptonIceTea

by LeptonIceTea·Jun 23, 2026·2 points·0 comments

Visit Project View on HN

AI Analysis

●●●BangerWizardryNiche Gem

Three years of solo dev work solving real-ball-to-virtual handoff on Quest 3.

Strengths

•Custom CV algorithm runs on headset passthrough cameras at 90 FPS standalone.
•Latency correction work makes real-to-simulated ball handoff feel seamless.
•Detailed dev log shows prototype evolution from webcam rigs to final product.

Weaknesses

•Niche audience limited to Quest 3 owners interested in golf.
•Requires physical space and real golf equipment to use.

Post Description

Hi HN, I’m the solo developer of Putt Dojo. I've spent the last few years trying to make a real physical ball work convincingly inside mixed reality. The app now runs standalone on Quest 3/3S and tracks a real golf ball using a custom computer vision algorithm running on the headset passthrough cameras, then hands off to simulation once the ball starts moving.

The article describes the process of discovery and development of the product, and includes videos of some early exploratory prototypes, experiments, the latency correction work.

Happy to answer questions about the tracking, latency correction, passthrough camera constraints, or the techinical/design decisions that came out of trying to make this work.