Back to browse
GitHub Repository

GenAI prompts as runnable programs

48 starsRust

Execute local LLM prompts in remote shells

by tgalal·Mar 12, 2026·2 points·0 comments

AI Analysis

●●●BangerBig BrainWizardry

SSH proxy trick keeps LLM execution local while commands run on air-gapped servers.

Strengths
  • Prompts execute locally via SSH tunnel—servers need no outbound internet or LLM access.
  • Prompts become first-class CLI commands with --help, stdin/stdout, and argument parsing.
  • Built-in caching, load balancing, and model variants for production pipeline workflows.
Weaknesses
  • Niche audience—only valuable for developers regularly SSHing into remote servers.
  • Windows support unclear; SSH agent forwarding can be finicky across different setups.
Target Audience

DevOps engineers, backend developers working with remote servers

Similar To

Cursor · Continue.dev · Warp

Post Description

Instead of giving LLM tools SSH access or installing them on a server, the following command:

$ promptctl ssh user@server

makes a set of locally defined prompts "magically" appear within the remote shell as executable command line programs.

For example, I have locally defined prompts for `llm-analyze-config` and `askai`. Then on (any) remote host I can:

$ promptctl ssh user@host # Now on remote host $ llm-analyze-config /etc/nginx.conf $ cat docker-compose.yml | askai "add a load balancer"

the prompts behind `llm-analyze-config` and `askai` execute on my local computer (even though they're invoked remotely) via the llm of my choosing.

This way LLM tools are never granted SSH access to the server, and nothing needs to be installed to the server. In fact, the server does not even need outbound internet connections to be enabled.

Github: https://github.com/tgalal/promptcmd/

Similar Projects