5 ms·
LLM Chat via SSH
- kimjune01 1y agohey i just tried it. it's cool! i wish it was more self aware
- ccbikai 1y agoThank you for your feedback; I will optimize the prompt
- ccbikai 1y agoI am the author, thank you for your support. Welcome to help maintain it with me
- gsibble 1y agoWe made this a while ago on the web: https://terminal.odai.chat https://terminal.odai.chat
- amelius 1y agoI'd rather apt-get install something. But that seems not a possibility in the modern days of software distribution, especially with GPU-dependent stuff like LLMs. So yeah, I get why this exists.
- halJordan 1y agoWhat is the complaint here? There are plenty of binaries you can invoke through your cli that will query a remote llm api
- dncornholio 1y agoUsing React to render a CLI tool is something. I'm not sure how I feel about that. It feels like like 90% of the code is handling issues with rendering.
- demosthanos 1y agoI mean, it's a thin wrapper around LLM APIs, so it's not surprising that most of the code is rendering. I'm not sure what you're referring to by "handling issues with rendering", though—it looks like a pretty bog standard React app. Am I missing something?
- eisbaw 1y agoWhy not telnet?
- RALaBarge 1y agoNo HTTPS support
- benterix 1y agoI bet someone can write an API Gateway for this...
- accrual 1y agoI'd love to see an LLM outputting over a Teletype. Just tschtschtschtsch as it hammers away the paper feed.
- cap11235 1y agoLast week or so, there was the LLM finetune posted that speaks like a 19th century Irish author. I look forward a bit to having an LLModem model.
- t0ny1 1y agodoes this project request to llm providers?
- cap11235 1y agoAre you serious? Yeah, its using gemini 2.5 pro without a server, sure yeah.
- gclawes 1y agoIs this doing local inference? If so, what inference engine is it using?
- demosthanos 1y agoNo, it's a thin wrapper around an API, probably OpenRouter or similar: https://github.com/ccbikai/ssh-ai-chat/blob/master/src/ai/index.ts https://github.com/ccbikai/ssh-ai-chat/blob/master/src/ai/in...
- ccbikai 1y agoCurrently using the OpenAI API to access multiple models. You can use ollama to access local inference models
- demosthanos 1y agoSkimming the source code I got really confused to see TSX files. I'd never seen Ink (React for CLIs) before, and I like it! Previously discussions of Ink: July 2017 (129 points, 42 comments): https://news.ycombinator.com/item?id=14831961 https://news.ycombinator.com/item?id=14831961 May 2023 (588 points, 178 comments): https://news.ycombinator.com/item?id=35863837 https://news.ycombinator.com/item?id=35863837 Nov 2024 (164 points, 106 comments): https://news.ycombinator.com/item?id=42016639 https://news.ycombinator.com/item?id=42016639
- ccbikai 1y agoMany CLI applications are now using Ink to write their UIs. I suspect React will eventually standardize all UI writing approaches.
- ryancnelson 1y agothis is neat.... whose anthropic credits am i using, though? sonnet-4 isn't cheap! would i hit a rate-limit if i used this for daily work?
- gbacon 1y agoWow, that produced a flashback to using TinyFugue in the 90s. https://tinyfugue.sourceforge.net/ https://tinyfugue.sourceforge.net/ https://en.wikipedia.org/wiki/List_of_MUD_clients https://en.wikipedia.org/wiki/List_of_MUD_clients
- xigoi 1y agoIt’s not clear from the README what providers it uses and why it needs your GitHub username.
- ccbikai 1y agoConnects to any OpenAI-compatible API. Using a GitHub username prevents abuse.