ericcurtin

10 ms·

1.
by ericcurtin 10mo ago
Time to use some local ai with Docker Model Runner :) No cloudflare no problem https://github.com/docker/model-runner
2.
by ericcurtin 10mo ago
I'm one of the devs, happy to answer any questions
3.
Show HN: Docker Model Runner Integrates vLLM for High-Throughput Inference(github.com)
7 points by ericcurtin 10mo ago|1 comments
4.
by ericcurtin 10mo ago
Will be around the next few hours
5.
Show HN: Run Unsloth Dynamic GGUFs using Docker model runner(github.com)
3 points by ericcurtin 10mo ago|1 comments
6.
by ericcurtin 11mo ago
Hi everyone, we're the maintainers. We're rebooting the model-runner community and wanted to share what we've been up to and where we're headed. When we first built this, the idea was simple: make running local models as
7.
Show HN: Docker/Model-Runner – Join Us in Revitalizing the DMR Community(github.com)
14 points by ericcurtin 11mo ago|2 comments
8.
by ericcurtin 11mo ago
Keep opening pull requests and issues, we need these things, you are right!
9.
by ericcurtin 11mo ago
Any new features you think we should add to further enhance your usage? Glad you find it useful
10.
by ericcurtin 11mo ago
Is there overlap with "Show HN: docker/model-runner – an open-source tool for local LLMs" posted today, we encapsulate AI workloads in containers using docker model runner. Some clear encapsulations advantages at a minimum. C
11.
by ericcurtin 11mo ago
What did you like? Anything stand out?
12.
by ericcurtin 11mo ago
Thanks very much. It worked well for you? Which hardware? :) Any other feedback, keep it coming!
13.
by ericcurtin 11mo ago
Hi everyone, we're the maintainers. We're rebooting the model-runner community and wanted to share what we've been up to and where we're headed. When we first built this, the idea was simple: make running local models as
14.
Show HN: docker/model-runner – an open-source tool for local LLMs(github.com)
18 points by ericcurtin 11mo ago|10 comments