fexelein

6 ms·

1.
by fexelein 1y ago
So I am running Ollama on Windows using an 10700k and 3080ti. I'm using models like Qwen3-coder (4/8b) and 2.5-coder 15b, Llama 3 instruct, etc. These models are very fast on my machine (~25-100 tokens per second depending on mode
2.
by fexelein 1y ago
I’m having a lot of fun using less capable versions of models on my local PC, integrated as a code assistant. There still is real value there, but especially room for improvements. I envision us all running specialized lightweight LLMs loca
3.
by fexelein 2y ago
On my machine, I am able to create a prompt that suits my need and chat with the model in realtime. With 100% GPU offload, it replies within half a second. LM studio provides an OpenAI compatible api endpoint for my Dotnet software to use.
4.
by fexelein 2y ago
As a cloud solution developer that has to build AI on Azure I have been using this instead of Azure OpenAI. It has sped up my development workflow a lot, and for my purposes it’s comparable enough. I’m using LM studio to load these models.
5.
by fexelein 3y ago
It seems to me like you don’t own this data. If you want to preserve this data, try again with the owner?
6.
by fexelein 4y ago
As recent as 2016 I was building some sites without any JavaScript. These weren’t small sites either. You can achieve a lot using some basic forms. It was quite fun
7.
by fexelein 4y ago
Hope it’s fast. I’m using a similar plugin which really is fast, but so many others are not!
8.
by fexelein 5y ago
I’m sad that a high end pc in 2022 is made from 2018 parts (gpu)
9.
by fexelein 5y ago
Cool link thanks
10.
by fexelein 5y ago
This came to mind. Somebody used excel to implement RSA as an educational tool. https://m.youtube.com/watch?v=zxMNNwvhj94
11.
by fexelein 5y ago
just make sure nobody ever uses it ;)
12.
by fexelein 5y ago
Why not?
13.
by fexelein 5y ago
It depends on the accuracy of the humans as well. Less accurate doesn’t mean not accurate.
14.
by fexelein 5y ago
As a code-first developer I never judge my work by code metrics or other things in the abstract. What does that even mean? I just cannot agree with most of the things said here. The definition of great code is not simplicity and test covera
15.
by fexelein 5y ago
The examples look like a lot more work. The ingredients and naming those into tuple variables, having to return the tuple type itself, three lambdas in there. What benefit do these abstractions give me over simply coding an Arrange/Act