digitallyfree

6 ms·

1.
by digitallyfree 3y ago
If you want to take it even further a fully virtualized Opnsense with Proxmox is amazing. Your router can float between cluster nodes and each VLAN becomes a virtual interface in the hypervisor. What still blows my mind is how I can migrate
2.
by digitallyfree 3y ago
Since you're releasing this under GPLv3 this is indeed open source. Having multiple license options does not affect this.
3.
by digitallyfree 3y ago
It's not a community per se but there's a lot of research and discussion going on directly in the llama.cpp repo ( https://github.com/ggerganov/llama.cpp ) if you're interested in the more technical side o
4.
by digitallyfree 3y ago
It certainly looks like it if you check their discussion board.
5.
by digitallyfree 3y ago
Likely it's hosted on the same infrastructure. The general recommendation is to host the status page on different provider so it's more likely to stay up.
6.
by digitallyfree 3y ago
It's not even source code, it's the fact that this just looks super sketchy in general. The website http://faction504.com/ listed just links directly to the Play Store page. There's no info on what Blackpage
7.
by digitallyfree 3y ago
The issue with AMD and AI is, as always, the software stack. Even if the hardware is great ROCM simply doesn't have industry traction and accessiblity.
8.
by digitallyfree 3y ago
If you ask me to make an account before I can see your content (even if it looks interesting) that's a turn off and I'll go somewhere else. Maybe have a button at the top that says "explore as guest" or something like th
9.
by digitallyfree 3y ago
I don't like the centralization of Cloudflare, but it's the only way I can host public web pages out of my homelab with a DSL connection. I would rather have a CDN than put my content on a VPS as the servers remain 100% under my c
10.
by digitallyfree 3y ago
If we look at this from a technical perspective, what is the cost of running such a service? Something like Facebook obviously costs a lot more to run, as it stores photos and video and also provides each user with an individually generated
11.
by digitallyfree 3y ago
Yeah as a long-time user I was really hoping for that myself, or at least have some sort of compromise. Certainly not that trainwreck of an AMA.
12.
by digitallyfree 3y ago
Wouldn't that be Hetzner?
13.
by digitallyfree 3y ago
It's not easy to move a group to a new platform, and there's very little people using Lemmy currently. The thing about Reddit despite its flaws is that it allows access to many large communities with a single account.
14.
by digitallyfree 3y ago
OpenLLAMA will be released soon and it's 100% compatible with the original LLAMA. https://github.com/openlm-research/open_llama
15.
by digitallyfree 3y ago
The fact that this is commodity hardware makes ggml extremely impressive and puts the tech in the hands of everyone. I recently reported my experience running 7B llama.cpp on a 15 year old Core 2 Quad [1] - when that machine came out it w
16.
by digitallyfree 3y ago
Likely you can use a Bluetooth keyboard and mouse with it.
17.
by digitallyfree 3y ago
It also doesn't have ECC as well which was a staple of the previous Mac Pro line.
18.
by digitallyfree 3y ago
I personally like the Adminforge instance https://teddit.adminforge.de . It's much quicker than the original teddit.net.
19.
by digitallyfree 3y ago
Theoretically the ARC should work with llama.cpp using OpenCL, but I haven't seen benchmarks or even a confirmation that it works.
20.
by digitallyfree 3y ago
I think the tinybox is meant to be a training/inference server meant for tinygrad and filled with those AMD cards. Very likely it will run Linux.
21.
by digitallyfree 3y ago
I learned from the start on lead-free RoHS solder (doing SMT work) and had zero issues with it. Honestly I've never tried leaded solder as I just use lead-free all the time, though I know people who swear by it.
22.
by digitallyfree 3y ago
This is the reason why I still stick with OpenVPN on TCP 443 for my selfhosted VPN. Yes performance suffers a bit but it works absolutely everywhere including behind campus/corp firewalls as no one blocks TCP 443. I've tried runni
23.
by digitallyfree 3y ago
This project is doing LLMs of all things with WebGPU too! https://mlc.ai/web-llm/
24.
by digitallyfree 3y ago
> “One kid kept opening up game sites” said one high school teacher who asked to stay anonymous, to protect the identities of their students. “I would wait for them to open one, add it to my list of blocked websites, refresh my settings,
25.
by digitallyfree 3y ago
What's the difference between Viogpu and the older Virgil3d?
26.
by digitallyfree 3y ago
Honestly your Reddit comment was probably already archived on Pushshift as soon as you posted it.
27.
by digitallyfree 3y ago
Privacy and security is a big desire for the people running these lower-quality local models. These assistants are becoming more and more powerful and people want to use them for personal tasks. For instance someone might want to chat about
28.
by digitallyfree 3y ago
For a single unit one could have it in their home or office, rather than a datacenter or colo. If the user sets up and manages the machine themselves there is no additional IT cost. The greatest operating expense would be the power cost.
29.
by digitallyfree 3y ago
While verification could be done for a cloud service like this one, what's more concerning is that locally run models with this tech will be coming soon (think of LLAMA and Stable Diffusion). KYC is merely a stopgap and honestly we&#x2
30.
by digitallyfree 3y ago
I guess I didn't really word this clearly, my intent was to state that the manual camera generally captures real-world conditions as a baseline. Then the photographer could in camera or in post manipulate the image to fulfill his artis

More ›