netsroht

8 ms·

1.
by netsroht 17d ago
Sure, just consumer grade products: an ~8yr old 16 core AMD Threadripper CPU + 64 GB RAM, Samsung NVMe drive(s) and obviously an nvidia RTX 4090 (watercooled). Only the GPU is important though.
2.
by netsroht 21d ago
I have been looking for a good local setup for a while now. Qwen 3.8 27b is really good for a dense model of this size IMO. I already had an RTX 4090 and I forked ninfer [0] with the obsession to squeeze everything out of this card for this
3.
by netsroht 7mo ago
Remember when openai was too afraid to release the full GPT-2 model (this one had only 1.5B params) because humanity apparently wasn't ready for it. Look where we are just a couple of years later. I really admired them back in the day
4.
by netsroht 2y ago
Gadgetbridge added support for Garmin watches recently [1]. All data is stored on your Android phone with no internet connectivity required and you can even export the sqlite DB so you own your sensor data. The UI isn't as nice as Garm
5.
by netsroht 2y ago
Always cool seeing stuff in this space. Regarding "zeitgeist", about a year ago I built something similar called https://zeitgaist.ai which also incorporates other sources like Mastodon, Bluesky, some subreddits etc.
6.
by netsroht 3y ago
Thanks for the links. Using a disposable email with crypto payments and occasionally generating a new account to unlink from previous searches could be a viable intermediate solution. Also, I found this link [1] in the thread you mentioned.
7.
by netsroht 3y ago
I get your perspective. A lot of us just want a search engine that serves the user first, not advertisers, especially at the results level. It's about function over strict privacy for many--everyone has their own privacy threshold. But
8.
by netsroht 3y ago
I'm not a cryptography expert, but from my research, shouldn't it be possible to verify quota on ZKPs server-side? Essentially, the server doesn't need to know the specifics of the user's identity, just that they possess
9.
by netsroht 3y ago
Being logged in while making search queries in search engines poses significant privacy risks. The searches can paint a comprehensive profile of the user, and these data often remain stored for extended periods. There's a chance this i
10.
by netsroht 3y ago
Thanks for your input. This website should neither compete with nor replace regular journalism. What I try to achieve here is to be able to break free from social media silos where usually people are in kind of bubble. No one can read this
11.
by netsroht 3y ago
Because I intentionally process them with a very rudimentary "cartoonizer" in order to distinguish from a regular news articles and to emphasize that these stories are not written by humans. I don't know yet whether this help
12.
by netsroht 3y ago
Is my new project [0] also part of the problem? I'm still unsure myself because LLMs also allow us to process data in unprecedented ways. In my specific case, I auto generate stories to highlight different view points based on what peo
13.
by netsroht 3y ago
I regularly get these infinity captchas on Firefox as well. A couple of days ago I noticed that switching to a different Firefox container let's me pass the captchas.
14.
by netsroht 3y ago
When I started working on Zeitgaist [1] I immediately recognized that biased information is the main problem. I'm currently thinking about attaching additional information to the sources I present like ground [2] is doing with politica
15.
by netsroht 3y ago
I think he's just emphasizing that OpenAI is in fact not open, thusly it's crossed out.
16.
by netsroht 3y ago
AI is a very broad term. Most search engines use some kind of ML for building their search index and also for ranking because it works very well. > Do you want to avoid LLMs answering your search? I have not seen that widely adopted at a
17.
by netsroht 3y ago
I agree that showing the prompts will break the usability flow. I'm currently thinking about a way that let's users see the reasoning behind the AI agent - maybe in form of prompts if they explicitly enable it - for my current pro
18.
by netsroht 3y ago
LangChain is a great workaround for that. [1] > how to work with a memory module that remembers things about specific entities. It extracts information on entities (using LLMs) and builds up its knowledge about that entity over time (als
19.
by netsroht 3y ago
Can and will you really read all the sources that you find with Google? What about topics people are talking about on all the different social media platforms? Will you really read all the comments? I think these tools will help us break ou
20.
by netsroht 4y ago
This is why I prefer the term "weak AI". Weak AI is specifically trained to solve tasks whereas strong AI can teach itself to solve new tasks. Whether humans are able to create strong AI is a philosophical question: While some a
21.
by netsroht 4y ago
That's why more research should be poured into homomorphic encryption where you could send encrypted data to the API, OpenAI would then run computation on the encrypted data and we would only decrypt on the output locally. I would neve
22.
by netsroht 4y ago
Wow, a context of 32K tokens. I'm excited to see what new capabilities that will have! Up until now and depending on the task by hand, I usually broke a larger context down into several contexts. For example to summarize multiple websi
23.
by netsroht 4y ago
I use this method to answer questions about historic and real-time social media comments. https://foretale.io/toolbox/Social_Media_QA
24.
Show HN: Ask questions that the social media Zeitgeist will answer(foretale.io)
1 points by netsroht 4y ago|0 comments