sc077y

7 ms·

1.
by sc077y 2mo ago
A lot of the heads of AI labs are talking about this including Dario, Demis and ELon, they are seeking to do a sort of decentralized peer review system, where the competitors have incentive both for self interest and global interest to flag
2.
by sc077y 2mo ago
All the AGI (which is a misnomer, ASI is preferred) talk is about the moment of singularity, which is where the growth at the third derivative is increasing, so the gap (in the absolute) between first place and others, even if it's one
3.
by sc077y 9mo ago
Who knew that English would be the most popular programming language of 2025?
4.
by sc077y 10mo ago
73% of statistics are wrong
5.
by sc077y 1y ago
I believe the ARC-AGI benchmark fits that description, it's sort of an IQ test for LLMs, though I would caution against using the word "Intelligence" for LLMs.
6.
by sc077y 1y ago
Woz is just a nerd, simple as that. And he stayed true to himself and that ethos his whole life.
7.
by sc077y 1y ago
Every time you use these tools irresponsibly, for instance for what I like to call headless programming (vibe coding), understand that you are incurring tech debt. Not just in terms of your project but personal debt regarding what you SHOUL
8.
by sc077y 1y ago
Critical Skills is spotting the potential bugs before they happen but in order to do that you need to have an extremely acute understanding or a have a lot of experience in the stack, libs and programming language of choice. Something that,
9.
by sc077y 1y ago
In that case, you use copy OR what you can can also do, if you really care about disk usage, is use symbolic links between the drives. have a .venv sym link on drive A (raid 1) point to the uv_cache_dir's venv on drive B (raid 0). I ha
10.
by sc077y 1y ago
I tried installing and setting up the project today, it was miserable. I finally got it to work only to find out that the mistral models' tool calling does not work at all for claude code. Also, there is no mention anywhere of what mod
11.
by sc077y 1y ago
I recently saw an interview without someone on the mac team and what's interesting is that the original Mac team had a lot of friction because of this philosophy. Jobs constantly asked unreasonable design constraints of his engineering
12.
by sc077y 1y ago
By default it will create hard links for python packages, so it won't consume any more memory (besides the small overhead of hard links).
13.
by sc077y 1y ago
I tried Multi-Account Containers to try isolate my work from my personal but it just wasn't good enough. History, bookmarks, passwords and plugins were all shared. Do I really need twitch emotes and every personal password on my work e
14.
by sc077y 1y ago
I'm wondering if one of the big reasons that OpenAI is making gpt-4.5 deprecated is not only because it's not cost-effective to host but because they don't want their parent model being used to train competitors' models
15.
by sc077y 1y ago
DocLayout-YOLO model is under the AGPL-3.0 license, it's not permissive. You can't have your project under the MIT license and also use copyleft software.
16.
by sc077y 1y ago
The problem I see with this definition is that we have things called RAG agents which don't technically act in any environment except for provide information.
17.
by sc077y 2y ago
The way that the embedding is done is using Matryoshka Representation Learning, truncating it allows to compress while losing as little meaning as possible. In some sense it's like dimensionality reduction.
18.
by sc077y 2y ago
Actually the rate of hallucination is not constant across the board. For one you're doing a sort of synthesis, not intense reasoning or retrieval with the llm. Second, the problem is segmented into sub problems much like how gpt-o1 or
19.
by sc077y 2y ago
Given that it's a French company I can almost guarantee that it was written/translated using an LLM.
20.
by sc077y 2y ago
This is impressive, it's hard to imagine all the implications of a BMI.
21.
by sc077y 2y ago
The real question here is who puts their API keys on a slack server ?
22.
by sc077y 2y ago
Damn I built a RAG agent during the past 3 months and a half for my internship. And literally everyone in my company was asking me why I wasn't using llangchain or llamaindex like I was a lunatic. Everyone else that built a rag in my c
23.
by sc077y 2y ago
Shkreli has actually sent the album to various people. He used to used to send it to any girl who asked for it back in the day. It's not that exclusive. Also according to Martin, now that he has sold the album, the album is mediocre.
24.
by sc077y 2y ago
I'm skeptical of the on-device AI. They crave edge compute but I'm doubtful their chips can handle a 7B param model. Maybe ironically with Microsoft's phi 3 mini 4k you can run this stuff on a cpu but today it's no where
25.
by sc077y 2y ago
Impressive not technically because nothing here is new but because it's the first real implementation for the average end consumers of "ai". You have semantic indexing which allows series to basically retrieve context for any
26.
by sc077y 2y ago
This is 100 percent doable. Building something like this at scale might be a pain but locally it's fairly easy.
27.
by sc077y 2y ago
Very interesting. I'm building a RAG chatbot and I haven't done the inline citations yet, I honestly thought it was a lot more complicated then just telling the llms to cite with a number and then have numbers next the sources. I
28.
by sc077y 2y ago
There are already a lot of open bibliographic databases, semantic Scholar and OpenAlex and to some extent Google Scholar. Researchers need fulltext analysis which with half of publications being locked behind a paywall makes it very tedious
29.
Ask HN: Questions about LLM context window
1 points by sc077y 2y ago|0 comments
30.
by sc077y 2y ago
Thinking back, if LLMs are able to have Memory store and access then RAG becomes useless. RAG is like a system that shoves bits down the RAM (Context Window) and ask the cpu(LLM) to compute something. But If you expand the RAM to a ridiculo

More ›