albystein

7 ms·

1.
by albystein 1y ago
Hi Peter, Thanks for hosting this AMA. I’ve an immigration issue related to status transition. So I came to the U.S on an F-1 visa about 6 years ago. However, during the course of my undergraduate study, I found out that I qualified for TPS
2.
by albystein 2y ago
Just increased message limits to 100 per day
3.
Show HN: Free AI Mobile App Generator(bfloat.ai)
1 points by albystein 2y ago|2 comments
4.
by albystein 3y ago
this seems like a plausible outcome, and if true could spell disaster for OpenAI models relative to the competition and open source models. Currently, reliability is one of the core obstacles preventing widespread adoption of LLMs in many b
5.
by albystein 3y ago
this hypothesis makes a lot of sense. if indeed gpt-4 is a sparse MoE—which i believe it is—then OpenAI must have tested and proved their initial idea of a large capacity MoE LLM model first training/building a smaller one. this smalle
6.
by albystein 4y ago
I think hallucination is akin to encountering a problem on a test to which you don’t fully remember the right concept to solve it. You might attempt the problem with whatever little knowledge you can recall, but the answer is ultimately inc
7.
by albystein 4y ago
I think it depends on the sampling/decoding method. Also, perhaps you could elaborate more on what you mean by top_p
8.
by albystein 4y ago
this is not what language models typically output as logits though. perhaps the term now is being misused and it’s causing a lot of confusion
9.
by albystein 4y ago
Basically, logits are the raw outputs of the last linear layer of a neural network just before the softmax(for multi-class classification tasks) or the sigmoid(for binary classification tasks) is applied to the outputs.
10.
by albystein 4y ago
This is exactly how I understand it. Although, I feel the thermodynamics analogy might be more intuitive to most people
11.
by albystein 4y ago
I’m not sure if comparing it to the greedy algorithm is the correct way to think about it. Even after applying the temperature, if you use greedy decoding, you’ll still pick the output that has the highest probability. Where the concept of
12.
by albystein 4y ago
Typically, in new markets and product categories, you should not consider early complimentary products as competitors, but rather as partners. During these early days, all participants are still trying to validate the product value proposit
13.
by albystein 4y ago
I think this line of reasoning is misguided. What’s striking and more important to focus on are the abstract reasoning abilities of these systems. Language, as you mentioned, abstracts real world objects and phenomena, so it’s a good approx
14.
by albystein 4y ago
This a very well put comment with a great analogy. A new emerging paradigm of action-driven LLMs is taking the approach of using the reasoning abilities of LLMs to drive agents that can take actions, interact with other tools and computer p
15.
by albystein 4y ago
The problem of hallucination in LLMs is a well-known and studied problem and solutions have been proposed to counter it. The most promising one is augmenting LLMs with a retrieval system. This involves sourcing a large database of factual i
16.
Ethereum development made a whole lot easier(alchemyapi.io)
3 points by albystein 6y ago|1 comments
17.
by albystein 6y ago
Alchemy API is a suite of developer tools that powers 70% of the top ethereum DApps and projects like CrytoKitties, Compound, MakeDAO, Aave, Dharma, etc. They just officially opened their tools to the public after serving enterprise users i