alibero

6 ms·

1.
by alibero 16d ago
Thank you for this excellent post series. It reminds me a lot of the pre-LLM days, though I was mostly using LSTMs back then. When the original GPT paper came out, I thought the future would be using LLMs to generate tons of synthetic label
2.
by alibero 2mo ago
The current trajectory is also a mass dying of humans so hopefully we can thread the needle there.
3.
by alibero 7mo ago
I've been looking into this. There seems to be some mostly-repeating 2D pattern in the LSB of the generated images. The magnitude of the noise seems to be larger in the pure black image vs pure white image. My main goal is to doctor a
4.
by alibero 2y ago
Later down the line, if you want to have separate behaviour for task deadlines vs payment deadlines, you're going to have to go through your codebase and look at every call to set_deadline and figure out if it's being used to set
5.
by alibero 3y ago
I used to work at Yelp, which had something that I think it similar to what you are describing called Data Pipeline ( https://engineeringblog.yelp.com/2019/12/cassandra-source-co... ). I remember it being pretty sim
6.
by alibero 3y ago
Check out figures 1 & 2 in the Llama-2 paper :) They benchmark against ChatGPT for helpfulness and harmfulness https://ai.meta.com/research/publications/llama-2-open-found...
7.
by alibero 3y ago
It seems like VR is less than half of the investment by RL. In Meta's 2022 annual report, they say "Many of our metaverse investments are directed toward long-term, cutting edge research and development for products that are not o
8.
by alibero 4y ago
As one of the unsupervised dorks working on LLMs at Meta (not one of the authors here) I took it in a positive way :)
9.
by alibero 4y ago
I feel like this is a boring answer but for me, I had to make a habit of it, and then it didn't feel so hard any more. I started doing a master's degree in my free time: when I started I barely had the energy to do anything outsid
10.
by alibero 4y ago
> Finally, RLHF, or "RL with Human Feedback". This is a fancy way of saying that the model now observes two humans in a conversation, one playing the role of a user, and another playing the role of "the AI", demonstra
11.
by alibero 4y ago
I was under the impression you got a 60 day grace on the TN as well: https://www.ecfr.gov/current/title-8/chapter-I/subchapter-B/... "An alien admitted or otherwise provided status in E-1, E-2, E-3,
12.
by alibero 5y ago
What I’m seeing is that some big tech companies these days (including my own) have standardized rubrics [1] for leetcode-style questions that focus on a few areas (like DS&A, communication and coding style) so I can’t really give any ma
13.
by alibero 5y ago
Yes, I skipped or paraphrased those parts of the bill to keep things short in a way that I thought made sense. But I think the message is unchanged with the full text. Namely that Section 230 would be amended to also state: "NO EFFECT
14.
by alibero 5y ago
We do background checks, so hopefully we're not actually hiring people who tell big lies on their resumes. > IMO for the hopper it is also not easy I agree. I'm changing jobs soon and have some apprehension for the reasons you
15.
by alibero 5y ago
It's ok if my employer's competitors are advantaged because I'm switching jobs soon to get that sweet sweet pay bump anyways :)
16.
by alibero 5y ago
Guess it's time to start giving strong no hires to job hoppers then /s
17.
by alibero 5y ago
The part of the bill that mentions E2EE (Section 5) is an amendment to the Communications Act of 1934, namely the famous Section 230 which contains: "No provider or user of an interactive computer service shall be treated as the publis
18.
by alibero 5y ago
In my experience, being familiar with inductive proofs is pretty useful for programming. For most non-trivial code involving recursion or loops the way I personally "know it works" usually has the flavour of an inductive proof. Fo
19.
by alibero 5y ago
Waterloo also offers a BCS which has fewer math requirements than the BMath: https://cs.uwaterloo.ca/current-undergraduate-students/major... The BMath option is only required if you want to have a double major in CS an
20.
by alibero 5y ago
The relationship is that computing the SHA hashes takes polynomial time. One way you can think of NP is that it is the set of problems whose solutions that can be deterministically verified in polynomial time. So for any hash computable in
21.
by alibero 5y ago
You’re correct that there is no proof of the security of SHA1. The existence of any one-way function would imply that P != NP. And if it turns out that P = NP then it will turn out that most of the cryptographic guarantees we rely on today
22.
by alibero 5y ago
I had a similar experience but I don’t really regret choosing not to skip grades. I didn’t really bloom socially until I hit university either but I think being a 14 year-old freshman would have probably changed how that played out.
23.
by alibero 6y ago
Yeah, the MNIST model seems to have issues. I can get it to make mistakes for all line widths and most digits. Maybe the issue with small digits is that there is no cropping happening and the model was trained on MNIST where all the digits