IshanMi

8 ms·

1.
Mark Zuckerberg: A profile of history's largest non-territorial empire(colossus.com)
4 points by IshanMi 3d ago|0 comments
2.
by IshanMi 1y ago
I'm working on a long-term project to better understand Operating Systems, video game development, and Rust by building the simplest possible OS in Rust that boots directly into a game of Doom, which will also be re-written in Rust. I&
3.
Nearly half of OpenAI's Safety Researchers have left(fortune.com)
7 points by IshanMi 2y ago|0 comments
4.
by IshanMi 2y ago
The author mentions that his father was in touch with a PE-backed chemical company a month before he passed, who re-engaged a month after- sounds like that might have been his succession plan?
5.
by IshanMi 2y ago
Personally, I found looking at open source work to be much more instructive in learning about AI and how things like training data and such are done from the ground up. I suspect this is because training data is one of the bigger moats an A
6.
by IshanMi 2y ago
You're right about Calhoun- I was actually referring to Dennis Muilenburg, the CEO who was fired in 2019 after the two 737 MAX crashes and the subsequent groundings. My comment wasn't clear enough- I'll edit it for clarity.
7.
by IshanMi 2y ago
Personally, I think the issue isn't one of degrees or qualifications, but rather one of values. The CEO prior to this one (Muilenburg) also had degrees in Aerospace Engineering, but chose to value profit maximization over things like s
8.
by IshanMi 2y ago
I remember someone telling me that they thought of luck as being as one of four kinds: - blind luck (which is what people usually mean by "luck") - stirring the pot (if you apply to 100 jobs you might get more "luck" tha
9.
by IshanMi 2y ago
It's also interesting to think that IBM released an 8-trillion parameter model back in the 1980s [0]. Granted it was an n-gram model so it's not exactly an apples-to-apples comparison with today's models, but still, quite cra
10.
by IshanMi 3y ago
Thank you for sharing- upon reflection I should have been looking for primary source evidence like this instead of reading too deeply into Wikipedia pages, as someone else pointed out. I will definitely be more careful in the future. Could
11.
by IshanMi 3y ago
I think you're right and I clearly read too much into the Wikipedia pages, instead of looking for more primary source documents like those others have posted. I will be more careful in the future. Thank you for pointing that out!
12.
by IshanMi 3y ago
I found some discrepancies when reading deeper into Mistral that felt a bit peculiar. If you look at the Wikipedia page for Mistral AI [1] it lists the company as having 3 founders, one from DeepMind & 2 from Meta. This is consistent wi
13.
by IshanMi 3y ago
I still remember discovering & using numba for the first time in university. At the time I didn't know any programming languages except for Python, and wasn't super great at Python either. We had to write and run molecular sim
14.
by IshanMi 3y ago
This paper analyzed ~14,000 users and I'm wondering if that's a big enough sample size considering there are 350M or so users on Twitter? Is there a statistics test you could use to tell? Or is the number we should compare 14,000
15.
by IshanMi 3y ago
For companies like Twitch or Kick, how much do layoffs like these affect the actual streamers? (Like are the layoffs usually accompanied by them reducing the streamer's revenue share, or things like that?)
16.
FOX CTO on their blockchain for content verification for AI Labs(techinsiders.substack.com)
2 points by IshanMi 3y ago|0 comments
17.
by IshanMi 3y ago
Try the "historical papers" on this repo: https://github.com/aimerou/awesome-ai-papers And also you can find papers with their implementations in code here: http://paperswithcode.com
18.
by IshanMi 3y ago
In case you're unsure which papers would be good to implement, here's a nice GitHub repo: https://github.com/aimerou/awesome-ai-papers Try out the "historical papers"! :)
19.
by IshanMi 3y ago
Focusing on Deep Learning specifically: - Most LLMs currently use the transformer architecture. You can learn about this visually ( https://bbycroft.net/llm ), or through this blog post ( https://jalammar.github.io&
20.
by IshanMi 3y ago
So if I'm understanding this correctly: The SAM paper from this past April (that let you do zero-shot segmentation on any image, seemingly better than even OpenAI's CLIP) was using a ~600M parameter ViT model to generate image emb
21.
by IshanMi 3y ago
A lot of people are taught Excel early on in school. I wonder if this would result in more people learning or being introduced to Python at an early age?
22.
by IshanMi 3y ago
This is what works for me so far: - This repo has a list of important papers at the end of every week: https://github.com/dair-ai/ML-Papers-of-the-Week - The best papers are usually discussed pretty quickly on relevant
23.
by IshanMi 3y ago
I think the 8 trillion parameters is accurate- Tangora is an N-gram model with a vocab size of 20,000 words and N = 3. Parameters for an N-gram model = V^(N-1) * (V-1) Plugging in V=20,000 words and N = 3 for Tangora, you'd get 7.9996E