treprinum

5 ms·

1.
by treprinum 2y ago
I would suspect the physiological base of burnout is the depletion of mainly B vitamins in the brain. When you look at the Krebs cycle, the main energetic reaction in every cell, B vitamins play crucial role whether they act as catalysts of
2.
by treprinum 2y ago
Didn't Chinese scientists recently show a crazy success rate (~90%) of treating advanced Alzheimer/dementia by performing a microsurgery of the neck, allowing brain to dispose accumulated waste?
3.
by treprinum 2y ago
Nvidia just did what Intel/AMD should have done to threaten CUDA ecosystem - release a "cheap" 128GB local inference appliance/GPU. Well done Nvidia, and it looks bleak for any AI Intel/AMD efforts in the future.
4.
by treprinum 2y ago
Bad idea for social marketing - by the time a post becomes popular, it disappears.
5.
by treprinum 2y ago
Get admitted to online UIUC iMBA or BU OMBA, take the marketing/sales/entrepreneurship courses, quit.
6.
by treprinum 2y ago
That's a pity! CGTalk was the site where I first learned about Cg from Nvidia that later morphed into CUDA so unbeknownst to them, CGTalk was at the forefront of the AI by popularizing it.
7.
by treprinum 2y ago
Would that mean that we would need to exchange latent "embeddings" between various "reasoning" models for emulating thinking and an LLM will be just about converting to/from human language when interfacing with mere
8.
by treprinum 2y ago
I am really glad we are finding new pieces of the puzzle of how our gut works and perhaps can someday understand their effect on immunity, neuro-degeneration, cancer etc. for which we now only have accidental findings.
9.
by treprinum 2y ago
I said in some areas of Barcelona which is true. Now somebody did the Simpson's paradox using the whole data set instead of conditional data, leading to a different result.
10.
by treprinum 2y ago
So you cherry pick one real-world observation, try to refute it and it makes the rest wonderland? EU is doing super great because you just scentifically proved that Barcelona can't be as bad as LA?
11.
by treprinum 2y ago
No, but EU with all its social agenda is now imploding at unusual places that were once considered great places to live, inflation is doing its thing. In the US tech is considered the most important engine of the economy, EU wasted over a d
12.
by treprinum 2y ago
Why would anyone outside some desperate eastern European countries want to join? EU is going down hard, since 2008 no meaningful GDP growth, flat salaries, no tech companies propelling growth, old population, all the while US and Chinese GD
13.
by treprinum 2y ago
The top-end RDNA4 GPU will have 16GB RAM. That's a massive regression compared to 7900XTX and performance-wise it should be at best at the 7900XTX level. We are discussing AMD cards for LLM inference where VRAM is arguably the most imp
14.
by treprinum 2y ago
AMD decided not to release a high-end GPU this cycle so any investment into 7x00 or 6x00 is going to be wasted as Nvidia 5x00 is likely going to destroy any ROI from the older cards and AMD won't have an answer for at least two years,
15.
by treprinum 2y ago
Best way is to use ChatGPT + Whisper + ElevenLabs and a prompt where you tell the LLM to answer in German but to tell you what mistakes you made and what you should have said instead in your own language. Instead of this lazy "immersio
16.
by treprinum 2y ago
Tor browser asks you if you want to allow fingerprinting or not when a site attempts to query your HW info. Not sure why other browsers can't do the same.
17.
by treprinum 2y ago
I have an idea - how about Apple letting Mac users use Nvidia cards/chips again?
18.
by treprinum 2y ago
I remember somebody complaining about it on reddit, unable to overcome some BIOS limitation on an AMD G processor. Even on M3 Max one had to issue a special command to enable GPU to access more memory.
19.
by treprinum 2y ago
Quantized sure but there is some loss of variability of the output one can notice quickly with 30B models. If you want to use the fp16 version you are out of luck.
20.
by treprinum 2y ago
Problem with MI300x is the price. Problem with 7900XTX is that it's at best as good as Nvidia with the same RAM for a similar price. If 7900XTX had e.g. 64GB of RAM, was 2x slower than 4080, and kept its price, it would sell like crazy
21.
by treprinum 2y ago
View it as Raspberry Pi for AI workloads. Initial stage is for enthusiasts that would develop the infra, figure out what is possible and spread the word. Then the next phase will be SME industry adoption, making it commercially interesting,
22.
by treprinum 2y ago
AMD GPUs aren't very attractive to ML folks because they don't outshine Nvidia in any single aspect. Blasting lots of RAM onto a GPU would make it attractive immediately with lots of attention from devs occupied with more interest
23.
by treprinum 2y ago
It's too slow and not very compatible. Most BIOSes also don't allow sharing that much memory with GPU (max like 16GB).
24.
by treprinum 2y ago
I ran some variation of llama.cpp that could handle large models by running portion of them on GPU and if too large, the rest on CPU and those were the results. Maybe I can dig it from some computer at home but it was almost like a year ago
25.
by treprinum 2y ago
That's a question M3 Max with its internal GPU already answered. It's not like I didn't do any HPC or CUDA work in the past to be completely clueless about how GPUs work though I haven't created those libraries myself.
26.
by treprinum 2y ago
K80 used to be two glued K40 but their interconnect was barely faster than PCIe so it didn't have much benefit as one had to move stuff between two internal GPUs anyway.
27.
by treprinum 2y ago
I think plenty of enthusiastic open source devs would jump at it and fix their software if the software was reasonably open. The same effect as what happened when Meta released LLaMA.
28.
by treprinum 2y ago
For some reason Apple did it with M3/M4 Max likely by folks that are also on HN. The question is how many of the years spent designing HW were spent also by educating oneselves on the latest best ways to do it.
29.
by treprinum 2y ago
They are charging as much as Nvidia for it. Now imagine they offered such a card for $2k. Would that allow them to eat Nvidia's lunch?
30.
by treprinum 2y ago
That's why I said "basic GPU". It doesn't have to be too fast but it should still be way faster than a regular CPU. Intel already has Xeon Phi so a lot of things were developed already (like memory controller, heavy para

More ›