6 ms·
Sparse Attention, it's the highlight of this model as per the paper
by hammeiam 10mo ago
Sparse Attention, it's the highlight of this model as per the paper
- pylotlight 10mo agoI'll have to wait for the bycloud video on this one :P
- culi 10mo agoHow did we come to the place that the most transparent and open models are now coming out of China—freely sharing their research and source code—while all the American ones are fully locked down
- pennomi 10mo agoOver reliance on investors who demand profits more than engineering. The best innovation always happens before being tainted by investment.
- victor9000 10mo agoBecause the entire US economy is being propped up by AI hype.
- nickstinemates 10mo agoThe money would have gone somewhere. The "smart" money went to AI. Don't get fooled.
- culi 10mo agoeverybody looks smart in a bull market
- p-e-w 10mo agoBecause the whole framing of US vs China as open vs closed was never correct to begin with.
- kouteiheika 10mo ago> How did we come to the place that the most transparent and open models are now coming out of China—freely sharing their research and source code—while all the American ones are fully locked down Greed and "safety" hysteria.
- aqme28 10mo agoThe US companies are all basically GPUaas. I’m not sure what the financial model is here, but I like it.
- SequoiaHope 10mo agoShort cheeky answer is that capitalists need to capture value and communists don’t. Less cheeky answer is that this is a good opportunity for China to make sure the world isn’t dominated by US-sourced AI models. However in another way the US probably offers more free inference than China. What good is an open 600 billion parameter model to a poor person? A free account with ChatGPT might be more useful to them, though also more exploitative.
- evrenesat 10mo agoChina needs to build the world's trust and respect, while the US is slowly but surely losing theirs.
- m_mueller 10mo agoslowly?
- tim333 10mo agoThe US is more law and finance led and the first thing seems to be to get an IP advantage and raise money. China I guess less so - they are famously lax on IP and everyone copies everything.