mratsim

7 ms·

1.
by mratsim 6mo ago
In my case with vLLM on dual RTX Pro 6000 gpt-oss-120b: (unknown prefill), ~175 tok/s generation. I don't remember the prefill speed but it certainly was below 10k Nemotron-3-Super: 14070 tok/s prefill, ~194.5 tok/s gene
2.
by mratsim 2y ago
Exact instruction challenge https://www.youtube.com/watch?v=cDA3_5982h8
3.
by mratsim 2y ago
Years ago I started a collection of convolution optimization resources: https://github.com/mratsim/laser/wiki/Convolution-optimisati... Also checked and apparently Nvidia Cutlass now supports generic convolut
4.
by mratsim 2y ago
The Internet Engineering Task Force, which in particular standardizes TLS, has acknowledge my contributions for my contributions to the very generic and globally useful hashing-to-curve primitive: https://datatracker.ietf.org&#x2
5.
by mratsim 2y ago
BLS signatures are general purpose, the only Ethereum specific thing is choosing which elliptic curves are used for public keys and which for signatures as well as a prefix before hashing inputs. Similarly KZG polynomial commitments are gen
6.
by mratsim 2y ago
Great question, first of all I did extensive research https://github.com/mratsim/constantine/wiki/Constant-time-ar... . Then the library defines its own types SecretBool and SecretWord throughough library that
7.
by mratsim 2y ago
Author here, adding an accompanying post focused on performance: https://ethresear.ch/t/releasing-constantine-v0-1-0-a-modula...
8.
by mratsim 2y ago
According to the US, an US citizen just have to open a bank account anywhere in the world and the law applies, regardless of where the bank is hosted.
9.
by mratsim 2y ago
Reminded me of Bastiat's candlestick maker's petition: http://bastiat.org/en/petition.html
10.
by mratsim 2y ago
Why is it different? People don't have to comply to GDPR but if they want to serve EU folks then they don't have a choice.
11.
by mratsim 2y ago
What would be the 7 dimensions?
12.
by mratsim 2y ago
That was my reasoning for this "restriction".
13.
by mratsim 2y ago
Author here, Nim supports variadic generic, it's an arbitrary limitation so that shape and stride small vectors that describe a tebsor can be stack-allocated and fit in a cacheline. Also at the time, Nim default heap allocator was not
14.
by mratsim 2y ago
They always take two months at the very minimum as well because buyers as to go to many banks or a loan broker. You have notaries involved and right to step away from a sale, no question asked for 10 days iirc.
15.
by mratsim 3y ago
Overpromise and underdeliver. And lots of funding for then vaporware
16.
by mratsim 3y ago
idiv is not constant-time on any ISA anyway ;)
17.
by mratsim 3y ago
Percival cache attacks on Hyperthreading. I go over some examples here: https://github.com/mratsim/constantine/issues/358#issuecomme...
18.
by mratsim 3y ago
I've written and given a lot of references to attacks, countermeasures, fighting the compilers and even non-cryptographic side-channel attacks to uncover someone's Twitter identity: - https://github.com/mratsim&#x2
19.
by mratsim 3y ago
Venmo, CashApp, Paypal "Friends or Family" and gift cards (Apple, Google Pay, Steam, ...) are all irreversible.
20.
by mratsim 3y ago
The same problem as with passwords that has been plagging the security industry for decades. Passwords, credentials and other high-risk high value intangible data are not associated with high-risk high-value AND our memory is not designed f
21.
by mratsim 3y ago
Or for some there is a national base price.
22.
by mratsim 3y ago
It is a French company so maybe they have extra French datasets? I've been quite disappointed by French LLMs on Huggingface when I tried a month ago.
23.
by mratsim 3y ago
> In a way, I think you're absolutely correct that it's harder to change anything, but not because the method is wrong; it's because it addresses the fundamental issue of traditional budgeting and it's difficult and t
24.
by mratsim 3y ago
When there is an emergency to break into a house, the police needs to get a mandate from a judge.
25.
by mratsim 3y ago
GPU drivers provide an event system: - Cuda: https://github.com/mratsim/weave/issues/133 - OpenCL: https://github.com/mratsim/weave/issues/134
26.
by mratsim 3y ago
> GPTs are a little better, but I still don't see the product market fit. If ChatGPT doesn't have product-market fit, what actually has?
27.
by mratsim 3y ago
What would that check do? Check IPs?
28.
by mratsim 3y ago
The fact that it was not enforced doesn't mean there wasn't a sword of Damocles above your head.
29.
by mratsim 3y ago
But what happens if the company you're trading with has non-US entities? Or traveling salesmen? The issue here is the complexity of complying and closing all loopholes that would allow the government to bring the full weight of the leg
30.
by mratsim 3y ago
I disagree. To fully comply with this you would need as a library provider to fully KYC your clients so that there is a firewall between their US and non-US entities, and that travelling people don't bring out an encryption library at

More ›