cschmidt

17 ms·

1.
by cschmidt 1mo ago
A good deal of the field of Operations Research (OR) is about getting a good solution to NP-hard problems anyway. It is fun!
2.
by cschmidt 2mo ago
Send me an email (my address is in my profile)
3.
by cschmidt 2mo ago
Send me an email (my address is in my profile)
4.
by cschmidt 2mo ago
Send me an email (my address is in my profile)
5.
by cschmidt 2mo ago
I’m not sure why you think this is ai slop. I work on tokenization research full time. My name is Craig Schmidt and I have a number of papers in the field. This researcher has done some very impressive work and I’m trying to defend him from
6.
by cschmidt 2mo ago
Can I say this seems to be fantastic work. I cloned your repo earlier today after seeing it on the tokenization discord. I know everyone in the tokenization community wants to absorb the lessons of how you got such a speedup. The caching an
7.
by cschmidt 3mo ago
I suggest Scholar Inbox. https://www.scholar-inbox.com/landing It is a recommendation system for new papers that come out each day. If you train it a bit by specifying what you like and don't like you'll get a pr
8.
by cschmidt 3mo ago
It all depends on where you get your news. You need somewhere that puts things into context so you can understand why things are happening. Personally I really like the Economist. The weekly pace of publication also encourages analysis over
9.
by cschmidt 3mo ago
It does seem like those 20% are exactly on the nasty side. So even more impressive.
10.
by cschmidt 4mo ago
The "Quantitative Display of Information", which I just checked, is using Monotype Bembo. So still Bembo, but a different version.
11.
by cschmidt 5mo ago
Those are not global students. Those are people who are already living in the state. Foreign students typically pay the most tuition possible with no financial aid, subsidizing everyone else.
12.
by cschmidt 7mo ago
Looks great. I just ordered it. Thanks for the recommendation.
13.
by cschmidt 10mo ago
There are equal weight S&P ETFs, which avoid having a handful of stock dominating. However, they do have to do a lot more rebalancing to keep things in line.
14.
by cschmidt 11mo ago
There is other research that works with pixels of text, such as this recent paper I saw at COLM 2025 https://arxiv.org/abs/2504.02122 .
15.
by cschmidt 1y ago
I worry how often that is happening already on Spotify.
16.
Gian-Carlo Rota's Combinatorial Theory Course: The Guidi Notes(ellerman.org)
1 points by cschmidt 1y ago|0 comments
17.
by cschmidt 1y ago
I’m not sure about this masters program, but the undergrad program seems to be proper ORMS.
18.
by cschmidt 1y ago
I think in this context Management Science is an older term that was synonymous with operations research. The flagship journal of Informs (the institute for operations research and management science) has the same name. Studying how to opti
19.
by cschmidt 1y ago
Attention does help, which is why it can learn arithmetic, even with arbitrary tokenization. However, if you put it in a standard form, such as right-to-left groups of 3, you make it an easier problem for the LLM to learn. All the examples
20.
by cschmidt 1y ago
Math operations go right to left in the text, while we write them left to right. So if you see the digits 123... in an autoreressive manner, you don't know really anything, since it could be 12345 or 1234567. If you flipped 12345 as
21.
by cschmidt 1y ago
And in regard to utf-8 being a shitty biased tokenizer, here is recent paper trying to design a better style of encoding https://arxiv.org/abs/2505.24689
22.
by cschmidt 1y ago
Virtually all current tokenization schemes do work at the raw byte level, not the utf-8 character. They do this to avoid the Out of Vocabulary (OOV) or unknown token problem. In older models, if you came across something in the data you ca
23.
by cschmidt 1y ago
I suppose it is. There is a lot to tokenization - pre-tokenization, how to handle digits, the tokenization training approach - that is about adding cleverness. In the long run, the bitter lesson would be to just get rid of it all and lear
24.
by cschmidt 1y ago
This paper has a good solution: https://arxiv.org/abs/2402.14903 You right to left tokenize in groups of 3, so 1234567 becomes 1 234 567 rather than the default 123 456 7. And if you ensure all 1-3 digits groups are i
25.
by cschmidt 1y ago
Gurobi does have a cloud service where you pay by the hour. A full non-academic license is pricy.
26.
by cschmidt 1y ago
I'm just saying that these systems don't work for me. I write ML/AI conference papers in LaTeX, and I think that use case will be tough to dislodge. I can see this being very attractive to people making other types of docum
27.
by cschmidt 1y ago
One thing that has helped with ease of use is Overleaf. It is a hosted LaTeX editor with lots of collaboration features (leaving comments, history of edits) that let people collaborate in real time on a paper. It comes with many templates
28.
by cschmidt 1y ago
You make a fair point - I'm talking specifically about CS/ML/AI conferences. I shouldn't overgeneralize.
29.
by cschmidt 1y ago
Every conference has their own required LaTeX style file that must be used. Unless there is an automated way to convert these exactly, I don't see how LaTeX alternatives can be used.
30.
by cschmidt 1y ago
Anyone reading this in the future, I meant to say the length weighting is a bit nonstandard. It is usually by frequency. Oops

More ›