simedw

6 ms·

1.
by simedw 20d ago
For some reason, in almost every test I did with Gemini 3.5 Live, it classified my Swedish (native) as Dutch. There are similarities between the languages, but still. It’s pretty good at understanding my broken Mandarin, though.
2.
by simedw 20d ago
This was neat, well done! The only alternative version of Go I’ve played before was magnetic Go, where all the rules are the same except that, along the axis lines where you place a piece, like colours attract and opposite colours repel. On
3.
by simedw 28d ago
Luckily I have access to 4x RTX 4090s, so I didn’t have to pay cloud GPU prices directly. If I had, it probably would have added up quite a bit given how many training runs and experiments I ended up doing.
4.
by simedw 28d ago
The biggest speed improvement came from changing the note representation when I switched to compound note events: roughly 5× fewer autoregressive passes per note. For the current model I’m using Core ML, which optimizes the kernels the firs
5.
by simedw 28d ago
Yes, some kind of planning step is on my TODO list. Another thing I want to try is generating a few continuations in parallel, picking the one that looks best, and then continuing from there. Maybe the picking could be automatic. I can prob
6.
by simedw 28d ago
For DPO I only had around 700 preference examples, so not much data at all. That took about 12 minutes to train on a single GPU. Pretraining was obviously a a lot slower, the 125M model took roughly half a day.
7.
by simedw 28d ago
If the attribute describes the current note, I would first try adding it as another field/head on the note event. For example: NOTE( pitch, delta_onset, duration, attack_velocity, release_velocity, ... )
8.
by simedw 28d ago
Thank you. Yes, I think I’ve gotten it to roughly a GPT-2 level: good enough to share, but with a lot of room left to improve. I think adding some kind of bar/measure token might help with rhythm, and perhaps some form of longer-term p
9.
Show HN: I trained a 125M model to autocomplete piano on-device(simedw.com)
598 points by simedw 28d ago|117 comments
10.
How to force AI agents to use an egress proxy(simedw.com)
4 points by simedw 3mo ago|1 comments
11.
by simedw 4mo ago
Nice package, not only is using words more token-efficient [saving time and money], but weaker models are also less likely to make mistakes when providing the key, at least in my tests. That said, for `createAliasMap`, don't you think
12.
by simedw 4mo ago
Cool project! I noticed that if you go from training to watch and then back, the training temporarily drop significantly in score.
13.
by simedw 6mo ago
No offense, but are you a bot?
14.
by simedw 6mo ago
Agreed, it almost feels like we have a visual processing unit with special “opcodes” for operations like depth matching and pattern repetition. The generator first needs a depth map, and then derives the repeating pattern from that. A norma
15.
Building a Magic Eye Generator and Decoder(simedw.com)
3 points by simedw 6mo ago|5 comments
16.
From Noise to Image – interactive guide to diffusion(lighthousesoftware.co.uk)
154 points by simedw 7mo ago|21 comments
17.
by simedw 7mo ago
I think this speaks for itself: simedw ~ $ claude -p "random number between 1 and 10" 7 simedw ~ $ claude -p "random number between 1 and 10" 7 simedw ~ $ claude -p "random number between 1 and 10&qu
18.
by simedw 8mo ago
Great suggestin, added a toggle to see pinyin.
19.
by simedw 8mo ago
Thank for the great feedback! I have just added sandhi support, please let me know if it's working better.
20.
by simedw 8mo ago
Hi, thanks for the feedback. The 了 issue was a bug on the JavaScript side; that should be fixed (training did thankfully handle it correctly). The other two are probably things that could be fixed with a bigger and more varied dataset.
21.
by simedw 8mo ago
It’s fairly sensitive to background noise at the moment. I’m planning to train an improved version with stronger data augmentation, including background noise.
22.
by simedw 8mo ago
For accents, I’ve mostly tested with a few friends so far. I’m wondering whether region should be a parameter, because training on all dialects might make the system too lax.
23.
by simedw 8mo ago
Thank you. I had a quick look at Farsi datasets, and there seem to be a few options. That said, written Farsi doesn’t include short vowels… so can you derive pronunciation from the text using rules?
24.
Show HN: I trained a 9M speech model to fix my Mandarin tones(simedw.com)
469 points by simedw 8mo ago|153 comments
25.
by simedw 8mo ago
It would be neat if it had a headless mode.
26.
Coding Agents Are Good First-Time User Testers(simedw.com)
3 points by simedw 8mo ago|2 comments
27.
by simedw 8mo ago
https://simedw.com personal site, mostly posts regarding various experiments
28.
by simedw 9mo ago
First of all, big kudos for not missing a single day. When I used flashcards in the past, missing even a couple of days led to an avalanche of cards to review. Since you’ve been so consistent and are using your own software, have you experi
29.
by simedw 9mo ago
Thanks for the questions. Very fair concerns. Take all of this with a fairly large pinch of salt; this is still an experiment. 1. How does it know which words I already know? It doesn’t automatically. You provide that set. For example, if y
30.
by simedw 9mo ago
This is a simplified version: Journey to the West in Easy Chinese by Jeff Pepper and Xiao Hui Wang. Otherwise, I would definitely have waited a bit before biting off something like this.

More ›