snippyhollow

13 ms·

1.
by snippyhollow 3y ago
We changed RoPE's theta from 10k to 1m and fine-tuned with 16k tokens long sequences.
2.
by snippyhollow 7y ago
Thanks for the feedback, we'll fix this.
3.
HiPlot: High-dimensional interactive plots made easy(ai.facebook.com)
137 points by snippyhollow 7y ago|21 comments
4.
HiPlot: High-dimensional interactive plots made easy(ai.facebook.com)
10 points by snippyhollow 7y ago|0 comments
5.
by snippyhollow 7y ago
The models are here: https://github.com/facebookresearch/wav2letter/tree/master/r... https://github.com/facebookresearch/wav2letter/tree/master/r...
6.
by snippyhollow 7y ago
It is like `cp`.
7.
by snippyhollow 8y ago
Quite usable, all of TorchCraftAI uses it https://torchcraft.github.io/TorchCraftAI/ :)
8.
by snippyhollow 9y ago
Compulsory "Spikey Spheres" notebook http://nbviewer.jupyter.org/urls/gist.githubusercontent.com/...
9.
by snippyhollow 9y ago
Similar to https://arxiv.org/abs/1311.2901
10.
by snippyhollow 9y ago
paper: https://s3.amazonaws.com/fairseq/papers/convolutional-sequen... code: https://github.com/facebookresearch/fairseq pre-trained models: https://github.com/facebookresearc
11.
A novel approach to neural machine translation(code.facebook.com)
283 points by snippyhollow 9y ago|44 comments
12.
by snippyhollow 9y ago
https://newsroom.fb.com/news/h/comments-on-research-and-ad-t...
13.
by snippyhollow 10y ago
A few years ago SpringRTS, and in particular the BalancedAnnihilation mod [0] were active and playable. There is also Planetary Annihilation [1] (that I used to play competitively online, a few of the top players are ex-StarCraft II Grand M
14.
Artificial Intelligence, Revealed(code.facebook.com)
2 points by snippyhollow 10y ago|0 comments
15.
by snippyhollow 10y ago
I did a quick "visualization" hack a while ago http://nbviewer.jupyter.org/urls/gist.githubusercontent.com/...
16.
by snippyhollow 10y ago
[2014]
17.
by snippyhollow 10y ago
Part 2 was never finished but supposed to be text around this http://nbviewer.jupyter.org/github/syhw/DL4H/blob/master/DNN...
18.
by snippyhollow 10y ago
I wrote this quite some time ago exactly to hold the hands of neophytes who want to do such endeavour. http://nbviewer.jupyter.org/github/syhw/DL4H/blob/master/fro...
19.
Distributed Learning in Torch(blog.twitter.com)
3 points by snippyhollow 11y ago|0 comments
20.
Are ML and Statistics Complementary? [pdf](ics.uci.edu)
68 points by snippyhollow 11y ago|31 comments
21.
Facebook’s Cyborg Virtual Assistant Is Learning from Its Trainers(technologyreview.com)
1 points by snippyhollow 11y ago|0 comments
22.
by snippyhollow 11y ago
I have 300/100mbps down/up fiber in Paris. As important as the bandwidth is the latency. Basically it means I do most of my work SSHed (mosh'ed actually) to a cluster and don't notice I'm working from home or the co
23.
by snippyhollow 12y ago
Wow that site still exists! :) I did one when I was 17 (I'm 28 now), I first modelised everything in 1) an optics simulator 2) Solidworks, and then assembled it with a wooden case: http://forum.allinbox.com/aspectgeek&#
24.
From Logistic Regression to Deep Nets, a Crash Course(nbviewer.ipython.org)
4 points by snippyhollow 12y ago|0 comments
25.
by snippyhollow 12y ago
The second chapter "High-Dimensional Space" talks about the problem of spikey spheres[0] (how most of the mass is near the surface), I made an ipython notebook to illustrate it[1]. [0] http://www.penzba.co.uk/cgi-b
26.
by snippyhollow 12y ago
Thomas is a labmate of mine, fire away if you have specific questions, either I can answer them, or ask him!
27.
So you wanna try Deep Learning?(snippyhollow.github.io)
72 points by snippyhollow 12y ago|9 comments
28.
by snippyhollow 12y ago
I also did topic modeling (LDA) and other experiments on HN, code for fetching all posts and comments, and for topic modeling, can be found here: https://github.com/SnippyHolloW/HN_stats (lein run // look at
29.
by snippyhollow 12y ago
It's PG's parameters for a naive Bayes model based on these LDA topics, learned by taking his comments on HN as upvotes for the articles content.
30.
by snippyhollow 12y ago
Yes but what does it mean?

More ›