exgrv

17 ms·

1.
by exgrv 2y ago
We can! At Kyutai, we released a real-time, on-device speech translation demo last week. For now, it is working only for French to English translation, on an iPhone 16 Pro: https://x.com/neilzegh/status/18874981024
2.
High-Fidelity Simultaneous Speech-to-Speech Translation(arxiv.org)
6 points by exgrv 2y ago|1 comments
3.
by exgrv 2y ago
Samples: https://huggingface.co/spaces/kyutai/hibiki-samples Inference code: https://github.com/kyutai-labs/hibiki Models: https://huggingface.co/collections/kyutai/
4.
Beyond English-Centric Multilingual Machine Translation(ai.facebook.com)
2 points by exgrv 6y ago|0 comments
5.
Training with quantization noise for extreme model compression(ai.facebook.com)
9 points by exgrv 6y ago|0 comments
6.
by exgrv 7y ago
Except it does? After Equation 2: "v_w and v'_w are the input and output vector representations of w."
7.
by exgrv 9y ago
This is probably due to our preprocessing of Wikipedia that did not get rid of all the '}' from the markup.
8.
by exgrv 9y ago
We decided to keep the casing, as it is useful for some applications such as named entity recognition. Regarding the punctuation, as pointed out in another comment, these tokens might also be useful for some applications (and they are easy
9.
Fast and accurate language identification using fastText(fasttext.cc)
46 points by exgrv 9y ago|12 comments
10.
by exgrv 10y ago
These models were trained in an unsupervised way, and thus cannot be used with the "predict" mode of fastText. The .bin models can be used to generate word vectors for out-of-vocabulary words: > echo 'list of words&#x2
11.
by exgrv 10y ago
Hi, because we trained these vectors on Wikipedia, we released models corresponding to the 90 largest Wikipedia first (in term of training data size). More models are on the way, including Irish.
12.
by exgrv 10y ago
Regarding the size of the word vectors files: the text files are sorted by frequency, so it is possible to easily load the top k words only. We might also release smaller models in the future, for training on machines without large memory.
13.
by exgrv 10y ago
These models were trained on Wikipedia. It should be "Western Frisian" instead of "Western" ( https://en.wikipedia.org/wiki/West_Frisian_language ). Thanks for the catch!
14.
by exgrv 10y ago
Models are trained independently for each language. So unfortunately, you cannot directly compare words from different languages using these vectors. If you have a bilingual dictionary, you might try to learn a linear mapping from one langu
15.
by exgrv 10y ago
The graph algorithm described in the blogpost is more related to label propagation (which is more than 10 years old), than to "retrofitting". And the Google paper linked in the blogpost is citing the relevant literature correctly.
16.
by exgrv 10y ago
If the dataset is public, could you post a link? Otherwise, could you please send me an email? (My address can be found on the github README). Thanks!
17.
by exgrv 10y ago
Thanks for pointing this out. We design this library on large datasets and some static variables may not be well tuned for smaller ones. For example the learning rate is only updated every 10k words. We are fixing that now, could you please
18.
by exgrv 10y ago
It is possible to chose between negative sampling (ns), softmax or hierarchical softmax (hs) by using the -loss option.
19.
by exgrv 10y ago
At train time, the code supports multiple labels by sampling one of the k label at random. At test time, it only predicts the most probable label for each example. We will add more functionalities for multi label classification in the futur
20.
by exgrv 11y ago
Except it is not the equality operator, but a special case of an indicator function (c.f. comment by pash).
21.
by exgrv 11y ago
A lot of people play the lottery. Only one person did this experiment. When you test multiple hypothesis (as in your lottery example), you need to perform a correction[2,3]. [1] https://xkcd.com/882/ [2] https:/&
22.
by exgrv 11y ago
Members of the editorial board of scientific journals are not paid. So nothing prevents having a completely free and open access journal, which is peer reviewed. As a matter of fact, such journals already exist in some fields (e.g. the Jour
23.
by exgrv 11y ago
Microsoft Research is also an excellent organization for CS related research.
24.
by exgrv 11y ago
There is this paper by Joulin & Mikolov: Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets ( http://arxiv.org/abs/1503.01007 ). In this case, the memory of the RNN is an ensemble of differentiable st
25.
Language Models for Image Captioning: The Quirks and What Works(arxiv.org)
14 points by exgrv 11y ago|0 comments
26.
by exgrv 12y ago
I believe that the prestige of a journal is mainly defined by the members of the editorial board. So if you can convince members of the editorial board of prestigious journals to resign and join your new open access journal, it can very rap
27.
by exgrv 12y ago
I also like this quote from Antoine de Saint Exupéry: "Il semble que la perfection soit atteinte non quand il n'y a plus rien à ajouter, mais quand il n'y a plus rien à retrancher", which can be translated as: "Perf