ipieter

7 ms·

1.
by ipieter 3mo ago
I only see an edit to the readme (13h ago) and removal of the weights, so the repo is now empty. I am willing to give them the benefit of the doubt, but we've seen this before: a model gets released that is supposedly state-of-the-art,
2.
Canada's AI Startup Cohere Buys Germany's Aleph Alpha to Expand in Europe(reuters.com)
3 points by ipieter 5mo ago|0 comments
3.
by ipieter 5mo ago
There is currently very little evidence that morphological tokenizers help model performance [1]. For languages like German (where words get glued together) there is a bit more evidence (eg a paper I worked on [2]), but overall I start to s
4.
by ipieter 1y ago
Distributing inference per layer, instead of splitting each layer across gpus, is indeed another approach, called pipeline parallelism. However, per batch there is less compute (only 1 gpu at a time), so inference is slower. In addition, t
5.
by ipieter 1y ago
This is an interesting blogpost. While the general conclusion ("We need batching") is true, inference of mixture of experts (MoE) models is actually a bit more nuanced. The main reason we want big batches is because LLM inference
6.
by ipieter 2y ago
The mains frequency is literally how fast the generators in power plants are turning. If the load on the grid increases, those generators slow down slightly and more natural gas/coal/heat needs to be added to increase the frequenc
7.
by ipieter 2y ago
I have both DO and Hetzner VMs and I find them comparable, with Hetzner being a bit cheaper. If I look at the logs and fail2ban, it looks like DO does a bit more abusive traffic filtering, but that is basically the only difference. However,
8.
by ipieter 2y ago
Yeah I just tried it with numbers I knew a bit and it seems totally made up. The generated chart showed a linear downwards trend while in reality there isn't one and the numbers seem way off.
9.
by ipieter 3y ago
Our university recently recommended the same thing, and I think this is a very bad idea for two reasons. 1. Not every sequence of words deserves to be cited. GPT-3 and ChatGPT are often confidently wrong about facts, why would you want to a
10.
by ipieter 5y ago
no it’s not. Philips Lighting is split of into a new brand: Signify. They pay to use the Philips name (e.g. for Philips Hue).
11.
by ipieter 6y ago
As a Belgian, I was looking in horror at that recipe. Why would people put sugar on their fries?! So I'm glad you like the Belgian fries. What I've always learned to be key is that we fry our cut potatoes twice: once at 140°C, wai
12.
by ipieter 6y ago
I can answer that, since I also made a small static site generator from scratch in python. I was using another static site generator (Hexo), but at some point I wanted to change some things and add some custom html to my posts. Since the do