rileyphone

4 ms·

1.
by rileyphone 3mo ago
DeepSWE is closer to that https://deepswe.datacurve.ai/
2.
by rileyphone 3mo ago
Absolutely, plus if you control the coding agent you can enforce certain guarantees and have it wrap your services with a custom sdk. I've been exploring this pattern in a couple of different domains where it's just a vite react a
3.
by rileyphone 3mo ago
Here's one: AI democratizes the ability to produce software, which has mostly been an arcane craft wielded by a priestly class. Now anyone, if they know what they want and it isn't too complex, can talk to AI and get working (if n
4.
by rileyphone 3mo ago
All that says is some benchmarks aren’t worth the tokens it takes to evaluate them. Mythos is clearly capable of finding zero days other models can’t, and Fable is close enough to be lumped with it.
5.
by rileyphone 10mo ago
Pretty neat! Really like the design and minimalism. Oh, and the free hosted models :-) (but I assume that's just for the demo). Kind of confused by the open in cursor button but otherwise clean. It seems like there's a lot of stuf
6.
by rileyphone 11mo ago
Yes but it's really good for building better object systems, especially with newer features like proxies. In the SELF days they implemented Smalltalk with prototypes and found that it was faster than normal Smalltalk implementations.
7.
by rileyphone 1y ago
According to this delightful overview [1] of the desalination plant, the capacity overall is 12000kW so that's definitely close enough. 1. https://www.niph.go.jp/soshiki/suido/pdf/h21JPUS/abstract&#x
8.
by rileyphone 1y ago
Location: Seattle, WA Remote: Sure Willing to relocate: No Technologies: Javascript (Node/Web/Bun), Linux, Python, SQL (SQL Server/MySQL/Postgres/Sqlite), Azure, k8s/docker, React, Typescript, and many more Res
9.
by rileyphone 1y ago
From talking to people, the average user relies on memories and chat history, which is not easy to migrate. I imagine that's the part of the strategy to keep people from hopping model providers.
10.
by rileyphone 1y ago
I got a Sovol SV06 ACE a few months ago as it seemed to have most of the nice features of the Bambu (like auto bed leveling) without the closedness. The printer runs Klipper and you can ssh into it. So far there's been one issue where
11.
by rileyphone 1y ago
Page for the role doesn't have Seattle, only SF.
12.
by rileyphone 1y ago
It's baked in to the process as part of design review, after getting pass the first wall of zoning. https://www.seattle.gov/neighborhoods/public-participation/e...
13.
by rileyphone 2y ago
Firefox has made Mozilla billions over its lifetime by selling the default search engine rights to Yahoo and Google. Chrome, having a much greater user base, would demand a correspondingly higher fee (probably around $10b a year). Now, the
14.
by rileyphone 2y ago
If you spend 1000W on 1 gigaflops, but could have gotten 1 teraflops instead on newer hardware, you are mostly just throwing money away. Unless fab capacity is severely limited in the future or energy becomes too cheap to meter, the opportu
15.
by rileyphone 2y ago
Been working on an autoencoder that converts the hidden states of transformer models into a spatial representation that can be visualized. Started more on the toy scale but now I'm trying to scale it beyond my humble 3060. Using LLMs t
16.
by rileyphone 2y ago
Gemini is probably using ring attention. But scaling to that size requires more engineering effort in terms of interlink that goes beyond the purpose of this release from Mistral.
17.
by rileyphone 2y ago
According to the paper, the dataset goes up to 1978 because that's when copyright law was updated to automatically apply to newswires. It's unfortunate that we got into the situation where academia has to play by the rules wrt cop
18.
by rileyphone 2y ago
In that case there are two attractors - one towards the Golden Gate Bridge and one towards the harmless, helpful, honest assistant persona. Techniques as such probably get weirder results with model scale but no reason to think they get wip
19.
by rileyphone 2y ago
In this case Azure is responsible for the datacenters, billing, and support.
20.
by rileyphone 2y ago
There's also the oceanic currents carrying warm water from the gulf. Europe is in a very lucky position.
21.
by rileyphone 2y ago
Unary operators are still operators. The integer parsing rules are probably different. In Lisp, -x would be a symbol, and the proper analog to -123 would be (- x) eg.
22.
by rileyphone 2y ago
Not really because the ordering is unambiguous given the parens. No need for operator precedence rules like PEMDAS.
23.
by rileyphone 2y ago
The bigger size is probably from the bigger vocabulary in the tokenizer. But most people are running this model quantized at least to 8 bits, and still reasonably down to 3-4 bpw.
24.
by rileyphone 2y ago
To be fair, the Llama 2 instruction tuning was notably bad.
25.
by rileyphone 2y ago
$10 a month?
26.
by rileyphone 2y ago
128GB in one chip seems important with the rise of sparse architectures like MoE. Hopefully these are competitive with Nvidia's offerings, though in the end they will be competing for the same fab space as Nvidia if I'm not mistak
27.
by rileyphone 2y ago
With an MoE you only need to train a smaller model which you can then combine into an x8 and finetune/train the router. Mistral used their 7B base to make Mixtral, Qwen's new MoE uses their 1.8B model upscaled to 2.7B, pretty sure
28.
by rileyphone 2y ago
LLMs aren't nearly as monetizable (now) as search ads. Very possible that search collapses in the near future alongside the open web, and that whole line of revenue destroyed.
29.
by rileyphone 2y ago
It's just such a bad name though.
30.
by rileyphone 2y ago
Nice! I started a similar project with a rotary phone a couple years ago with asterisk (just to the point of making a test call). Wish I had heard about the Windstream device, I ended up getting a pulse to tone converter and a PAP2T to voip

More ›