abetlen

5 ms·

1.
by abetlen 3y ago
I would add the following two numbers if you're generating realtime text or speech for human consumption: - Human Reading Speed (English): ~250 words per minute - Human Speaking Speed (English): ~150 words per minute Should be treated
2.
by abetlen 3y ago
Also worth checking out https://github.com/saharNooby/rwkv.cpp which is based on Georgi's library and offers support for the RWKV family of models which are Apache-2.0 licensed.
3.
by abetlen 3y ago
You can see for yourself (assuming you have the model weights) https://github.com/abetlen/llama-cpp-python I get around ~140 ms per token running a 13B parameter model on a thinkpad laptop with a 14 core Intel i7-9750
4.
How Is LLaMa.cpp Possible?(finbarrtimbers.substack.com)
4 points by abetlen 4y ago|0 comments
5.
by abetlen 4y ago
This is not true, GPT-3 can perform chain-of-thought reasoning through in-context learning either by one/few-shot examples or zero-shot by starting a prompt with "let's think step by step" (less reliable). GPT-3.5 (what&
6.
by abetlen 4y ago
I think you're focusing on a few narrow examples where LLMs are underperforming and generalising about the technology as a whole. This ignores the fact that Microsoft already has a succesful LLM-based product in the market with Github
7.
by abetlen 4y ago
My go-to heuristic is three point estimation, basically a weighted average of the best, worst, and average case [0]. (Best + Worst + 4 * Average) / 6 One nice property is that it imposes a distribution that adjusts for longer tailed ri
8.
by abetlen 4y ago
If you run a Kubernetes cluster for self-hosting software or development I highly recommend setting up a Tailscale subnet router [1]. This will allow you to access any IP (pods or services) in your cluster from any of your Tailscale-connect
9.
by abetlen 5y ago
pikchr is awesome. A project I did recently was a WASM-compiled pikchr library to generate diagrams directly in the browser [1]. Here's a very early demo of a live editor you can play around with [2]. Not fully-featured yet but what I&
10.
by abetlen 6y ago
Cool trick, thanks for sharing. I don't get why there isn't a suitable snscanf function that takes the buffer length as an argument and returns the number of bytes parsed?
11.
by abetlen 6y ago
If you're getting into this stuff a great resource I found is the ZipCPU Tutorial [0] by Dan Gisselquist. The tutorial covers both Verilog design and Formal Verification methods. It uses open source tools like Verilator and SymbiYosys
12.
by abetlen 6y ago
> I'm pretty sure you could also maintain a temp table and use some kind of "insert...where...returning" construct to squeeze that into a recursive query. I'm not sure if this is possible in SQLite, as far as I know t
13.
by abetlen 6y ago
The issue I found with WITH RECURSIVE queries is that they're incredibly inefficient for anything but trees. I've looked around and there doesn't seem to be any way to store a global list of visited nodes. This means that whe
14.
by abetlen 6y ago
I've actually been working on an extension to perform breadth first search queries in SQLite on general graphs [0]. The extension is actually based off of the transitive closure extension. You can use it on any existing SQLite database
15.
by abetlen 6y ago
My brand new laptop was stolen while I was in school and I had to finish the year with a used 10-inch netbook I borrowed from a friend. Because of the tiny display and underpowered processor I had to get creative, I installed Arch plus i3 a
16.
by abetlen 6y ago
I may be misreading that, but isn't the table saying that 82% of residents with dementia require assitance in their daily living activities? From having spent time volunteering at a nursing home, that 87% number is not far off from m
17.
by abetlen 6y ago
I'm not sure if you're from outside North America, but I don't think nursing homes here are likely to have LAN parties unless we make some big medical breathroughs in the next few decades. According to this survey of Canadian
18.
by abetlen 6y ago
They really were. Here's a version of that video that includes Lorinda Cherry writing a talking calculator by piping together 3 unix commands. https://youtu.be/XvDZLjaCJuw?t=828
19.
by abetlen 6y ago
You're right. There is also Chilean town / research station that requires all residents to have their appendix removed [1]. [1]: https://en.wikipedia.org/wiki/Villa_Las_Estrellas
20.
by abetlen 6y ago
Fun fact, all doctors who plan to winter at an Antarctic station must have their appendix removed beforehand [1]. The reason is that they're usually the only doctor available. [1]: https://www.antarctica.gov.au/about-an
21.
by abetlen 6y ago
While you can use recursive common table expressions to perform graph queries, certain queries like breadth-first traversal are not very efficient for anything but trees (not even DAGs). See my post on the sqlite forum from the other day fo
22.
by abetlen 6y ago
OTP = Open Telecom Platform [1], though I think the full name is avoided nowadays. On an unrelated note, I've always been fascinated with the Erlang VM. The idea that you could hot-load modules and have multiple versions of the same mo
23.
by abetlen 6y ago
This is true, but won't help very much either. According to Google Support [1], they don't decide what is or is not fair use, leaving it up to the courts. This means the default position is that nothing is fair use unless the cont
24.
Calling print in Matlab with no arguments prints directly to your printer(mathworks.com)
3 points by abetlen 6y ago|0 comments
25.
by abetlen 6y ago
When I was a teenager, my mom (a psychiatrist) gave me her copy of Frankl's treatise on Logotherapy titlled The Will to Meaning . That book was so over my head, but something that's always stuck with from it is: life is uncond
26.
by abetlen 6y ago
I agree that asking for reviews was a lot less common at the time (2012), but he actually says "asking for reviews ... wasn't something that came to the front of mind ... it felt dirty at the time". To me that reads like he w
27.
by abetlen 6y ago
I think it's telling that his first hypothesis for why Barnes & Noble was getting more positive reviews was that they were paying for them. Honestly, my first thought was "maybe they're just asking more customers". I
28.
by abetlen 6y ago
The video tells the story of No Man's Sky, the buildup of unmeetable expectations prior to it's release, the online anger towards the game developers after the game's dissapointing release, and the hard work of those develope
29.
The Engoodening of No Man's Sky [video](youtu.be)
2 points by abetlen 6y ago|1 comments
30.
by abetlen 6y ago
Weird right? I learned Pascal in highschool in Ontario around 2010 as well. I remember being really frustrated at the time because we weren't learning some modern language like Java or Python. Instead we were stuck with Turbo Pascal, w

More ›