chewxy

6 ms·

1.
by chewxy 5mo ago
So I have been practicing writing fiction the past year or so. It identifies a fiction piece I wrote as Greg Egan[0]. Another paragraph from another piece was identified as China Mieville[1]. The accompanying blog posts explaining the makin
2.
by chewxy 10mo ago
BigQuery has that and I've been loving using it since they introduced it
3.
by chewxy 11mo ago
> Limited training data, as compared to kanguages like Python or javascript. I use my own APL to build neural networks. This is probably the correct answer, and inline with my experience as well. I changed the semantics and definition
4.
When good pseudorandom numbers go bad(blog.djnavarro.net)
71 points by chewxy 1y ago|38 comments
5.
by chewxy 1y ago
Maybe read the paper first? > This study asked whether Large Language Models (LLMs) understand sentences in the minimal sense of representing “who did what to whom”. In Experiment 1, we found that the overall geometry of LLM distributed
6.
by chewxy 1y ago
I wrote a short story ten years ago making fun of this concept: https://blog.chewxy.com/2014/05/20/the-long-term-plan/
7.
by chewxy 2y ago
Barry Jay's got an upcoming paper at PEPM regarding typed tree calculus. Good read too.
8.
by chewxy 2y ago
Thanks :)
9.
by chewxy 2y ago
At this point I'm writing mostly for myself. GTM strategies for novels... that's an interesting way to think about things. I've not thought about it just yet. Happy to hear if you have any ideas tho.
10.
by chewxy 2y ago
I'm working on my scifi novel. I had started writing it when LLMs started taking off - I had been doing AI for two decades and I was well-placed to be in a good position to profit with the rise of LLMs, but I ended up gaining nothing m
11.
by chewxy 2y ago
I did this 13 years ago: https://blog.chewxy.com/2011/08/31/one-point-five-hours/
12.
by chewxy 2y ago
Not really, this is actually pretty readable
13.
by chewxy 2y ago
I told a variant of the original Little Mermaid story as part of a school outreach program. The kids came to the conclusion that God wasn't a fair being because he didn't give mermaids souls. I walked away satisfied that my little
14.
by chewxy 2y ago
there's also a good paper - Can a neuroscientist understand a microprocessor - by Kording's lab which is also an excellent read.
15.
by chewxy 2y ago
Dana Angluin's group were studying chat systems way back in 1992. There even was a conference around conversational AI back then.
16.
by chewxy 2y ago
Haha I remember you and your SaltStack talks at SyPy. Shame you moved to Melbourne. Hey, coffee's better here now ( https://www.timeout.com/sydney/news/experts-have-ranked-the-... ). Wanna come back?
17.
by chewxy 2y ago
Most LLMs out there are very American in their writing mannerisms. The article even alludes to this: > The AI did, however, try to sound like someone. It was folksy and upbeat, talky and pretend-excited I've not seen an LLM, even wh
18.
by chewxy 2y ago
I've been running GolangSyd for about 8 years now, and previously Sydney Python for about the same amount of time. I found finding sponsors to be one of the hardest things. One of the last Sydney Pythons in which I gave a talk on machi
19.
by chewxy 2y ago
So.. sourcegraph?
20.
by chewxy 2y ago
This is not a nice way to discover Dan Dennett died
21.
Chinchilla Scaling: A Replication Attempt(arxiv.org)
2 points by chewxy 2y ago|0 comments
22.
by chewxy 2y ago
you have to admit that 3-3 invasion is pretty annoying to handle. AI is way too aggro and people are learning to be as aggressive.
23.
by chewxy 2y ago
A good thing about living in a small house. I can hear when my rice cooker is done (plays a tune), when my washing machine is done (plays a tune), when my dryer is done (plays a tune). :) (note that that hasn't prevented me from hookin
24.
by chewxy 2y ago
Go (the game). I wrote a clone of AlphaGo in Go (the programming language) 8 years ago. Along the way I learned to play Go. I've been using a combination of my own AI, LeelaZero and KataGo to teach myself in Go. For 8 years I've l
25.
by chewxy 3y ago
I agree. There are other types of AIs with different applications that do not need to be trained on the internet. The examples you have given however, are examples where the deep nets are extremely data hungry. Take computer vision for exam
26.
by chewxy 3y ago
It was good enough in 2015/2016 for me to run a startup that allowed people to program in natural language. We even had paying clients though eventually none could stomach the $2000 per month for incremental/on-line training costs
27.
by chewxy 3y ago
GP mentioned that the current slate of transformer based AIs are not transformative in the same way the Internet was. Rather it's more of a triumph of data engineering practices. OP disagrees with GP. OP's main thesis is that AI e
28.
by chewxy 3y ago
Current AI/ML is in fact a reflection on training data. Change the manifold, and change the response. It's unfortunate that of course the data is the entire internet.
29.
by chewxy 3y ago
I talked to Matt about not owning our own data after GopherConSG where he gave this talk. It was enlightening how complicated the issue is - there's a lot of legal liabilities on the end of the data provider (the company that monitors
30.
by chewxy 3y ago
The paper is about implementing transformer-like attention using simulated human neurones

More ›