AdamDKing

6 ms·

1.
by AdamDKing 6y ago
The script for this scam hasn't changed in years! Here's Kitboga with the same scam over 2 years ago: https://twitter.com/kitboga/status/1009830578407997440 (it's almost always 22 pounds of cocaine)
2.
by AdamDKing 7y ago
Possibly due to the current Google Cloud outage. https://status.cloud.google.com/incident/compute/19008
3.
by AdamDKing 7y ago
On the <|endoftext|>: GPT-2 and this model were trained by sampling fixed-length segments of text from a set of web pages. So if the sample happens to start near the end of one page then it will fill in the rest of the length with the
4.
by AdamDKing 7y ago
>How exactly the large GPT-2 models are deployed is a mystery I really wish was open-sourced more. TalkToTransformer.com uses preemptible P4 GPUs on Google Kubernetes Engine. Changing the number of workers and automatically restarting th
5.
by AdamDKing 7y ago
Thanks for the upvotes! The site is running quite a bit slower than planned, but I think I know why. I should be able to get it going at full speed around tomorrow.
6.
by AdamDKing 7y ago
The site was using one K80 GPU but it's slowing down significantly so I'm adding a second GPU. The servers run on Google Kubernetes Engine.
7.
Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model(talktotransformer.com)
93 points by AdamDKing 7y ago|55 comments
8.
by AdamDKing 7y ago
You seem to be saying this work is based on convolutional neural networks. That's incorrect. It uses the same attention mechanisms from natural language processing which involve no convolution operations. Convolutions have a different
9.
by AdamDKing 7y ago
It seems that using "fixed attention" for text would encourage the network to periodically summarize the context so far and put it in that fixed column for the rows below to access. Maybe the reason "strided attention" d
10.
by AdamDKing 7y ago
That line refers to training the model from scratch. You can still run the trained model very quickly with one "cheap" GPU. That said, I'm not sure why one wouldn't get a similar result training on the EC2 or GCE instanc
11.
by AdamDKing 7y ago
For all the 3D diagrams that I made (including the animated one at the end) I wrote code that used https://threejs.org/ and my custom library. It worked, but with a lot of hassle. In the future I'll likely try using Bl
12.
by AdamDKing 7y ago
NVIDIA just released the code: https://github.com/nvlabs/spade/
13.
Photos from Crude Sketches: Nvidia's GauGAN Explained Visually(adamdking.com)
124 points by AdamDKing 7y ago|25 comments