sdrg822

7 ms·

1.
by sdrg822 1y ago
“Model Control Plane” - quite early to already re-use a popular acronym
2.
by sdrg822 1y ago
Congrats on the launch!
3.
by sdrg822 2y ago
+1 it wouldn’t be terribly useful if it were only caching the tokenizer output.
4.
by sdrg822 2y ago
Where is the lie in this repo?
5.
by sdrg822 2y ago
I think if you actually meet the people you'd realize they're pretty earnest and candid of these things' limitations, though it may not show in tweets and hackernews posts. This repo, for instance, makes no claims of AGI. It
6.
by sdrg822 2y ago
But indexing *is* training. It's just not using end-to-end gradient descent.
7.
by sdrg822 3y ago
Dang they use Transformer-XL from 2019 haha - didn't realize people still used that / XLNet-like architectures
8.
by sdrg822 3y ago
It is not.
9.
by sdrg822 3y ago
Congrats on the launch!
10.
by sdrg822 3y ago
Cool. Important note: """ One may ask whether the conditionality introduced by the use of CMM does not make FFFs incompatible with the processes and hardware already in place for dense matrix multiplication and deep learning
11.
by sdrg822 4y ago
It’s only a matter of time
12.
by sdrg822 4y ago
Given that GPTZero was an undergrad’s side project it’s not that surprising?
13.
by sdrg822 4y ago
Attention is Turing complete
14.
by sdrg822 4y ago
For things like BERT where you just want to extract an embedding, the naive way you reach full utilization at inference time is that you : - run tokenization of inputs on CPU - sort inputs by length - batch inputs of similar length and appl
15.
by sdrg822 4y ago
Yeah this is purely a risk decision for a prototype not an actual technical limitation.
16.
by sdrg822 4y ago
Really well done
17.
by sdrg822 4y ago
Which humans?
18.
by sdrg822 5y ago
Good points!
19.
by sdrg822 5y ago
Just a slight comment - "&" was indeed called "and" (not "per se"), but in reading the alphabet, it was confusing to say "and and." To clear up confusion, one could say "and per se and,"
20.
by sdrg822 5y ago
Seasoning isn't the problem... Turmeric and cumin added to your pulses aren't going to give you metabolic diseases...
21.
by sdrg822 6y ago
Agreed, the "but" in the bolded text[1] further confuses, but the article highlights some great progress. >> STAR, has responded to 748 incidents." >> about 3 percent of calls for DPD service, or over 2,500 incide
22.
by sdrg822 6y ago
> "While it remains to be seen whether transplantation from very young donors can restore cognitive function in aged recipients, the findings demonstrate that age-related shifts in the gut microbiome can alter components of the cent
23.
by sdrg822 6y ago
Automated summarization, content moderation/censorship, and advertising. It could make publishing more profitable, but will it make enable higher quality content? It feels more like a continuation of the race to the bottom we are alrea
24.
by sdrg822 6y ago
Abbreviation for a popular blogger in the financial independence / retire early domain. See: https://www.mrmoneymustache.com
25.
by sdrg822 6y ago
While models such as XLNet incorporate recurrence, GPT-{2,3} is mostly just a plain decoder-only transformer model.[1] [1] https://arxiv.org/abs/2005.14165 [2] https://d4mucfpksywv.cloudfront.net/better-l
26.
by sdrg822 7y ago
Embarrassment may be universal, but the internalization of guilt and shame varies dependent on the culture both in degree and manner. See, e.g.: https://www.researchgate.net/publication/276464615_A_Cultura...
27.
by sdrg822 7y ago
Usually backcountry camping requires hiking in to a site, whereas "tent" camping would refer to stays in frontcountry campgrounds that are usually accessible via a car. With exceptions, tent camping would require a reservation, wh
28.
by sdrg822 7y ago
I also have been wondering whether I am out of the loop on some joke...