iliane5

7 ms·

1.
by iliane5 2y ago
Just wanted to say thank you for your work and attention to detail, it's immensely valuable and we're all very grateful for it.
2.
by iliane5 3y ago
Watching an entirely generated video of someone painting is crazy. I can't wait to play with this but I can't even imagine how expensive it must be. They're training in full resolution and can generate up to a minute of video
3.
by iliane5 3y ago
I think it's mostly the scale. Once you have a consistent user base and tons of GPUs, batching inference/training across your cluster allows you to process requests much faster and for a lower marginal cost.
4.
by iliane5 3y ago
What I was saying is that because you need to go out of your way to make sure it's tokenized properly, I wouldn't be surprised if there are enough non properly tokenized examples in the dataset. If that was the case, it would make
5.
by iliane5 3y ago
> LLMs are not particularly good at arithmetic, counting syllables, or recognizing haikus I suspect most of this is due to tokenization making it difficult to generalize these concepts. There are some weird edge cases though, for example
6.
by iliane5 3y ago
AFAIK it's pretty standard practice not to expose the "raw" LLM directly to the user. You need a "sanity loop" where user input and the output of the LLM is checked by another LLM to actually enforce rules and mitig
7.
by iliane5 3y ago
100% agree. However, seeing how excited Palantir is with their war assistant LLM , the US testing autonomous fighter jets a few months ago, etc. I think there's a decent chance that AI won't even have to break out of its constrain
8.
by iliane5 3y ago
I don't think we need sentient AI for it to be autonomous. LLMs are powerful cognitive engines and weak knowledge engines. Cognition on its own does not allow them to be autonomous, but because they can use tools (APIs, etc.) they are
9.
by iliane5 3y ago
> Why is building what amounts to a calculator/spreadsheet/CAD program for language somehow a Rubicon that cannot be crossed? We've already crossed it and I believe we should go full steam ahead, tech is cool and we should
10.
by iliane5 3y ago
There's no denying this is regulatory capture by OpenAI to secure their (gigantic) bag and that the "AI will kill us all" meme is not based in reality and plays on the fact that the majority of people do not understand LLMs.
11.
by iliane5 3y ago
The human brain works around a lot of limiting biological functions. The necessary architecture to fully mimic a human brain on a computer might not look anything like the actual human brain. That said, there are 8B+ of us and counting so u
12.
by iliane5 3y ago
> I don't want every to know how to make a bomb. This information is not created inside the LLMs, it's part of their training data. If someone is motivated enough, I'm sure they'd need no more than a few minutes of go
13.
by iliane5 3y ago
> Why is it so hard to hear this perspective? Like, genuinely curious. Because people have different definition of what intelligence is. Recreating the human brain in a computer would definitely be neat and interesting but you don't
14.
by iliane5 3y ago
Agreed, there is way too much hype about the actual capabilities of the LLaMa models. However, instruction tuning alone makes Alpaca much more usable than the the base model and to be fair even some versions of the "tiny" 7B can d
15.
by iliane5 3y ago
I'm sure they're tweaking lots of things under the hood, especially now that they have 100M+ users. It could be bigger (30B?, maybe 65B) as coming down from 175B gives quite a lot of room, but the cognitive drop from Davinci giv
16.
by iliane5 3y ago
GPT-3.5 is much worse at "complex" cognitive tasks than Davinci (175B), which seem to indicate that it's a smaller model. It's also much faster than Davinci and costs the same as Curie via the API.
17.
by iliane5 3y ago
It’s not only 10x cheaper, it’s also way faster at inference and not as smart as Davinci. IMO the only logical answer is that the model is just smaller.
18.
by iliane5 3y ago
I bet they’re not saying how big of a model GPT-4 is because it’s actually much smaller we would expect. ChatGPT is IMO a heavily fine-tuned Curie sized model (same price via API + less cognitive capacity than even text davinci-003) so it w
19.
by iliane5 3y ago
I think as soon as text2video gets really good (like midjourney level), there’s gonna be so much AI generated content that unless it’s all extremely good, human made content will be something people search specifically for. As for curation,
20.
by iliane5 3y ago
> LLMs architected and trained the way they are now can never approach human reasoning capability Not sure if you’ve played with GPT-4 but honestly it’s getting there. If you take the bar exam, ChatGPT was in the bottom 10% of participan
21.
by iliane5 3y ago
Absolutely. What’s fascinating is that they’re getting such good understanding of many things through just text. Multimodal models that can process text, images, sounds, video, etc. are gonna be very interesting for that very reason
22.
by iliane5 3y ago
There's no denying LLMs are anything but sentient however is sentience really needed for intelligence? I feel like if we can have machines that are X% smarter than a human could ever get for any given task, it'd be a much better o
23.
by iliane5 3y ago
> But it's not better than almighty human intelligence, it _is_ human intelligence, because it was trained on a mass of some of the best human intelligence in all recorded history Sure, I was saying "better" in the sense t
24.
by iliane5 3y ago
Well it's like birds and airplanes. Do airplanes "fly" in the same sense that birds do? Of course not, birds flap their wings and airplanes need to be built, fueled and flown by humans. You could argue that the way birds fly
25.
by iliane5 3y ago
What I find really entertaining is the "just predicting the next token" argument. If just predicting the next token can produce similar or better results than the almighty human intelligence on some tasks, then maybe there's
26.
by iliane5 3y ago
SVG also supports <script> tags, which is even wilder
27.
by iliane5 3y ago
Apparently it’s for analytics
28.
Show HN: Alceos – AI Knowledge Base for Your Data(alceos.com)
2 points by iliane5 3y ago|0 comments
29.
by iliane5 4y ago
Spam is spam whether made by a human or an AI. Good, valuable content is good whether made by a human or an AI. Bad or uninteresting content is spam if it’s being pumped out by an AI, but it’s a learning experience/personal expression
30.
by iliane5 4y ago
AI content detection is a losing battle imo. Models will become better and people will use the detectors to rephrase the text so it doesn’t get detected.

More ›