dougabug

5 ms·

1.
by dougabug 4d ago
LLMs glom onto pre-existing tropes, idioms, and verbal constructs.
2.
by dougabug 2y ago
No, your constant output example isn’t what people are talking about with “hallucination.” It’s not about destroying information from the input, in the sense that it you asked me a question and I just ignored you, I’m not in general halluci
3.
by dougabug 2y ago
Sure, but if we label the text as “factually accurate” or “logically sound” (or “unsound”) etc., then we can presumably greatly increase the probability of producing text with targeted properties
4.
by dougabug 2y ago
A pixel (in the context of an image) could be “wrong” in the sense that its assigned value could lead to an image that just looks like a bunch of noise. For instance, suppose we set every pixel in an image to some random value. The resultin
5.
by dougabug 2y ago
My recollection of CLIP is that it’s more of a text-language co-embedding, where you have two transformers, one which encodes images into vectors and one which encodes captions into vectors. Through a contrastive loss (positive pairs are ca
6.
by dougabug 3y ago
I would assume some of them can write Verilog code
7.
by dougabug 4y ago
You need to be very careful about making sweeping generalizations based on a single personal anecdote. The really large data sets typically have very high error rates and sample biases. For instance, Google’s JTF300M is far noisier than Ima
8.
by dougabug 4y ago
Data can be crowd sourced, too. Wikipedia demonstrated that crowdsourced data can be pretty competitive. More recently the open LAION data sets have become widely used by both tech giants and independent researchers.
9.
by dougabug 4y ago
If it faithfully memorized and reproduced a set of watermarks, it would be premature to conclude that it hadn’t memorized other (non-generic) graphical elements.
10.
by dougabug 4y ago
That statement was clearly false. With an amazing teacher, an extremely bright student, focus, patience, time, etc., sure we can have the next Galois… but in the vast majority of cases, we should avoid setting kids up for failure by expecti
11.
by dougabug 4y ago
Calculus is not easy to teach to children. We fail to teach it adequately to most college students in their first two years of study. Even a few historically noteworthy mathematicians failed their first contact with the subject. Elementar
12.
by dougabug 4y ago
Calculus was quite difficult for human civilization to get a logically sound handle on; basically, it took the better part of two centuries from Newton’s original formulation of Calculus in the 17th Century to the work of Cauchy, Gauss, Wei
13.
by dougabug 4y ago
Yes, the future is now. It’s still early, extracted model quality will undoubtedly improve dramatically over time. https://blogs.nvidia.com/blog/2022/09/23/3d-generative-ai-re... https://resea
14.
by dougabug 4y ago
The first AI generated feature length film I’d want to see would be, “It’s a Wonderful Life, Calculus,” where we get to see what human history would’ve been like if we’d never stumbled across Calculus. So the basic idea at the heart of Calc
15.
by dougabug 4y ago
I would actually start with a first pass at elementary linear algebra, before taking a serious crack at even single variable Calculus. Then let the key ideas marinate in your brain; develop some facility and intuition / insight. Multiv
16.
by dougabug 4y ago
You have the first prerequisite, the desire to learn! Try to find resources which nurture your interest, until it grows into the will to learn. I find the history of mathematics and how it came to be, its role in the rise of civilization,
17.
by dougabug 4y ago
If you removed all of the noise in a corrupted image in one step, you would have a denoising autoencoder, which has been around since the mid-aughts or perhaps earlier. Denoising diffusion models remove noise a little bit at a time. Think a
18.
by dougabug 4y ago
No, NeRFs are more interpretable because they directly model field densities which absorb and emit light. In this respect they are something akin to a neural version of photogrammetry. They don’t need to train on a large corpus of images, b
19.
3D Novel View Synthesis with Diffusion Models(3d-diffusion.github.io)
106 points by dougabug 4y ago|13 comments
20.
by dougabug 4y ago
This approach is interesting in that it applies image-to-image diffusion modeling to autoregressively generate 3D consistent novel views, starting with even a single reference 2D image. Unlike some other approaches, a NeRF is not needed as
21.
by dougabug 4y ago
I’d imagine a cockroach is generally a bit harder to kill than a mosquito.
22.
by dougabug 4y ago
Giving no reason, absent a contractual or legal requirement to provide one, falls far short of offering up a blatantly illegal explanation. Even so, companies have clearly been found guilty of illegal discrimination, even when they went out
23.
by dougabug 4y ago
The established remedy for abusive monopolies is enforcement of antitrust laws.
24.
by dougabug 4y ago
No, state and federal law explicitly create protected classes, and describe the scope of protections granted. A service provider would be opening itself up to huge liability if it cut someone’s service based on, for instance, race or gender
25.
by dougabug 4y ago
Exactly so. Your decision not to host certain content you find odious is a valid exercise of your freedom of speech, as well as your freedom of association.
26.
by dougabug 4y ago
I am not suggesting that the right tools will allow absolutely anyone to be happy working in any given role in the domain of software development. Scoping is a big part of finding the right roles for people. Maybe a person loves developing
27.
by dougabug 4y ago
Prestige can be a kind of non-monetary compensation, but one which is generally difficult to measure, especially for rank-and-file employees.
28.
by dougabug 4y ago
So would this be something like OCP, but at the level of an entire eCommerce marketplace? If so, that sounds pretty awesome. Main pitfall would seem to be free riders cloning the system, stealing what works, creating closed source improved
29.
by dougabug 4y ago
Well, at least the people won’t thrive if the work is hard and the pay is low. Some people frame this as some kind of character defect on the part of Americans, but to me it just seems like common sense to avoid hard work for low pay, if po
30.
by dougabug 4y ago
It’s not a zero sum game. There isn’t some fixed, finite demand for software. There’s no upper bound on how much value can be created by skilled, imaginative software engineers, and a programmer can be productive with a relatively inexpensi

More ›