rhdunn

5 ms·

1.
by rhdunn 3d ago
It depends on how the model is evaluated/scored during training. If you don't have those laws encoded in the evaluation step (without any errors or ambiguities) then the model isn't going to learn to follow those laws. For mo
2.
by rhdunn 3d ago
I'm not sure if this is true any more but the reason for this is that negative indicators ("not", "don't", "do not", etc.) occur frequently in the underlying text such that the model learns to weight
3.
by rhdunn 4d ago
Part of software development is architectural design, database design, etc. That goes hand-in-hand with coding -- you come up with the design then implement that design. Part of software development is structuring the code to make it readab
4.
by rhdunn 4d ago
It depends on whether you are using the LLM as a) an advanced autocomplete; b) a chatbot/query interface; or c) an agent. Only the latter goes and does things for you. It's also confusing that the term AI has become synonymous wit
5.
by rhdunn 6d ago
These models aren't really LLMs -- they don't just operate on text tokens. They often include vision models and in some cases audio models. That means that they can better associate the meaning of images and words together so that
6.
by rhdunn 6d ago
You're comparing a company (Shopify) to an application (Google Chrome). A better comparison would be the number of engineers at Google (90,000 [1]) vs Shopify, or the number of developers actually working on the mobile application inst
7.
by rhdunn 6d ago
I'm not an AI critic (I use it for autocompletions and asking some questions) but still write my own code. I'm not sold on the agentic workflows that AI labs are pushing and haven't yet figured out if/when/how to in
8.
by rhdunn 7d ago
So this would suggest that the Goidelic languages (Irish Gaelic, Scottish Gaelic, Manx) are derived from the Brittonic languages (Welsh, Breton, Cornish). [1] I wonder how this affects the different proto-Celtic to modern Celtic languages h
9.
by rhdunn 8d ago
Ruby tags apply to other scripts as well like Japanese and Korean. See https://www.w3.org/TR/css-ruby-1/ .
10.
by rhdunn 9d ago
It only makes sense to train a frontier model if you are trying a different architecture to one that is available from an existing frontier model. This is because the different model architecture will learn the weights differently. It may m
11.
by rhdunn 9d ago
My understanding is that 1) SR doesn't consider acceleration (it's an extension of Galilean/uniform motion), and that 2) when Einstein considered acceleration as well as gravity via the equivalence principle which lead to GR
12.
by rhdunn 9d ago
The article says that this proves that Einstein's equivalence principle (resulting in relativity) holds in this test of a falling quantum particle (where gravity results in a phase shift in the quantum state). It doesn't show&#x2F
13.
by rhdunn 10d ago
Welch Labs on YouTube has a great collection of videos on how AI models learn. His recent video [1] covers how image models can learn to encode reasoning in the image processing layers when not given an out of band reasoning set of weights
14.
by rhdunn 11d ago
1. Does the implementation fit in the architecture/style of the project? 2. Are there potential security, accessibility, performance, etc. issues? 3. Domain specific knowledge (SQL, ASP.NET, XQuery, etc.) where there are better ways of
15.
by rhdunn 14d ago
My theory behind this is that when you encounter something new/novel it is distinct enough to remember -- where you were when you learned of 9/11; the days around the start of covid/lockdowns; being in a car accident; getting
16.
by rhdunn 15d ago
It is clever, but makes comparing versions of the WordNet database a lot harder as the byte offsets change as entries are added and removed.
17.
by rhdunn 17d ago
"Secret Hitler" is a social deduction game ( https://en.wikipedia.org/wiki/Secret_Hitler ). You can find various games of it on YouTube.
18.
by rhdunn 18d ago
The reasoning is that 600 is 60x10 which is conflating base 60 and base 10 numbering systems. You would expect something like 3600 (60x60), or even (given things like our units of time) 720 (60x12). The latter is because 12 is a factor of 6
19.
by rhdunn 19d ago
Keyboard shortcuts for those menu items are what most people will learn -- save, print, cut, copy, and paste will be the common ones that a lot of people will know. I'd be willing to bet that professional typists and people who spend t
20.
by rhdunn 19d ago
In some cases you may need the keyboard accessibility. - Your mouse/trackpad breaks or isn't recognized? - The right mouse button for your trackpad isn't working for some reason (e.g. you spilled a drink on it). It should sti
21.
by rhdunn 19d ago
My go to when implementing custom controls that can't be achieved in native HTML is the ARIA Patterns ( https://www.w3.org/WAI/ARIA/apg/patterns/ ) site. That has clear documentation on the roles, sta
22.
by rhdunn 19d ago
That's why you don't just use colour for identification. E.g. include a warning icon next to a button/element in addition to using a warning colour.
23.
by rhdunn 20d ago
It would be more flexible for a compiler to reuse the range analysis logic used in optimizations for statically verifiable divide by zeros. That way you could extend it to other things like statically verifiable overflows.
24.
by rhdunn 21d ago
Will they send him ... TO SPAAACE?!
25.
by rhdunn 23d ago
ASM is still used in some areas, such as: 1. function trampolines, such as in libraries like ATL (Microsoft's COM template library); 2. hand-optimized encoders/decoders for things like ffmpeg; 3. niche applications such as Ben Eat
26.
by rhdunn 23d ago
You mean like Microsoft, Google (GMail, YouTube, Android), Apple, Facebook, and others? Sorry, you can't buy an iPhone because Apple has got too many customers. Sorry, you can't have a GMail account because Google has too many cus
27.
by rhdunn 23d ago
I had my GMail account locked for 1-2 years because I accessed it from my parents house (in the same country but in a different county) while on holiday. That was because they detected the account being used from a different IP address. Usi
28.
by rhdunn 23d ago
Part of it is scale. If you have a small number of clients/users it is possible to provide that support. If you have millions or billions of users then you can't scale the support to handle the support requests, so some form of au
29.
by rhdunn 24d ago
The cost of training a model from scratch is going to be cost prohibitive for the vast majority of companies (even if renting the hardware needed for the 1-2 month training time). It's an interesting learning exercise, and some of the
30.
by rhdunn 24d ago
My understanding is that the idea behind Khanacademy is to switch the classroom -- learn a topic as homework; do the questions in the classroom. That way the teacher can assess (and help) the students. The other idea is that a student only

More ›