jwuphysics

7 ms·

1.
by jwuphysics 2y ago
Have a PhD in physics/astronomy, so—full disclosure—I'm not an expert here... I skimmed the paper and I have no idea what he's talking about. Given that half of his eight references are to his own papers, and the other half a
2.
by jwuphysics 2y ago
Could you say a bit more about how so?
3.
by jwuphysics 2y ago
Incredible, well-documented work -- this is an amazing effort! Two things that caught my eye were (i) your loss curves and (ii) the assessment of dead latents. Our team also studied SAEs -- trained to reconstruct dense embeddings of paper a
4.
by jwuphysics 2y ago
You can get a nice sample of papers using VVV data using the Astrophysics Database System [0]. I mostly study other galaxies, which usually aren't variable on human lifespan-like timescales. Stars can vary on these shorter timescales,
5.
by jwuphysics 2y ago
> Why not just say "incoherent output"? Because the biggest problem with hallucinations is that the output is usually coherent but factually incorrect. I agree that "hallucination" isn't the best word for it... p
6.
by jwuphysics 2y ago
Have you looked into TinyCorp [0]/tinygrad [1], one of the latest endeavors by George Hotz? I've been pretty impressed by the performance. [2] [0] https://tinygrad.org/ [1] https://github.com/tinyg
7.
by jwuphysics 2y ago
PBMs hold an incredible amount of power. The Acquired podcast did a marvelous breakdown of the American pharmaceutical industry while covering Novo Nordisk ( https://www.acquired.fm/episodes/novo-nordisk-ozempic ). If yo
8.
by jwuphysics 2y ago
That makes sense and I'll run a few evals. Many thanks for open sourcing your work!
9.
by jwuphysics 2y ago
How much do you expect auto-context and clustering+re-ranking to help for cases in which documents already have high-quality summaries? For context, I parse astrophysics research papers from arXiv and simply embed by paper abstracts (which
10.
by jwuphysics 2y ago
I am an astronomer and was at a conference when this headline broke. Obviously we ignored this and read the actual papers, e.g. https://arxiv.org/abs/2404.03002 . There you can see that the dark energy equation of state
11.
by jwuphysics 3y ago
Oof, yeah that's not a very good response. But I guess color is actually a technical term in research astronomy: it refers to the difference in two specified magnitudes (usually photometric filters). There's also the question of w
12.
by jwuphysics 3y ago
UniverseTBD ( https://universetbd.org ) is also making great strides in the space of large language models and astronomy.
13.
by jwuphysics 3y ago
Thanks for your spectacular resources! I see that you began an Annotated Mamba repository -- any chance you could share when that blog page might go live?
14.
Two Years in the Tenure Track(jwuphysics.substack.com)
3 points by jwuphysics 3y ago|0 comments
15.
by jwuphysics 3y ago
I would be surprised if this is the case. Neural scaling laws are well known and are used by all big industry players to extrapolate experiments.
16.
by jwuphysics 3y ago
Hi Jeremy & Eric, great to see your newest endeavor. I hope that Answer.AI builds on the success and impact that fast.ai has already enjoyed. Given new developments in hardware (by companies not named NVIDIA), I'm wondering if you
17.
by jwuphysics 3y ago
Duplicate: https://news.ycombinator.com/item?id=38614232
18.
by jwuphysics 3y ago
You can read the [50 Years of Text Games]( https://if50.substack.com/archive ) newsletter that preceded the book. I highly recommend it!
19.
by jwuphysics 3y ago
There is indeed lots of uncertainty, and all Milky Way mass estimates are model dependent. Also, the ~10^12 solar mass figure referred to above is an estimate of the total galaxy + dark matter halo mass. Stellar or baryonic mass estimates a
20.
by jwuphysics 3y ago
> The idea that AI might transform scientific practice is therefore feasible. But the main barrier is sociological: it can happen only if human scientists are willing and able to use such tools. As a tenure-track scientist who works in M
21.
by jwuphysics 3y ago
> why did you loose an interest? Two reasons: 1. The posts I'd find most interesting in the site are ones related to astronomy and applied machine learning. If there wasn't anything on astronomy (or physics) then I probably wou
22.
by jwuphysics 3y ago
Although not the point of my comment (I don't want to sign in at all ) -- I personally like a username/password the best.
23.
by jwuphysics 3y ago
As others have said, forcing a login is a huge barrier. I wanted to see if any astronomy posts were on the front page, and when I didn't see any, I tried to check out the categories. But when prompted for a login/sign-up, I lost i
24.
by jwuphysics 3y ago
Fascinating! I dug into the Wikipedia article, which cites a Scholarpedia article; the LLM answer seems to originate from a reference to this sentence [1]: > So, MOND reduces the discrepancy in clusters at these radii to only a factor of
25.
by jwuphysics 3y ago
In terms of the actual article -- really nice finding. Or I guess, nice set of experiments to decipher what lots of LLM researchers have been finding! I've noticed somewhat similar behavior while training graph neural networks to model
26.
by jwuphysics 3y ago
Hi Jeremy, always a fan of your work! Just a technical note since it falls under my domain of expertise (astronomy) -- the example about MOND described here should actually have choice (E) as the correct answer!
27.
by jwuphysics 3y ago
> Please do not propose this regulation. If consumers actually cared about their IoT devices receiving security updates, companies would be doing it. The fact that companies are not already doing this is evidence it's not important
28.
by jwuphysics 3y ago
A professor remarked that it was a bit sad that physics students nowadays have a better understanding of quantum field theory than fluid mechanics. He mentioned this while lecturing on QFT.
29.
by jwuphysics 3y ago
Please don't editorialize the title. The title is > Starlink Generation 2 Mini Satellites: Photometric Characterization I'm a professional astronomer and I don't know what the "brightness reduction target recommended
30.
by jwuphysics 3y ago
> What makes you think their proposal isn't more likely than a black hole? Because a boson star is purely theoretical and I have a much stronger observational prior that the object is a black hole.

More ›