fantispug

8 ms·

1.
by fantispug 21d ago
Their strength was the ability to keep at the very fast moving AI frontier. When a new model is released they have been able to have a working implementation days later, not months when the model was redundant. And often it's much more
2.
by fantispug 1y ago
Yes, this seems to be a common capability - Anthropic and Mistral have something very similar as do resellers like AWS Bedrock. I guess it lets them better utilise their hardware in quiet times throughout the day. It's interesting they
3.
by fantispug 1y ago
Meta's primary business is capturing attention and selling some of that attention to advertisers. They do this by distributing content to users in a way that maximizes attention. Content is a complement to their content distribution sy
4.
by fantispug 2y ago
I find this style changes the way I think about and write code transformations. It's also in shell pipelines, R's magrittr, and Clojure's thread macros, and can be emulated in some OO languages with methods that return the tr
5.
by fantispug 2y ago
I have seen it work better than LSH. Each time you embed a document you search for approximate nearest neighbours before adding it, so it is O(N) like MinHash. Vector indexes like HNSW and PQ have better performance/quality tradeoffs t
6.
by fantispug 3y ago
It covers a lot of the fundamentals in some detail (attention and transformers, decoding, transfer learning) that are underneath current cutting edge NLP; this is still a very good foundation likely to be good for several more years. What m
7.
by fantispug 4y ago
> Maybe my data structure has a hash table of items, as well as a direct link to the largest item. When I say: "write the function to insert a new item in the list, and remember to update the largest item if it is larger than the cu
8.
by fantispug 4y ago
With the prompt // Print the fibonnaci sequence, except the number 5. int main() { I got the result: int a = 0; int b = 1; int c = 0; while (c < 100) { c = a + b; a = b; b = c;
9.
by fantispug 4y ago
This happened in mathematics about a decade ago when Wolfram Alpha came out. Lecturers started complaining that Wolfram Alpha could solve assignment problems with worked steps. In both cases I think this is a real opportunity; we can let st
10.
by fantispug 4y ago
These issues are often interactions between packages. I use TRAMP daily without freezing, but only when I disable company mode in shell modes. VSCode certainly requires much less of this tweaking, even with a variety of extensions installed
11.
by fantispug 6y ago
The killer feature of racket is it is very easy to make Domain Specific Languages (including the teaching language) and related tooling. However last time I looked the library ecosystem didn't seem great; there were many libraries but
12.
by fantispug 6y ago
Kaluza-Klein theory is an attempt to exhibit a transformation that charged particles travel on "straight" lines in a 5-dimensional space. The fifth dimension is supposed to be a very small circle. There are some experimental impli
13.
by fantispug 6y ago
I'm the same; I use evil-mode in emacs and find the friction of switching between them small.
14.
by fantispug 6y ago
I've thought about a variant of this with Baking Pi [1]. That takes you through assembly to the point of having a Raspberry Pi with a minimal terminal (with just an external USB driver the author wrote). I think it would be interesting
15.
by fantispug 7y ago
This may make sense if you want to do image processing and deep reinforcement learning. But there are lots of other domains. For tabular data (which is probably most relevant in Pharma, and probably the best place to start) Introduction to
16.
by fantispug 7y ago
If you like books and you want to deeply understand ML techniques I'd suggest jumping straight into "Introduction to Statistical Learning" and only learning calculus/stats/matrix methods (linear algebra) as you need
17.
by fantispug 7y ago
Without experience in ML it's often hard to know what problems are solvable, how to frame the problem, and to tell a good solution in Github from a bad one, etc. If you want to go an applied route I'd suggest starting somewhere li
18.
by fantispug 7y ago
They do mention Penrose notation in the linked arxiv paper[1], as well as Cvitanović's Birdtracks[2] which let you do calculations on representations of groups. They claim they're making it more accessible with pedagogical example
19.
by fantispug 7y ago
Circa 2009 I worked on an application that would render maths tests for teachers using plain TeX. I'm sure there are a few other wild examples (my CV is in eplain TeX).
20.
by fantispug 7y ago
My experience is pip and virtualenv (or venv in 3.3+) works pretty well in both interactive and deployment contexts. My main gripe is Pip doesn't resolve conflicts between downstream dependencies (which I could only get a stable enviro
21.
by fantispug 7y ago
This is missing the most important difference - deployability. R was built as a language to use interactively and does things like raise warnings for things that should be errors, requires an external package (packrat) for reproducible pack
22.
by fantispug 8y ago
I hope that you're wrong because it's solving the wrong problem. A compatibility interval (at an agreed upon arbitrary level) communicates the magnitude of the difference as well as the uncertainty, which makes it much better for
23.
by fantispug 8y ago
The details are even hairier. He wrote TeX82 (modern TeX) in WEB, a literate programming language he invented that could be tangled into the Pascal machine code or weaved into literate documentation in ... TeX itself. In fact he wrote WEB i
24.
by fantispug 8y ago
I wonder whether using computers more (whether numerical or symbolic calculations) could remove some of the burden of understanding mathematical techniques and make this process smoother. Or maybe it would just obscure the fundamental assum
25.
by fantispug 8y ago
Absolutely. There are some known anomalies in particle physics (e.g. neutrino oscillations) but for the most part it is insanely robust. What's really hard is moving from these first principles to modelling real world phenomena; there
26.
by fantispug 8y ago
Apache libcloud works well for more basic services (e.g. storand and compute) and is extending into container management services.
27.
by fantispug 8y ago
The web is dominated by a closed source browser built on an open source core, owned by the company that has the most private information and power to censor of any public company.
28.
by fantispug 8y ago
The "top level" problem is real in Python and in Lisps; but in practice it's not a huge issue (if you really don't like __name__ == "__main__" you can create your main app as a separate script to your library).
29.
by fantispug 8y ago
Regarding quotes, they're optional (e.g. when you need a comma, leading whitespace, or newline). With arguments by position possible I guess colons have to be quoted too. It's not clear to me that it's possible to convert thi
30.
by fantispug 8y ago
It's good to see an article about Firefox enhancing privacy, rather than for backdoor installing plugins for Mr Robot, integrating closed source Pocket (the server is still closed source despite the Mozilla acquisition), or opting in s

More ›