scott_s

5 ms·

1.
by scott_s 7d ago
It is indeed interesting, and it's from Nathan Marz, who was the creator of Storm. That was the first major open source streaming platform. It predated what I consider the default open source streaming platform, Flink. Glancing through
2.
by scott_s 9d ago
That work is still relevant! It's just that end-users don't need to be aware of it. The position of the paper I submitted, which I basically agree with, is that "streaming" shouldn't need to be something end-users c
3.
by scott_s 9d ago
Agreed agreed. During my time in the space, my pithy saying about the system I worked on [1] was that we could scale up or down. If you wanted to do streaming packet filtering with microsecond latency, we could do that. If you wanted to do
4.
by scott_s 10d ago
I worked in the streaming area for a decade, doing research and development (see: https://scholar.google.com/citations?user=Rdf5OIYAAAAJ&hl=en ). After moving on from streaming specifically and moving into the general pr
5.
The Dataflow Model Revisited(vldb.org)
114 points by scott_s 10d ago|22 comments
6.
by scott_s 16d ago
I have not been following, but some searching lead me to the conclusion that contracts are currently in the draft, but Stroustrup and some others are loudly saying that is a mistake. See: https://wrocpp.github.io/posts/
7.
by scott_s 1mo ago
A good place to start: https://news.ycombinator.com/item?id=46195226 . (The submitter should be familiar.)
8.
Stop Telling Students Computer Science Is Dying(insidehighered.com)
15 points by scott_s 1mo ago|1 comments
9.
by scott_s 1mo ago
I find that an odd take. The paper claims to establish what causes the problem: dimensionality. They are clear in that they don't understand why. But this sort of work is what needs to be done to eventually solve the problem.
10.
by scott_s 3mo ago
We dynamically load the shared object files. See: https://github.com/meta-pytorch/torchcodec/blob/8bbce656797c... Solutions that shell out to the `ffmpeg` binary are not going to perform well.
11.
by scott_s 3mo ago
I was copying URLs fast-and-furious. The PyTorch Stable ABI reference is: https://docs.pytorch.org/docs/2.12/notes/libtorch_stable_abi...
12.
by scott_s 3mo ago
1. A higher-level API that better integrates into the PyTorch ecosystem. 2. Ease of going back-and-forth between CPU and GPU; in our experience, there's still a lot of scenarios where CPU decoding makes sense. 3. Audio decoding support
13.
by scott_s 3mo ago
You can get older version of TorchCodec that work with older version of PyTorch, but it unfortunately will not have the new features (HDR video decoding; fast Wav decoding) in the latest release. See the compatbility matrix: https:/&#
14.
by scott_s 3mo ago
The one you have installed. :) We don't distribute FFmpeg and instead find your installed version at runtime. We support versions 4 through 8.
15.
TorchCodec 0.14: HDR Video Decoding for CPU and CUDA, and Fast Wav Decoder(github.com)
62 points by scott_s 3mo ago|13 comments
16.
by scott_s 3mo ago
For disclosure, I've worked on TorchCodec. I'm happy to answer any questions!
17.
by scott_s 6mo ago
You are correct, but this is not a new role. AI effectively makes all of us tech leads.
18.
by scott_s 6mo ago
That's not what the author means. Multiple times a day, I have conversations with LLMs about specific code or general technologies. It is very similar to having the same conversation with a colleague. Yes, the LLM may be wrong. Which i
19.
by scott_s 8mo ago
I think of, and look up, this drunken rant at least once a year.
20.
by scott_s 8mo ago
Yes, and that peer review happens through the ACM. It serves an organizing function. The conferences themselves are also in-person events, and most of the important research papers come out of those conferences.
21.
by scott_s 9mo ago
It doesn't. arXiv is exclusively a pre-print service. The ACM digital library is for peer-reviewed, published papers. All of the peer-review happens through the ACM, as well as the physical conferences where people present and publish
22.
by scott_s 9mo ago
IEEE may do it, as it's a professional organization. That is, they're a non-profit dedicated to the furtherance of the field. Being open access fits their mission, and the costs can be handled by dues and fees. Springer and Elsevi
23.
by scott_s 9mo ago
Great news. They temporarily opened it in 2020 during the pandemic. I argued it should remain so in a post: https://www.scott-a-s.com/acm-digital-library-should-remain-... . I'm glad it's finally happened.
24.
by scott_s 10mo ago
Gather metrics and regularly report them.
25.
by scott_s 10mo ago
Agreed. In grad school, I used Perl to script running my benchmarks, post-process my data and generate pretty graphs for papers. It was all Perl 5 and gnuplot. Once I saw someone do the same thing with Python and matplotlib, I never looked
26.
by scott_s 1y ago
That's true of all renewable energy sources. So we should take advantage of all of them, as much as is feasible.
27.
by scott_s 1y ago
You train on data. Context is also data. If you want a model to have certain data, you can bake it into the model during training, or provide it as context during inference. But if the "context" you want the model to have is big e
28.
by scott_s 1y ago
Because training one family of models with very large context windows can be offered to the entire world as an online service. That is a very different business model from training or fine-tuning individual models specifically for individua
29.
by scott_s 1y ago
> Of course, because I am not new to the problem, whereas an LLM is new to it every new prompt. That is true for the LLMs you have access to now. Now imagine if the LLM had been trained on your entire code base. And not just the code,
30.
by scott_s 1y ago
The tools are at the point now that ignoring them is akin to ignoring Stack Overflow posts. Basically any time you'd google for the answer to something, you might as well ask an AI assistant. It has a good chance of giving you a good a

More ›