dxtrous

8 ms·

1.
by dxtrous 5mo ago
A co-creator of Pathway here - noticed some inbound from the HN link and was a bit shocked to see the discussion. Of course, Airflow is one of the most widely used technologies out there, even if sometimes considered part of the "legac
2.
by dxtrous 11mo ago
Well spotted. Thank you!
3.
by dxtrous 11mo ago
Missed it - seems HN moderation (or OP?) changed the headline to the paper title.
4.
by dxtrous 11mo ago
> Claims/Observations end with a QED-symbol Author comment: as a fairly common convention, QED immediately after a particular statement means that the statement should be considered proven. Depending on the text, this may either be
5.
by dxtrous 11mo ago
From the authors: great question. If you take an "easy" task for long-range dependencies where a Mamba-like architecture flies (and the transformer doesn't, or gets messy), the hatchling should also be made to fly. For more a
6.
by dxtrous 11mo ago
One of the authors here. I am genuinely thrilled to know someone would like to know what "B" stands for, knowing/expecting that "DH" stands for "Dragon Hatchling"! A clarification is thus due. As indicated
7.
by dxtrous 11mo ago
You can, of course, use the almost equivalent scientific-sounding Latin-derived term ("neuromorphic"), buy popcorn, and come back with it for a discussion about memristors.
8.
by dxtrous 2y ago
It's mostly still data in the unstructured realm. One case is "messaging" data (live indexing of communications, social, news updates, etc.). Another case is data which was not originally text but can be easily transcribed in
9.
by dxtrous 2y ago
It's absolutely great to see you've figured out the details of it! Indeed, the repository comes with a mix of Python and Rust which need to be built together. We trust our users not to re-build the package with altered parameters
10.
by dxtrous 2y ago
The main factor impacting the RAM requirement of the instance is the size of the data that you feed into it, especially if you need an in-memory index. (If you are curious about peak memory use etc., you can profile Pathway memory use in Gr
11.
by dxtrous 2y ago
For indexing operators, there is some flexibility regarding the amount of internal operator state that is persisted. Say, in a stream-stream join structure, it's actually often faster to rebuild its state from its "boundary condit
12.
by dxtrous 2y ago
(Adrian from the Pathway team here.) Indeed, everything is RAM-based, and persistence/cache relies on file backends. The precise backend to use is a code configuration parameter. S3 or local filesystem are the currently supported optio
13.
Show HN: Adaptive RAG – How we cut LLM costs without sacrificing accuracy(pathway.com)
8 points by dxtrous 2y ago|1 comments
14.
by dxtrous 3y ago
I was hoping to see an LSMT implementation in bash and left slightly disappointed.
15.
by dxtrous 3y ago
Would it work on a printer?
16.
by dxtrous 3y ago
Seems it works with Bokeh+Panel. Maybe it is possible to make it work with Plotly. Probably not Dash.