ylow

8 ms·

1.
by ylow 7mo ago
Just for you I will switch my FTP server to run on Port 23.
2.
by ylow 7mo ago
Most tech startups will be Delaware. And a lot comes down to the definition of "own" which is ambiguous especially as a C-Corp. One may not be CEO, but can be a H1B Co-founder with a non-trivial (for some amount of non-trivial) nu
3.
by ylow 7mo ago
There is no obligation to provide the public with his life story. Even if provided, few really understand the US immigration process to really comprehend what it means. And finally, does it matter? Even if deportation is fully legally and e
4.
by ylow 7mo ago
Whether he did really have valid work permits, or not, I have no idea. You seem knowledgeable. But I am just generally mildly frustrated by people online jumping to conclusions assuming malice or criminal intent, while knowing nothing about
5.
by ylow 7mo ago
This is not true. You do not need to be a US resident to register a company, and anyone own shares in a company. There are a variety of visa options, and ways to navigate the process that will work.
6.
by ylow 7mo ago
Its not so complicated. Not everyone wants a green card. It triggers international taxation, exit taxes if you give it up, etc. If you can maintain a work permit for 20 years, why not? Until life circumstances change sufficiently that it ma
7.
by ylow 1y ago
The application, method and algorithm needs to be separated. The application is movie recommendation. One of the methods which works pretty well for this is low rank matrix completion. There are several algorithms for this method, one of wh
8.
by ylow 1y ago
The actual problem that is being solved here is well defined mathematically and is matrix completion via low rank matrix factorization. And using a sampling approach for it. (I have not read the paper in its entirety, just skimmed the intro
9.
by ylow 1y ago
This is using statistics to tell a preconceived story. Underlying this a notion that foreign workers are simply “imported” like they are dug out of the ground or something. How do these STEM OPT people find jobs? Guess what. They interview
10.
by ylow 2y ago
Even just audio transcription can hallucinate in bizarre ways. https://arstechnica.com/ai/2024/10/hospitals-adopt-error-pro...
11.
by ylow 2y ago
I think both are necessary. The cdc technique is file format independent. The row group method makes Parquet robust to it.
12.
by ylow 2y ago
We are here to help lower that :-) . As we can push dedupe to the edge we can save on bandwidth as well. And hopefully make everyone upload and download faster.
13.
by ylow 2y ago
Great question! Rsync also uses a rolling hash/content defined chunking approach to deduplicate and reduce communication. So it will behave very similarly.
14.
by ylow 2y ago
I believe Parquet predates Arrow. That's probably why.
15.
by ylow 2y ago
Can you elaborate? As I understand Delta Lake provides transactions on top of existing data and effectively stores "diffs" because it knows what the transaction did. But when you have regular snapshots, its much harder to figure o
16.
Improving Parquet Dedupe on Hugging Face Hub(huggingface.co)
47 points by ylow 2y ago|17 comments
17.
by ylow 2y ago
Hi all! Yucheng (CEO XetHub) here, happy to answer any technical questions anyone might have. Our current tech is a significant enhancement over the original Git Is For Data paper we published last year https://www.cidrdb.org&#x2
18.
by ylow 2y ago
The dedupe is optimistic and is designed to scale to 1-10 PB range. There is a more complicated architecture blog post we are working on. We can dedupe across repositories but we do not right now largely for privacy reasons so that blocks a
19.
Benchmarking Versioning Tools: S3, DVC, Git LFS, and XetHub(about.xethub.com)
13 points by ylow 2y ago|4 comments
20.
by ylow 2y ago
(Yes 71 + 27 != 100, but that LLMs can't count is a whole other issue)
21.
by ylow 2y ago
Indeed this is unsurprising given how LLMs work. I mean if you ask a human to generate a random number, and then reset the universe and all state of the human and ask again, you will get the same number. But instead if I ask it to generate
22.
by ylow 3y ago
I think this is because a graph is not a data-structure nor a data-type. It is really an abstraction. Fundamentally, all I need to define a graph is a set of vertices v \in V and function Neighbors(v). And that really is all is needed for
23.
by ylow 3y ago
The issue comes when cells take many minutes or even hours to run (intentionally or not). The ideal is indeed sequential, and this helps me a lot with maintaining the sequential ordering as it simplifies and speeds up the “restart and run a
24.
by ylow 3y ago
Author here. Mandala looks really cool. Thanks for the recommendation!
25.
by ylow 3y ago
Author here. The goal in a way is better reproducibility. The memo hashes the contents of the inputs, so if your cell is deterministic (and you cover all the inputs), the memo should give you the right answers. Of course if you want to re
26.
You Do Not Need a Vector Database (For RAG): Benchmarking IR Methods
9 points by ylow 3y ago|0 comments
27.
by ylow 3y ago
Some random historical notes coroutine stuff which are perhaps of interest to some: 1. You can implement "stack-free coroutines" in C with some really entertaining macros https://www.chiark.greenend.org.uk/~sgtatha
28.
by ylow 3y ago
(Love the Gluster project btw. Thanks for maintaining it!)
29.
by ylow 3y ago
Nice! I did look at Ganesha when I was exploring other NFS server implementation I could perhaps borrow and simplify. It looked great, but pretty much all implementations are too "real-filesystem" for me to convert. I needed somet
30.
by ylow 3y ago
I don't know that its considered a "design mistake". It is not without flaws, but it does make it extremely simple to implement. Its a very acceptable point as a tradeoff between simplicity and performance. Will certainly lov

More ›