boyd

5 ms·

1.
by boyd 1y ago
Throwing cores at the problem with `pytest-xdist` is typically the lowest hanging fruit, but you still hit all the paper cuts the authors mention -- collection, DB fixtures, import time, etc. And, further optimization is really hard when
2.
by boyd 2y ago
I think we're somewhat talking past one another -- in any case, we'll add more in the README on minimal perfect hash functions and the differences. In short, you'd need to also have a data structure (e.g., a Bloom filter) for
3.
by boyd 2y ago
> PTHash and other minimum perfect hash functions return an arbitrary value if the query key did not exist when building the MPHF, so they can be a lot smaller. B-field can identify query keys that don't exist in the set (with high
4.
by boyd 2y ago
... meaning it is an "injective" function that maps unique key-value pairs, correct? Genuinely asking, I have glancing familiarity via their use in assembly algorithms but (a) don't have a formal math/CS background; an
5.
by boyd 2y ago
My understanding is that a perfect hash function maps elements elements to a unique integer (i.e., it's a one-to-one mapping). I think PHF data structures will also always return a value. So if you look up an element not in the const
6.
by boyd 2y ago
So a bitmap index requires a bit per unique value IIRC (plus the key and some amount of overhead). So for ~32 unique values you're already at 4 bytes, 40 bytes per key-value pair for 320 values, etc. In comparison, a B-field will let y
7.
by boyd 2y ago
Thank you! The "Space Requirements" section in the README has a few examples, and your comment has made me realize our (micro-)benchmark link in the README is broken. We'll get that fixed and maybe find the time to do a large
8.
by boyd 2y ago
> So it’s for cases where you have any key but associated with one of only (preferably few) discrete values We use it for a case with ~million unique values, but it's certainly more space efficient for cases where you have tens, hun
9.
by boyd 2y ago
Ah, we need to clarify the language! The B-field will always return the correct value for an inserted key. False positives are only returned for keys that have not been inserted. This is akin to a Bloom filter falsely returning that a key
10.
by boyd 2y ago
Yes you can manage the error rate by controlling the overall size of the allocated bit array and several other parameters. There's a (slightly obtuse) section on parameter selection here: https://github.com/onecodex&#x2
11.
by boyd 2y ago
I think those are both good examples of where you can manage the cost of a false positive. In genomics, we're using this to map a DNA substring (or "k-mer") to a value. We can tolerate a very low error rate for those individu
12.
Show HN: B-field, a novel probabilistic key-value data structure (`rust-bfield`)(github.com)
153 points by boyd 2y ago|36 comments
13.
Tempus AI (fka Tempus Labs) S-1(sec.gov)
1 points by boyd 2y ago|0 comments
14.
by boyd 2y ago
We’re more focused on data visualization vs. general “chat with your data”, but building in this space: https://minard.ai Upload or import a CSV, Excel, Google sheet, etc. and also just launched Postgres and Snowflake connectors
15.
by boyd 2y ago
It looks like on mobile in portrait that link isn’t showing up in the header. Thanks for flagging! We’ll get that fixed, but in the meantime the direct login link is https://minard.ai/accounts/login/ Note that the
16.
Show HN: Minard – Generate beautiful charts with natural language(minard.ai)
28 points by boyd 2y ago|5 comments
17.
by boyd 3y ago
It’s fairly common to use two hash functions and then compute the remaining n hashes as hn(x) = h1(x) + n * h2(x). Paper: https://link.springer.com/chapter/10.1007/11841036_42
18.
by boyd 3y ago
Feel obliged to point out this is misleading / not especially relevant: GDP is the value of the annual output of a country, while market capitalization is the (discounted) value of all future cash flows of a company. LVMH is ~0.5T mark
19.
by boyd 3y ago
I was looking at this a while back and it was difficult/tedious at the time (and I think also not supported on Amazon EKS). Has it gotten better? Any resources you recommend? Cursory Google searches on this have so much outdated info
20.
by boyd 5y ago
Futons are neither good couches nor good beds.
21.
Seeding Accounts for Kindergartners and Hoping to Grow College Graduates(nytimes.com)
7 points by boyd 5y ago|0 comments
22.
Eleven Arrested in Armed Roadside Standoff in Massachusetts(nytimes.com)
1 points by boyd 5y ago|0 comments
23.
by boyd 6y ago
One Codex (YC S14) | San Francisco (Mission) | Software + Scientist Roles | Onsite + Remote | https://www.onecodex.com One Codex is a platform for microbial genomics. We are a technical, experienced team working on meaningful pr
24.
AI Collaboration(tinkeredthinking.com)
1 points by boyd 6y ago|0 comments
25.
by boyd 6y ago
One Codex (YC S14) | San Francisco (Mission) | Software + Scientist Roles | Onsite + Remote | https://www.onecodex.com One Codex is a platform for microbial genomics. We are a technical, experienced team working on meaningful pr
26.
by boyd 6y ago
One Codex (YC S14) | San Francisco (Mission) | Software + Scientist Roles | Onsite + Remote | https://www.onecodex.com One Codex is a platform for microbial genomics. We are a technical, experienced team working on meaningful pr
27.
by boyd 6y ago
One Codex (YC S14) | San Francisco (Mission) | Software + Scientist Roles | Onsite + Remote | https://www.onecodex.com One Codex is a platform for microbial genomics. We are a technical, experienced team working on meaningful pr
28.
by boyd 6y ago
Those systems process up to 384 or 1056 samples in ~8 hours. The proposed method should support a similar volume (even a bit higher) than the Roche 8800, but with a different large installed instrument base. So this should add a lot of capa
29.
by boyd 6y ago
They accepted more tests than they had the ability to quickly process. They also appear to have accepted many tests that required use of a lower throughput assay before switching to higher throughput testing on Roche 8800s: https:/&#x
30.
by boyd 6y ago
One Codex (YC S14) | San Francisco (Mission) | Software + Scientist Roles | Onsite + Remote | https://www.onecodex.com One Codex is a platform for microbial genomics. We are a technical, experienced team working on meaningful pr

More ›