tadkar

6 ms·

1.
by tadkar 23d ago
I wonder if the NCD metric says something about distillation too. Would you expect that a model that has been distilled/seen traces from other models would have a smaller NCD? It would be really interesting to see if this holds up and
2.
by tadkar 3mo ago
ahead of time
3.
by tadkar 2y ago
I think the important thing is that the first approach to converting complete sentences to an embedding was done by averaging all the embeddings of the tokens in the sentence. What ColBERT does is store the embeddings of all the tokens be
4.
by tadkar 2y ago
Here’s my understanding. It is intimidating to write a response to you, because you have an exceptionally clear writing style. I hope the more knowledgable HN crowd will correct any errors in fact or presentation style below. Old school wor
5.
by tadkar 2y ago
I have a theory that organizations that grow fast and scale well all have this “cellular model” at their core. Investment bank trading desks in the pre-2008 era, partnership at the big strategy consulting firms and even “multi-strategy hedg
6.
Architecting ML Pipelines on Snowflake(modelbit.com)
1 points by tadkar 2y ago|0 comments
7.
by tadkar 3y ago
This is a great blog to give you things to get started. https://easyperf.net/ As with all things, practice is an essential part of improving! Then, there's learning from some real achievements. Fast inverse square root
8.
by tadkar 3y ago
I came here to say exactly the same thing. There are also a couple of other options: the MIR project from RedHat [1], libjit [2], lightning [3] and Dynasm [4] 1. https://github.com/vnmakarov/mir 2. https://w
9.
by tadkar 3y ago
I suspect that for most Bloom filters, the most commonly used hash functions are “good enough”. There’s also some literature to suggest that using just 2 hash functions and recombining the results is plenty. See kirsch-mitzenmacher [1] and
10.
Quack Pipe – DuckDB as a ClickHouse UDF(blog.qryn.dev)
4 points by tadkar 3y ago|0 comments
11.
Comparing SQL based streaming analytics approaches(georgheiler.com)
2 points by tadkar 4y ago|0 comments
12.
by tadkar 4y ago
I think JetBrains have something where you can do something like what you’re looking for. https://www.jetbrains.com/mps/
13.
by tadkar 4y ago
I think this is the paper https://arxiv.org/abs/1204.6079
14.
Bootstrapping Data Labels(eugeneyan.com)
12 points by tadkar 5y ago|0 comments
15.
by tadkar 5y ago
How does preflight deal with selectors used to identify elements changing? This is the critical piece to solve before systems like this are useful. As identified in the paper discussed here: https://blog.acolyer.org/2016&#x2
16.
On Medici and Thiel(strangeloopcanon.com)
26 points by tadkar 5y ago|5 comments
17.
by tadkar 5y ago
From an employer’s perspective, I’d be super interested in hearing about the experience of applying for this visa too! Does the UK government make it easy to apply? What are the interviews like? Anything your employer did that made the whol
18.
by tadkar 5y ago
The paper has a great figure where they illustrate areas of the overhead vs false positive trade-off space where each filter type performs best. Cuckoo filters make an appearance there
19.
by tadkar 5y ago
A hyperLogLog is for counting distinct elements. This and Bloom filters are more about checking whether an element has been seen before; a very different use case.
20.
No more DSLs: Implement and deploy a distributed system with a single program(catern.com)
64 points by tadkar 5y ago|15 comments
21.
Online spreadsheet with first class functions and record types(inflex.io)
6 points by tadkar 5y ago|1 comments
22.
by tadkar 6y ago
There is a similar great project here [1] with the Hungarian Wikipedia corpus. Great workout for non English and maybe non-ascii operations. The performance of Java there is super impressive. It should port relatively quickly to this file t
23.
by tadkar 6y ago
Clickhouse is not something you use for a CRUD backend. The obsession with Clickhouse is the phenomenal performance for the OLAP use case, a scenario where there were not many open source, easy to install and maintain options. For the most
24.
by tadkar 6y ago
I am going to massively over simplify, but here goes. The really big idea from control theory is the idea of negative feedback. This basically boils down to measuring the output of your system and making the input to the system some functio
25.
by tadkar 6y ago
The observation about consumer inflation is very true, the massive inflation is actually in asset values (house prices, share prices, etc) I also wonder how I reconcile the rest comment with others pointing out the vast amounts of money a
26.
by tadkar 6y ago
Thanks for the loss function reference! I wonder if there’s something waiting to be discovered here about doing gradient descent but only taking steps with some probability. Definitely something to think about, I can’t imagine this idea has
27.
by tadkar 6y ago
And would the 2 memory algorithm be equivalent to a gradient descent with momentum? I used to know what a sub gradient was, but I think there must be something more to the ideas in the paper because I’m struggling to see the analogy between
28.
by tadkar 6y ago
Related to this, one of my favourite articles [1] suggests that it’s sufficient to only use one or two pieces of memory to get good estimates. Here’s a pretty amazing result from the paper. To estimate the median (loosely) on a stream, firs
29.
by tadkar 6y ago
That is definitely changing in credit risk and underwriting as well. There are several companies like [1] applying deep neural nets to the credit risk problem. This on top of a lot of in house work in the big banks to “supplement” what is a
30.
by tadkar 6y ago
Some quick comments about the iOS app. 1) it seems quite unintuitive to not be able to drag the cursor along the calculation and to rely on the arrow keys 2) the list is functions is long and not having text search (much like excel) is a ma

More ›