bhavnicksm

8 ms·

1.
by bhavnicksm 13d ago
Hey there! i just had a tiny nerd snipe thinking about why models tokens are priced a certain way. tldr: its very complicated. but wanted to suggest an alternate reality to the one we live in, maybe one where we can have fixed magins on cos
2.
DFlash 2: Keep Drafting Parallel(inco.ai)
15 points by bhavnicksm 29d ago|1 comments
3.
by bhavnicksm 8mo ago
Hey! Author of the blog here. This is pretty cool~ Thanks for suggesting this, I will read this in detail and add it to the next (0.5.0) release of memchunk.
4.
by bhavnicksm 9mo ago
thanks! this is still pretty early, please let us know if you face any issues with the library, database or anything else :)
5.
by bhavnicksm 9mo ago
it doesn't right now, but the fallback feature is planned for in a future release. mostly because there's no simple way to handle the classic fallbacks like aws, gcp and azure, and we wanted to spend some time thinking about their
6.
Show HN: Catsu: A unified Python client for embedding APIs(catsu.dev)
7 points by bhavnicksm 9mo ago|5 comments
7.
by bhavnicksm 10mo ago
Hey! Right now, some things are somewhat hard-coded to be Cloudflare compatible. If someone's willing, you can just deploy this without Cloudflare, but you'd need to dig into the code a little. In the future releases, I'll ma
8.
by bhavnicksm 10mo ago
Yes, that's quite fair re:Cloudflare! I couldn't find the right words to describe this, in comparison to something like Github Gist. I suppose "Own-your-data" since the D1 db generated is yours completely. Happy to chang
9.
Show HN: Pbnj – A minimal, self-hosted pastebin you can deploy in 60 seconds(pbnj.sh)
69 points by bhavnicksm 10mo ago|18 comments
10.
by bhavnicksm 2y ago
Thank you so much for giving Chonkie a chance! Just to note Chonkie is still in beta mode (with v0.1.2 running) with a bunch of things planned for it. It's an initial working version, which seemed promising enough to present. I hope th
11.
by bhavnicksm 2y ago
I don't fully understand what you mean by "maximum length truncation of the string"; but if you're talking about splitting the sentence into 'chunks' which have token counts less than a pre-specified max_token
12.
by bhavnicksm 2y ago
TokenChunking is really limited by the tokenizer and less by the Chunking algorithm. Tiktoken tokenizers seem to do better with warm-up which Chonkie defaults to -- which is also what the 2nd one is using. Algorithmically, there's not
13.
by bhavnicksm 2y ago
That's pretty cool! I believe a research paper called LumberChunker recently evaluated that to be pretty decent as well. Thanks for responding, I'll try to make it easier to use something like that in Chonkie in the future!
14.
by bhavnicksm 2y ago
Just to clarify, the 21MB is the size of the package itself! Other package sizes are way larger. Memory footprint of the chunking itself would vary widely based on the dataset, and it's not something we tested on... usually other provi
15.
by bhavnicksm 2y ago
Right now, we haven't worked on adding support for code -- some things like comments (#, //) have punctuations that adversely affect chunking, along with indentation and other issues. But, it's on the roadmap, so please
16.
by bhavnicksm 2y ago
Haha~ thanks!
17.
Show HN: Chonkie – A Fast, Lightweight Text Chunking Library for RAG(github.com)
199 points by bhavnicksm 2y ago|36 comments