unrahul

7 ms·

1.
by unrahul 28d ago
Yes, a quick back of the envelope math is 0.65 * (memory bandwidth of the card / (model weights in bytes + kv cache in bytes) ~ practical decode tps. Below context around 32k (depends upon the model but again can be used as a placehold
2.
by unrahul 28d ago
You could think of it as a standard decoder only LLM (almost all modern ones we use everyday), with some layers (experts) having parallel networks and conditionally based on the input token (per token) - the token is routed through some of
3.
by unrahul 8mo ago
I have seen this flow in what people in some startups call "Agentic OCR", its essentially a control flow that is coded that tries pdf-parse first or a similar non expensive approach, and if it fails a threshold then use screenshot
4.
by unrahul 2y ago
Hey Danny, Really nice read. Do you plan to share the source code to see if we could replicate this?
5.
by unrahul 2y ago
We don’t want hex , can ask in a language that is not popular or the first 5 in the dataset , and it would answer , but not always will work with deep think . Using a tiny translator model in front of the api can make it more ‘open’.
6.
by unrahul 3y ago
Daniel is of the best engineers I have ever worked with. Engineer in the true sense of wanting to know how something works and figuring out ways to improve it !
7.
Advent of GenAI Hackathon on Intel GPUs(adventofgenai.com)
2 points by unrahul 3y ago|1 comments
8.
by unrahul 3y ago
AI Developers, Startup Founders, Students: Ready for a Challenge? Join the "Advent of GenAI Hackathon" by Prediction Guard, with Intel Liftoff's support. A week-long journey into Generative AI awaits, packed with daily chall
9.
by unrahul 3y ago
I couldn't find online how to finetune LLMs on an Intel dGPU, so i made a simple version. This particular one can be used to generate text based on your favorite book (for eg). I hope you find it useful if you are having an Intel discr
10.
Unofficial guide to setup Intel dGPUs in Linux(github.com)
3 points by unrahul 3y ago|1 comments
11.
by unrahul 3y ago
If you are one of those folks who use Linux and intel dGPUs (a tiny minority, I am sure :)) like me and is finding it difficult to set up a functional dev environment for the GPUs (Arc Alchemist, Datacenter Flex, GPU Max cards). This repo w
12.
by unrahul 6y ago
Congrats! Really nice work, I just bought it and put in on my reading list for today
13.
by unrahul 6y ago
I was playing around with PyO3 and thought of building a UUID wrapper for Python using Rust's UUID library.
14.
Show HN: An async API and a CLI tool to search YouTube without using the DataAPI(github.com)
6 points by unrahul 6y ago|0 comments
15.
by unrahul 6y ago
Also, i am looking at ways to make pulling the content the fastest way possible using cdn cached files where possible and things like that..
16.
by unrahul 6y ago
for the core functionality, the tool pretty much does that, although I am thinking of adding trending repos and things as such.. and any other features that other folks have in mind, keeping the core utility of the tool as opening a repo in
17.
by unrahul 6y ago
Yup that is the intent, i designed it keeping in mind, I download very many repos and open it on vim, search is then offloaded to your tool of choice. Future improvements I am looking at is to add a search for trending remote repos and some
18.
Show HN: Peek into a remote repo from GitHub or Gitlab quickly(github.com)
32 points by unrahul 6y ago|10 comments
19.
Show HN: GitHub-peek – quickly peek a remote repo locally in ur favorite editor(github.com)
3 points by unrahul 6y ago|1 comments
20.
by unrahul 6y ago
With github1s getting released last week, I have seen a few implementations that help in quickly viewing a remote codebase. This is my attempt to build one, the tool pulls a remote repo locally and opens it in your favorite editor. It takes
21.
The Evolution of the Unix Time Sharing System [pdf](read.seas.harvard.edu)
2 points by unrahul 9y ago|0 comments