vkkhare

5 ms·

1.
by vkkhare 1y ago
updated the link
2.
Show HN: Run 30B model in 4GB Active Memory(github.com)
4 points by vkkhare 1y ago|2 comments
3.
by vkkhare 1y ago
Isn't the inference cost of running these models at scale challenging? Currently it feels like small LLMs (1B-4B) are able to perform well for simpler agentic workfows. There are definitely some constraints but surely much easier than
4.
by vkkhare 1y ago
We will be open sourcing the entire platform soon. This blog shows our platform to build the AI app https://www.nimbleedge.com/blog/how-to-run-kokoro-tts-model-...
5.
Ask HN: Can On-device AI solve projected energy crisis?
1 points by vkkhare 1y ago|3 comments
6.
by vkkhare 1y ago
We have just started open sourcing the on-device AI platform. We have started with the github repo for custom Kokoro TTS model. It is basically a batch implementation for Kokoro while supporting streaming. https://github.com&#x2F
7.
NimbleEdge AI App - First offline voice AI by running Python on-device(nimbleedge.com)
20 points by vkkhare 1y ago|6 comments
8.
by vkkhare 5y ago
maybe try local p2p networking and compute offloading? Check out https://nimbleedge.ai for a cool demo This is our repository https://github.com/NimbleEdge/RecoEdge
9.
by vkkhare 5y ago
I would love to talk more about it and understand your take. Is there a way I can reach out to you? I have been reading the content in web 3 and form my own opinion on the merits/demerits.
10.
by vkkhare 5y ago
What do people think of automatic differentiation support facebook was trying for Kotlin. They called it differentiable programming https://ai.facebook.com/blog/paving-the-way-for-software-20-...
11.
What will Machine Learning look like in future?
3 points by vkkhare 5y ago|0 comments
12.
by vkkhare 5y ago
I was thinking along ML. How analytics and ML happens on user data which is stored on data silos. For example, twitter has data about all our posts and interactions and uses that data to build recommendation models which it monetizes as to
13.
by vkkhare 5y ago
I believe edge computing is one of the game changing technologies for the decade. I am not sure if it can fall under the purview of Web 3 or not. For example one of the library I implemented was along training ML models on user devices inst
14.
by vkkhare 5y ago
you can find many such people in our discord server https://nimbleedge.ai/discord We all care about how our data is used and processed.
15.
by vkkhare 5y ago
That's why not giving them ability to copy data, allow them to use that data only on your device and send aggregated information back. So they cannot copy the data
16.
by vkkhare 5y ago
That's what I am worried about, from its description the intent looks good but being aligned to only one industry or vertical defeats the purpose of ubiquity. People wouldn't trust it if they all just see is a volatile currency
17.
by vkkhare 5y ago
I do care if that data gets leaked or if that data is used by third party companies for things I have bought and I do not want them to know. Why should a bank do my credit scoring based on my what am watching on Amazon or what books am I re
18.
by vkkhare 5y ago
Marc is reading this ;p
19.
by vkkhare 5y ago
This is a very cool description! Hits to the point
20.
by vkkhare 5y ago
Exactly if that is the case, it should also include technologies where data ownership lies with the users. After all data itself is a huge resource. One of the biggest reasons corporates could monopolise the platform because as users we onl
21.
by vkkhare 5y ago
Web 2 as a term itself was coined much later when people needed to distinguish web 3 from status quo
22.
Ask HN: Is Web 3.0 just crypto or something more?
30 points by vkkhare 5y ago|89 comments
23.
by vkkhare 5y ago
Edge computing for machine learning. Instead of running ML models on the cloud, I train them on user's device, ask these devices to offload computation between each other and give me the best performance out there. One good example is
24.
by vkkhare 5y ago
Makes sense though I wonder what would be the original source of that data (someone like google/microsoft must be logging user data and then making some parts of it anonymized and public). Maybe also look into on-device learning, it ca
25.
by vkkhare 5y ago
How do you train newer models then? From what I read you use public datasets to train your models but what about in future? You would need some kind of data collection mechanism? Gpt-2 and gpt-3 are great but the datasets they are trained w