acd

13 ms·

1.
Glq a port trellis quantization of large language models as a vLLM plugin(github.com)
2 points by acd 6d ago|1 comments
2.
by acd 6d ago
glq is a re implementation gpl port of QTIP Trellis encoding of large language models as vLLM plugin. glq is efficient between 2-4 bits per word where it has an edge over scalar quantization. Fit larger LLMs on consumer hardware GPUs. glq e
3.
by acd 6d ago
What is the alternative to subscribing to streaming services? Can you purchase your movies online and be guaranteed to have access to the movies in the future?
4.
by acd 7d ago
You want a replaceable battery because once the battery wears out if the repair is expensive people will throw the used air buds. Used airbuds creates electronic waste ewaste on landfills. Not all electronic recycling ä works well some non
5.
by acd 7d ago
Explore Pixel Grapheneos Lineageos or Fairphone Unlocked boot loader in pixel to load third party operating system. PinePhone for Linux Ubuntu touch
6.
by acd 7d ago
Sennheiser Momentum 5 has user replacable battery which is better for the environment https://www.ifixit.com/Device/Sennheiser_Momentum_5
7.
by acd 9d ago
Can we please agree on calling devices with a cpu and os that spy on the owner smart? I personally think that closed operating systems with spyware is quite dumb for user privacy.
8.
by acd 10d ago
This is the same behaviour as the german secret police in east germany. The difference now its for ads and by tech. All collected data are probably ai transcribed from audio to text and is fused via data fusion to serve ads. Add collaborati
9.
by acd 18d ago
People should know more about data fusion. How browser javascript fingerprints and unique personal id of the adtech works. Hint it traveres VPNs. The seven has an id of you Check your id https://amiunique.org/ https:/
10.
by acd 20d ago
There is us fair competition law Sherman anti trust act laws. "is a United States antitrust law which prescribes the rule of free competition among those engaged in commerce and consequently prohibits unfair monopolies" https:&#x
11.
by acd 29d ago
No it should not it would be better if it saves norweigan retirement funds for the future.
12.
by acd 29d ago
I have written a llm compression quantization library called glq because of the high ram prices. Glq uses qtip Trellis quantization which are efficient at low bpw 2-4 bits. As a gamer and ai developer I want to squeeze more out of the same
13.
by acd 2mo ago
Why analog monitors is better. Harder to install spyware. So called by the industry "Smart devices" are dumb for privacy reasons.
14.
by acd 2mo ago
Used GPU hosting for pension funds. You go to ebay search for a used GPU. You get a price. Neither is used servers a new thing or used routers. There are established used server companies. https://en.wikipedia.org/wiki/
15.
by acd 2mo ago
This benchmark is probably also self promotion of services. Fireworks happens to make a router. Using the router gets better performance. https://docs.fireworks.ai/deployments/routers
16.
by acd 2mo ago
Use Picode as an alternative to Opencode
17.
by acd 2mo ago
I dont agree for environments sake it should be user replaceable batteries even in small electronic devices. Hearing aids has user replaceable batteries
18.
by acd 2mo ago
Isnt there an issue with "Buy" and different countries marketing laws? Ie it implies "Hold" or "TemporaryKeep". Guess it will be an upswing of BlueRay movies. Already happening with LPs and CDs
19.
by acd 3mo ago
Code that is written will have to maintained often by someone else than who wrote the code. So if one write code nobody else understands its an eventual maintenence failure. You could optimize for different things. Code understandability by
20.
Show HN: Glq LLM quantization using E8 lattice(github.com)
2 points by acd 4mo ago|0 comments
21.
by acd 4mo ago
Big corp penny slap on the fingers. I dont this amount will change behaviour or incentive to make larger profit.
22.
by acd 4mo ago
Actually with data fusion VPN does not fix privacy. Ad networks does data fusion of Javascript browser finger print. So you are de cloaked any way on a VPN
23.
by acd 4mo ago
Use Winpodx and run Windows apps as a container in Linux https://github.com/kernalix7/winpodx
24.
by acd 4mo ago
But as soon as what happens is an unusual event that is not in training data it get dangerous. Think of any abnormal weather events that would make news headlines such as Lightning, blizzard, snow storms etc This need to be simulated Or th
25.
by acd 5mo ago
Sounds useful for display purposes
26.
by acd 6mo ago
How does it compare to drbd? "Distributed Replicated Block Device (DRBD)[3] is a distributed replicated storage system for the Linux platform. It mirrors block devices between multiple hosts" Which I think may be technology used b
27.
by acd 6mo ago
Go Linux. Gamers will have a better experiance in Linux. Predict that Windows will become an legacy emulation layer.
28.
by acd 6mo ago
The problem is when people wear "smart" aka dumb privacy glasses in public restrooms. Should be banned or geofenced
29.
by acd 6mo ago
Will wired speakers make a come back? Stereo separation vs mono pods?
30.
by acd 6mo ago
Claude code once said verb it was "Slithering" I then changed the verb.

More ›