11 ms·
Will QC make LLMs faster/better?
by iamkrazy 4mo ago
Will QC make LLMs faster/better?
- mrits 4mo agoThe answer is Yes and No
- stingraycharles 4mo agoDepending on whether you’re measuring the model’s position or direction?
- mrits 4mo agoI thought it would have gone over a lot better here
- subroutine 4mo agoUntil you look; then it collapses to one or the other.
- meindnoch 4mo ago0% chance.
- subroutine 4mo agoIn theory, quantum computers could provide dramatic speedups for certain linear algebra operations (eg. matrix inversion, eigenvalue estimation). The catch is that many NN training algorithms need all the data to be stored in qRAM so the QC can access matrices efficiently. Loading in a massive dataset will likely be more difficult than the computations, eliminating the quantum advantage. This is analogous to having an extraordinarily fast processor attached to a slow af hard drive inside a neutrino storm.