7 ms·
OpenAI – transformer debugger release
- CityOfThrowaway 3y agoThis is pretty cool. I find it intriguing that we're neural surgery on LLMs!
- seanieb 3y agoCan’t help but think Elons lawsuit will trigger more releases by OpenAI. His core arguments are BS, but raised legitimate questions about their non-profit status and lack of non-profit related activity.
- gurgunday 3y agoWhy do you think they are BS? You say it raised legitimate questions about their non-profit status and lack of non-profit related activity.
- rvz 3y ago> Why do you think they are BS? Because me and everyone else here really hates Elon Musk. > You say it raised legitimate questions about their non-profit status and lack of non-profit related activity. As soon as OpenAI accepted that investment from Microsoft it has only been used as a for-profit proxy to have their own ‘DeepMind’ to bring down Google which they have tried for years with Bing and the Scroogled campaigns. OpenAI is now no better than Google DeepMind and both are as closed and secretive and OpenAI ditched from their charter and non-profit status and continues to make excuses for not giving back their research.
- marknutter 3y ago> Because me and everyone else here really hates Elon Musk. Speak for yourself.
- rvz 3y agoHow exactly?
- myko 3y agoI think some believe Elon's argument is BS because Elon claims to be upset about OpenAI charging for their work. However, internal communications/texts show he wanted to do the same thing. So it seems like sour grapes that he isn't the one in charge.
- ramblerman 3y agoAn argument isn’t good or bad because of the motivations of the person behind it. I get Elon is not popular right now. But jeez this is playground emotional level logic.
- _diyar 3y agoI detailed my understanding of this case in a sibling-comment to this one, but I think the fact that he wanted to "do the same thing" (read: use the for-profit engine to fund AI research) only makes his case stronger! If I understand correctly, the OpenAI board asked Musk to remove himself and sell his stake as his for-profit pursuits conflicted with the mission of open, non-profit research. But after he left, they started a for-profit subsidiary and did exactly what they didn't want him doing. I could see how a judge might side with him.
- GreedClarifies 3y agoLet's be real. They think Elon's arguments are BS since he bought Twitter and he destroyed their Leftie safe space. They are also very upset with Elon's very public shift away from the current Left. It's Elon derangement syndrome.
- phatskat 3y agoElon’s shift to appeal to a more right-leaning base happened long before any of the OpenAI stuff.
- nonethewiser 3y ago> His core arguments are BS, but raised legitimate questions about their non-profit status and lack of non-profit related activity. These legitimate questions about their non-profit status ARE his core arguments. His complaints are the same as the popular notion on hackernews that OpenAI has failed to be open.
- refulgentis 3y agoErm, you get it, it's right in your comment: lawsuit about non-profit, HN about open weights.
- jhonof 3y agoThey are part of his core argument, but not the entire argument. The (imo) shakier part of the argument is that he is entitled to damages even though he doesn't own shares in the company. This is atypical, most of the time you lose that right once you get rid of your shares. It seems like he is arguing that he was misled and sold his shares because of that, which will be hard to prove if true, and even if it is true, isn't really illegal.
- _diyar 3y agoI believe at the time it was reported that Musk and the OpenAI board chose to part ways due to his for-profit AI research (in Tesla) posing a conflict of interest to the OpenAI mission. Hence his argument boils down to "You made me sell my shares because my 'closed' AI research conflicted with your 'open' non-profit ideals. However, you have since stoped to adhere to your mission statement, effectively seizing to publish your research findings and pursuing for-profit goals. As a consequence of this I have lost a bunch of money." And as nuts as Musk is, I kind of see his point here.
- jhonof 3y agoThat argument doesn't really hold a lot of water with me to be honest. If I sell (forced or otherwise) my shares in company because it isn't working on tech I agree with, and then they pivot and start working on tech I agree with and their shares pop, I am not entitled to sue them for damages.
- resource_waste 3y agoWhen I said this last year, people said "BUT THEY ARE DEMOCRAITIZING IT" Its good to see that I was always right, even last year. I just didn't have a dad who owned an emerald mine.
- simondotau 3y agoPeople seem to imagine that Errol Musk is dead and Elon got a big inheritance from his daddy's estate. In fact Errol is still very much alive, became bankrupt sometime in the 1990s, and is now a deadbeat living off financial support from his sons. Was there ever an emerald mine? Maybe. Though nobody has been able to find a scrap of evidence for it. Literally the only "evidence" is Errol's own boasts, which is that he bought a half-share of a Zambian mine for 100k ZAR ($50k USD). Hardly the stuff generational empires are made of.
- garyfirestorm 3y agoif you bought 50k USD worth of $AAPL in 1990, by conservative estimates they will be worth 560 million USD worth today. I'd argue, that's generational stuff right there.
- bitcurious 3y agoIf you bought the winning lottery ticket, you’d be a lottery winner.
- zingelshuher 3y agoIf grandmother had balls she would be a grandfather.
- simondotau 3y agoDid Errol Musk buy 50k worth of $AAPL in 1990?
- n2d4 3y agoThe Zambian mine is the emerald mine everyone is talking about. From Walter Isaacson's biography: > [Errol and a Zambian busienessman] agreed on a price [for Errol's plane], and instead of taking a payment in cash, Errol was given a portion of the emeralds produced at three small mines that the entrepreneur owned in Zambia. [...] > Errol, who never had an ownership stake in the mine, expanded his trade by importing raw emeralds and having them cut in Johannesburg. "Many people came to me with stolen parcels," he says. "On trips overseas I would sell emeralds to jewelers. It was a cloak-and-dagger thing, because none of it was legal." After producing profits of roughly $210,000, his emerald business collapsed in the 1980s when the Russians created an artificial emerald in the lab. He lost all of his emerald earnings. $210,000 in 1986 would be about $600,000 today.
- brucethemoose2 3y agoMy concern is that Elon has shut the door with a sloppy lawsuit. If some other entity (Government agency? Another company?) Comes around to pull this string, its going to set a bad precedent.
- furyofantares 3y ago> raised legitimate questions about their non-profit status and lack of non-profit related activity What is "non-profit related activity"? IANAL but the only justification needed for non-profit designation is not being for-profit. And maybe their structure with a for-profit subsidiary is up for debate because of this. But you don't get to be non-profit by doing "good stuff" like open sourcing things. You get it by investing all profits back into the business. Evil Corp for Doing Evil could be a non-profit if it invested all its profits back into the business.
- LordDragonfang 3y ago> What is "non-profit related activity"? What is "non-profit related activity"? IANAL but the only justification needed for non-profit designation is not being for-profit. Good thing you are NAL, because this is flat out wrong. "Non-profit" is a term used to refer to specific tax-exempt institutions under US tax law 501(c), and has nothing to do with investing profits "back into the business" (otherwise, you could have called Amazon or Uber "non-profits"). OpenAI[1] is specifically a 501(c)(3)[2] which explicitly requires the organization's purpose be one of the following "exempt" purposes: >charitable, religious, educational, scientific, literary, testing for public safety, fostering national or international amateur sports competition, and preventing cruelty to children or animals. [3] If it does not continue to fill one of those purposes, it can lose its tax-exempt nonprofit status. [1] https://projects.propublica.org/nonprofits/organizations/810861541/201943199349318399/full https://projects.propublica.org/nonprofits/organizations/810... [2] https://www.irs.gov/charities-non-profits/charitable-organizations/exemption-requirements-501c3-organizations https://www.irs.gov/charities-non-profits/charitable-organiz... [3] https://www.irs.gov/charities-non-profits/charitable-organizations/exempt-purposes-internal-revenue-code-section-501c3 https://www.irs.gov/charities-non-profits/charitable-organiz...
- furyofantares 3y ago> Good thing you are NAL I'm offended. Presumably if I was AL I would have gotten it right.
- jeanlucas 3y agoRemember, open source is just on the beginning and for recruiting purposes
- xcodevn 3y agoI must say, understanding how transformers work is arguably the most important research problem in history, assuming that AGI can be achieved by just scaling up current LLM models on text, video, audio, etc.
- kindking 3y agoThat is a very big assumption.
- ImHereToVote 3y agoWhich might turn out to be correct. Might be wrong also. We have no priors to AGI developing. Only NGI, and we know preciously little about how to achieve NGI too, except the bedroom way.
- joaogui1 3y agoIn vitro fertilization too!
- furyofantares 3y agoWe have a lot of priors - everything we've ever done has not produced AGI. Maybe scaling transformers is the best way forward. I'm hopeful. But it's a big assumption that it will produce AGI.
- kromem 3y agoIt really depends on the definition. "Better than the average human at most profitable tasks" is a much lower bar than most people on HN might think. I have vendors who instead of filling out a web form which remembers their inputs and eventually even fills everything out for them instead print it out and fax it back in. We're probably only about 2-3 years away from transformers being self-optimizing enough in prompts and evaluations to outpace the average worker in most tasks in most roles. (It won't necessarily be that much cheaper after the multiple passes and context windows required, and crucially probably won't be better at all tasks in most roles.) If you define AGI as "better than any human at profitable tasks" or "better than average at all tasks" then yes, we're a long ways off and transformers alone probably won't get us there.
- paulcjh 3y agoA very meagre attempt to look like they provide open source tools help the world safely make AGI
- abdellah123 3y ago[flagged]
- bilsbie 3y agoHow many transformers are in a typical LLM? Or is the whole thing considered a transformer?
- dfgtyu65r 3y agoNormally, the LLM is composed of multiple transformer blocks, where each block consists of the (mutli-head) attention and fully-connected feedforward components. These are then stacked on top of each other to give the final output of the network.
- jerpint 3y agoThe architecture as a whole is referred to as a transformer (autoregressive decoder-only architecture in the case of gpt style LLMs). Note that there can be other types of LLMs too that are not necessarily transformer based (SSM, RNN, etc)
- neverokay 3y ago[dead]
- nuz 3y agoYearly obligatory open source drop. What was it last time, whisper?
- whalesalad 3y agoInteresting to see the use of ruff and black in the same project. https://github.com/openai/transformer-debugger/blob/main/.pre-commit-config.yaml https://github.com/openai/transformer-debugger/blob/main/.pr...
- jolux 3y agoAnd isort, which Ruff also supports.
- throw310822 3y agoHmmm.. but what happens if you allow the LLM to access and query its own debugger? "Why did I answer this to that?" "What happens if I change slightly my assumptions"?