6 ms·
Did you look at the results? All models that were tested failed significantly (10%+) to acheive the passing range.
by fullstackchris 4y ago
Did you look at the results? All models that were tested failed significantly (10%+) to acheive the passing range.
- impossiblefork 4y ago10% is actually small though, also, the latest program tested is GPT3. GPT3.5 was what really impressed people and was the point when people saw that these models could be capable.
- espadrine 4y ago> also, the latest program tested is GPT3. GPT3.5 was what really impressed people The latest program shown in this chart[0] is text-davinci-003, which is part of GPT-3.5[1]. [0]: https://github.com/mjbommar/gpt-takes-the-bar-exam#progression-of-models-over-time https://github.com/mjbommar/gpt-takes-the-bar-exam#progressi... [1]: https://beta.openai.com/docs/model-index-for-researchers/models-referred-to-as-gpt-3-5 https://beta.openai.com/docs/model-index-for-researchers/mod...
- impossiblefork 4y agoAh, I it seems I can't read. I still believe these models have potential for major improvements-- they'll probably still be unreasonable, but perhaps they'll be reasonable enough that people will have to make harder bar exams.
- PartiallyTyped 4y agoProject to the next 10 years given the trends.
- fullstackchris 4y agoSo I'm going to put a laptop on the stand when I go to trial? Give me a break.
- PartiallyTyped 4y agoNowhere near what I said. Companies have hordes of lawyers scouring through contracts, e.g. think associates and paralegals (which are not technically lawyers). Expect that a non trivial portion will get axed.
- blitzar 4y agoOne day in the future we will look back at the multi volume contracts (and legislation) we were having written to satisfy our delicate egos and laugh at our past self.
- notahacker 4y agoWell law firms can either axe them or use the fact associates and paralegals are able to do final checks on hundreds of pages rather than first pass looks at dozens of pages to generate a lot more work for itself. The idea that the amount of work to do is fixed has been predicting mass unemployment since the beginning of the Industrial Revolution
- deleted 4y ago[deleted]
- aflag 4y agoIf it could build a case better than a human, you would. But currently it's nowhere close to that
- spiderfarmer 4y agoI'd still trust a lawyer that used ten different laptops better than just one laptop.
- aflag 4y agoWould you trust more an intern consulting 10 lawyers about your case instead of any single lawyer? Assuming a world where AI has surprassed human ability to make a case, having a human component would just make it worse.
- spiderfarmer 4y agoLike with Full Self Driving, the low hanging fruit has been picked and now we'll see that it takes considerably longer than thought to level up.
- mrjin 4y agoFSD was lie. This isn't any better.
- xtracto 4y agoThis is important and relevant. I was into AI already in the late 1990s when symbolic AI was all the rage, and we had just passed the first AU winter. Technology like "Creatures" was again amazing people , NN also sparked new interest, but things did not progress as much as we had hoped in the last 30 years. GPT is great, as they say, it's a great bullshit generator. It's the right direction , but it's just that.
- PartiallyTyped 4y agoWhich is why I pointed 10 years ahead, and not next 3 or 5 years. I have made similar comments before regarding low hanging fruits, and GANs, and then diffusion became a thing.
- hoseja 4y agoxkcd://605/
- meindnoch 4y agoThe beginning of an exponential curve looks the same as the beginning of an S-curve.
- PartiallyTyped 4y agoI don't disagree, but the progress we saw in relatively little time, suggests that even if we are in an S-Curve, and I believe that we are unless there's a new paradigm change, 10 years is enough to capture the last 10%, no?