6 ms·
You can verify that your Bard instance is using Palm 2 by asking “are you using the palm or palm 2 model?”
by zdyn5 3y ago
You can verify that your Bard instance is using Palm 2 by asking “are you using the palm or palm 2 model?”
- xkapastel 3y agoI don't think you can do this, it will just make things up. Language models don't have this type of reflection. Google would need to indicate this out of band, like on the page itself, in order for you to be confident about what model you're using.
- entropicdrifter 3y agoAgreed. I'm not entirely sure that the person you're replying to is not joking
- chaxor 3y agoI'm pretty sure they're trying to suggest that LLMs in general are not useful because they can't do this type of thing. It's just the next iteration of goal post moving and should effectively be ignored. Many artists and such that I've spoken to about AI work have similar comments about these systems because of the disdain for their existence. The number of times I hear an argument like "well, they can never taste the tartness of a kiwi and feel the heat of the sun while at the beach" gets quite exhausting. For some reason, many people have this weird notion that this is what AGI means - exactly what humans do, and specifically within the same data domains of humans, but they don't consider working solely outside those domains as a possibility for AGI.
- fnordpiglet 3y agoJust wait as the multimodal LLM’s roll out! People will be shoving kiwis into their computer and taking their laptops out for a few rays before you know it.
- cdchn 3y agoI tried asking it "what is the difference between the palm language model and the bard language model?" and its reply started off "The main difference between the Palm language model and the Bard language model is the size of the dataset they are trained on. Palm is trained on a dataset of 400 billion parameters, while Bard is trained on a dataset of 540 billion parameters." Which to me is even more interesting that what the OP commenter asserted.
- knaik94 3y agoIt makes up those numbers, I asked about the difference between the small and large PaLM 2 data set size, and it asserted the small model was trained on 540 billion and the large model was trained on 540 trillion. A different draft instead specified 1.4 trillion for the large.
- cdchn 3y agoIt even gave me a table with a whole bunch of differences. All thats made up? Here is a table that summarizes the key differences between the two language models: Feature Palm Bard Number of parameters 400 billion 540 billion Vocabulary size 137 billion words 1.5 trillion words
- knaik94 3y agoI didn't mean to argue that everything generated is incorrect. But in my experience, the numbers it generates seem closer to random guesses. If you ask it enough times, it sometimes converges on a number, but I don't think that means it's an accurate value. I was able to make it generate a similar table for the different PaLM 2 sizes, and laMDA, and it listed, PaLM 2 Gecko 137 billion, PaLM 2 Otter 540 billion, PaLM 2 Bison 1.8 trillion, PaLM 2 Unicorn 5.4 trillion, LaMDA 137 billion. For Unicorn, it also lists "Still under development." Edit: Playing around with it more and it listed WuDao 2.0 1.75 Trillion, Chinchilla 175B, Codex 175B, Dalle2 1.3B, GPT4 1.75T, GPT3.5 540B, GPT3 175B, GPT2 1.37B, GPT 1.3B. But in the previous question it listed GPT4 540 billion and Codex 5.4 trillion among other contradictions.
- deleted 3y ago[deleted]
- sunshadow 3y agoI've asked "are you using palm 3": It said: I am using the Palm 3 model. Palm 3 is a large language model... Don't believe it :) Also, In the technical report, It mentions multiple languages, I've asked in Turkish which was supposed to be supported, but wasn't able to answer. Even if its PaLM 2, its hard to trust to the model itself.
- cdchn 3y agoI asked it "are you using the palm 420 language model or the palm 2 language model?" It said "I am not using either the Palm 420 language model or the Palm 2 language model. I am using a different language model called Bard, which is a large language model from Google AI." Perhaps the people at Google saw this and made a manual correction? Hard to say, black boxes and all...
- astrange 3y agoIt doesn't have the capability to be corrected that easily. It's just lying. Bard is very bad about this, it lies with the slightest encouragement. Try "compare and contrast captain planet and paptain clanet".