6 ms·

Pelican riding a bicycle: https://pasteboard.co/CjJ7Xxftljzp.png https://pasteboard.co/CjJ7Xxftljzp.png

mohsen1 10mo ago
Some time I think I should spend $50 on Upwork to get a real human artist to do it first to know what is that we're going for. What a good pelican riding a bicycle SVG is actually looking like?
- AstroBen 10mo ago
  IMO it's not about art, but a completely different path than all these images are going down. The pelican needs tools to ride the bike, or a modified bike. Maybe a recumbent?
robterrell 10mo ago
At this point I'm surprised they haven't been training on thousands of professionally-created SVGs of pelicans on bicycles.
- notatoad 10mo ago
  i think anything that makes it clear they've done that would be a lot worse PR than failing the pelican test would ever be.
  - imiric 10mo ago
    It would be next to impossible for anyone without insider knowledge to prove that to be the case. Secondly, benchmarks are public data, and these models are trained on such large amounts of it that it would be impractical to ensure that some benchmark data is not part of the training set. And even if it's not, it would be safe to assume that engineers building these models would test their performance on all kinds of benchmarks, and tweak them accordingly. This happens all the time in other industries as well. So the pelican riding a bicycle test is interesting, but it's not a performance indicator at this point.
arresin 10mo ago
It’s a good pelican. Not great but good.
- cubefox 10mo ago
  The blue lines indicating wind really sell it.
xnx 10mo ago
2D SVG is old news. Next frontier is animated 3D. One shot shows there's still progress to be made: https://aistudio.google.com/apps/drive/1XA4HdqQK5ixqi1jD9uMgmGUoxBeu8fFX?showPreview=true&showAssistant=true https://aistudio.google.com/apps/drive/1XA4HdqQK5ixqi1jD9uMg...
- knownjorbist 10mo ago
  Did you notice that this embedded a Gemini API connection within the app itself? Or am I not understanding what that is?
  - xnx 10mo ago
    I hadn't! It looks like that is there to power the text box at the bottom of the app that allows for AI-powered changes to the scene.
- Alex-Programs 10mo ago
  Incredible. Thanks for sharing.
- agnosticmantis 10mo ago
  This says Gemini 2.5 though.
  - xnx 10mo ago
    Good observation. The app was created with Gemini 3 Pro Preview, but the app calls out to Gemini 2.5 if you use the embedded prompt box.
- nick32661123 10mo ago
  Great improvement by only adding one feedback prompt: Change the rotation axis of the wheels by 90 degrees in the horizontal plane. Same for the legs and arms https://aistudio.google.com/app/prompts?state=%7B%22ids%22:%5B%221LqaF4gknC3yji4uI7uWTjjAo7liZEZ-p%22%5D,%22action%22:%22open%22,%22userId%22:%22115978321886005652329%22,%22resourceKeys%22:%7B%7D%7D&usp=sharing https://aistudio.google.com/app/prompts?state=%7B%22ids%22:%...

Some time I think I should spend $50 on Upwork to get a real human artist to do it first to know what is that we're going for. What a good pelican riding a bicycle SVG is actually looking like?

AstroBen 10mo ago
IMO it's not about art, but a completely different path than all these images are going down. The pelican needs tools to ride the bike, or a modified bike. Maybe a recumbent?

robterrell 10mo ago

At this point I'm surprised they haven't been training on thousands of professionally-created SVGs of pelicans on bicycles.

notatoad 10mo ago
i think anything that makes it clear they've done that would be a lot worse PR than failing the pelican test would ever be.
- imiric 10mo ago
  It would be next to impossible for anyone without insider knowledge to prove that to be the case. Secondly, benchmarks are public data, and these models are trained on such large amounts of it that it would be impractical to ensure that some benchmark data is not part of the training set. And even if it's not, it would be safe to assume that engineers building these models would test their performance on all kinds of benchmarks, and tweak them accordingly. This happens all the time in other industries as well. So the pelican riding a bicycle test is interesting, but it's not a performance indicator at this point.

arresin 10mo ago

It’s a good pelican. Not great but good.

cubefox 10mo ago
The blue lines indicating wind really sell it.

xnx 10mo ago

2D SVG is old news. Next frontier is animated 3D. One shot shows there's still progress to be made: https://aistudio.google.com/apps/drive/1XA4HdqQK5ixqi1jD9uMgmGUoxBeu8fFX?showPreview=true&showAssistant=true https://aistudio.google.com/apps/drive/1XA4HdqQK5ixqi1jD9uMg...

knownjorbist 10mo ago
Did you notice that this embedded a Gemini API connection within the app itself? Or am I not understanding what that is?
- xnx 10mo ago
  I hadn't! It looks like that is there to power the text box at the bottom of the app that allows for AI-powered changes to the scene.
Alex-Programs 10mo ago
Incredible. Thanks for sharing.
agnosticmantis 10mo ago
This says Gemini 2.5 though.
- xnx 10mo ago
  Good observation. The app was created with Gemini 3 Pro Preview, but the app calls out to Gemini 2.5 if you use the embedded prompt box.
nick32661123 10mo ago
Great improvement by only adding one feedback prompt: Change the rotation axis of the wheels by 90 degrees in the horizontal plane. Same for the legs and arms https://aistudio.google.com/app/prompts?state=%7B%22ids%22:%5B%221LqaF4gknC3yji4uI7uWTjjAo7liZEZ-p%22%5D,%22action%22:%22open%22,%22userId%22:%22115978321886005652329%22,%22resourceKeys%22:%7B%7D%7D&usp=sharing https://aistudio.google.com/app/prompts?state=%7B%22ids%22:%...