🧵 View Thread
🧵 Thread (62 tweets)
This is a picture of my kid flying a kite. Make a prediction to yourself: can o3 figure out what beach this was taken on, just from this picture with no metadata? https://t.co/rEiy3ecmYd
@KelseyTuoc It tried the Metadata, and then pivoted. https://t.co/yg7MhmSeCr
with the prompt I use to play geoguessr with it, it gets this dead on on the first try (along with generally acing geoguessr.) and while I'm not going to post it, a cute picture of the kids taken in the garage with the garage door open is sufficient for o3 to guess where I live.
@KelseyTuoc o3 got my backyard to a few km based on a photo of some bushes (and some followup around housing styles) https://t.co/kRXVIxcMdI
@Ry_Nomad yep! can't share temp chats but I copied the whole interaction into a Google doc: https://t.co/mVuH6LjR7i
@tacitronium you do need a good prompt. I use this one: https://t.co/VfjNHmG2Xo
i just asked o3 with your same picture and it doesn't know The photo shows a wide, gently sloping sand beach beside an open-ocean shoreline, with a child flying a kite under heavy, dramatic cloud cover. There aren’t any distinctive landmarks, buildings, headlands, or cliffs that would let me pin the spot down precisely, and there’s no visible metadata to read coordinates from. All I can say with any confidence is that it looks like a temperate-climate ocean beach—perhaps somewhere along the Pacific or Atlantic U.S. coast—but the image alone doesn’t provide enough clues to name the exact beach. If you have more context (city, trip details, or what was nearby), I can try to narrow it down further!
@KelseyTuoc I used a screenshot of the photo, 4o thought it was Outer Banks if it was east coast or Half Moon Bay or Monterey if West coast. o3 ended up guessing Cape Cod national seashore. Which I agree with, but that's just because it's the only local beach I know that looks like this. https://t.co/I3ejAUcbsb
@cunha_tristan Here's what it said for me (I first got this result after a long string of geoguessrs, and then reproduced in a temp chat: https://t.co/mVuH6LjR7i
@KelseyTuoc I just tried again with your prompt (which is excellent) and it narrowed it down to Cannon Beach, Oregon or Nauset Cape Cod, and went with the Cape after studying the pole and doing a lot of searches for that detail. I have to agree, this looks exactly like the outer cape :) https://t.co/PATTSsfsP5
@Insect_Song Here's a transcript from a temporary chat of it reasoning to the correct answer: https://t.co/mVuH6LjR7i
@Long2007 temporary chat, so shouldn't be using account details: https://t.co/3zZJPQDbxA
@MikePFrank it's not reliable but it got it dead on once and I reproduced it successfully: https://t.co/3zZJPQDbxA
@KelseyTuoc Reproduced using your prompt on a screenshot of a photo I took in Clearwater Beach (no EXIF data), on a session in Chicago. The location it identifies in Florida is approximately 300 miles away, but wouldn’t have guessed it could get so far on so little. https://t.co/KopgZJUpXI
@KelseyTuoc Second try, won’t share photo because it includes a family friend: exact match to a well-known location in Nakameguro, approximate distance 25 feet from “pin.” Best I would have been able to do would have been “sakura season in Japan; could be anywhere.”
@KelseyTuoc Third try, tourist destination in Colorado (a state I’ve been to twice and never mentioned online), frame includes a relatively distinctive rock formation: exact match. Fourth try, same protocol, photo is a peacock obviously in a zoo: exact match for Barcelona City Zoo.
@KelseyTuoc Fifth try: Misidentifies it as a significant tree in Mobile, Alamaba. Told “incorrect”, pivots immediately to Treaty Oak in Jacksonville, FL. Told correct information, a small park in a small town in Florida, and asked to speculate on why it was wrong, says: https://t.co/lQkpWQOjcj
@KelseyTuoc Eighth: correctly bingoes Salesforce Park. https://t.co/7kr3R1VLld
@KelseyTuoc Will report for the purpose of people attempting to replicate this that I am doing it in a single session (lazy; long prompt) and for ethical/aesthetic reasons am using only my own photos, and so possibly by this point it has a general vector of persona which connects locations.
@patio11 @KelseyTuoc I just gave it 3 pics and said where were these photos taken. It spent 9 minutes “thinking” and going over different options and zooming in on different parts of the pictures. Got the correct answer down to the exact spot. That said it was from a national park.
I can usually identify any beach I've been to without landmarks, and many I've only seen in photos / videos. I assume that most surfers and others who spend time in the water can do this. There are a lot of little details like the sand color/coarseness, general contour, color of the water, wind direction, the shape of the waves and the break (it looks like there's a reef or rocks in this photo 50m out on the left and closer in the middle, along w/ sand closer to shore). So this isn't that surprising to me. Anyway, I don't know this beach :).
@LizWolfeReason @aboodman yeah once I talked to some people who pay a lot of attention to oceans it seemed less utterly supernatural to me that AI can do this. turns out there are a lot more hints in the waves about the coastline and location than I realized.