Human Generated Data

Title

In the Near Future, New York

Date

2005

People

Artist: Sharon Hayes, American born 1970

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Human Generated Data

Title

In the Near Future, New York

People

Artist: Sharon Hayes, American born 1970

Date

2005

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Machine Generated Data

Tags

Amazon
created on 2019-11-18

Human 99.8
Person 99.8
Person 99.8
Automobile 99.7
Transportation 99.7
Vehicle 99.7
Car 99.7
Person 99.7
Person 99.2
Person 99.2
Person 98.7
Pedestrian 98.4
Person 97.1
Person 95.4
Person 93.5
Police 91.5
Military Uniform 90.1
Officer 90.1
Military 90.1
Tarmac 87.7
Asphalt 87.7
Road 84.6
Crowd 83.4
Shoe 75.6
Apparel 75.6
Clothing 75.6
Footwear 75.6
Urban 71
Machine 68.2
Wheel 68.2
Text 64.2
People 63.2
Person 60.4
City 59.4
Town 59.4
Building 59.4
Metropolis 58
Banner 56.2
Shoe 54.9
Person 47.1

Clarifai
created on 2019-11-18

street 99.6
police 99.1
road 98.1
city 97.1
people 96.8
offense 96.3
battle 94.8
drag race 93.6
action 92
law enforcement 89.8
man 86.7
group 85.4
interaction 84
many 83.9
traffic 83.5
bomb 83.4
crowd 83.3
crisis 81.3
pavement 80.9
bus 80.7

Imagga
created on 2019-11-18

pedestrian 100
street 44.2
city 42.4
people 29.6
road 24.4
building 23
urban 22.7
man 20.8
architecture 18
travel 17.6
person 17
car 15.8
town 15.8
men 15.4
buildings 15.1
male 14.9
tourist 14.1
walking 13.3
adult 12.9
outdoor 12.2
cars 11.7
spectator 11.7
tourism 11.5
traffic 11.4
business 10.9
outdoors 10.9
sidewalk 10.9
life 10.6
crowd 10.6
walk 10.5
old 10.4
vehicle 10.4
cityscape 10.4
sport 9.6
women 9.5
window 9.2
helmet 8.7
tree 8.5
modern 8.4
house 8.4
safety 8.3
transportation 8.1
group 8.1
lifestyle 7.9
tourists 7.8
clothing 7.8
scene 7.8
outside 7.7
center 7.6
bag 7.5
church 7.4
shopping 7.3
uniform 7.3
job 7.1
day 7.1
work 7.1

Google
created on 2019-11-18

Street 87.5
Yellow 86.5
Metropolitan area 85
Urban area 84.7
Pedestrian 81.9
Vehicle 76.1
City 74.4
Car 72
Night 69.5
Road 65.4
Photography 62.4
Downtown 61
Metropolis 60.3
Crowd 57.8
Police 55.7
Official 54.9
City car 50.6

Microsoft
created on 2019-11-18

building 99.5
person 99.4
outdoor 99.4
clothing 97.3
street 96.7
man 88.6
firefighter 86.9
text 86.2
city 77.9
way 72.8
police 72.7
sidewalk 67.5
people 63.4
high-visibility clothing 52.3
busy 43

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Female, 54.9%
Disgusted 45%
Fear 45%
Calm 54.8%
Surprised 45%
Angry 45.1%
Confused 45%
Happy 45%
Sad 45.1%

Feature analysis

Amazon

Person
Car
Shoe
Wheel
Person 99.8%

Categories

Captions

OpenAI GPT

Created by gpt-4 on 2024-02-07

The image shows a busy urban street scene with pedestrians and vehicles. In the foreground, two individuals are dressed in black uniforms with reflective safety vests, suggesting they could be members of a security or traffic management team. One of them is holding a sign that reads "WE ARE INNOCENT" in bold uppercase letters. Behind them, the bustling street is apparent with various buildings, signs for businesses such as "Bubba Gump Shrimp Co." and "Roxy Delicatessen," and traffic lights. The presence of a black car at the edge of the image suggests active road traffic. The scene is illuminated by what appears to be natural sunlight, casting strong shadows on the ground and giving an impression of a clear day.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-30

The image shows a street scene in what appears to be an urban setting. In the foreground, there are several individuals wearing police uniforms and safety vests, standing together. One of them is holding a sign that reads "WE ARE INNOCENT". In the background, there are various buildings, traffic lights, and pedestrians on the sidewalk, suggesting an active city environment. The overall mood of the image seems to depict a scene related to some form of protest or demonstration taking place on the street.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

The image depicts a city street scene with three men in the foreground, two of whom are wearing yellow safety vests and black hats. The man on the left is dressed in a purple shirt and black pants, while the other two men wear white shirts and black pants. A sign held by one of the men reads "WE ARE INNOCENT" in black letters on a white background. In the background, several people are walking along the sidewalk, and a few cars can be seen driving down the street. The overall atmosphere suggests a daytime setting, possibly during rush hour or a busy afternoon. The presence of the sign and the men's attire implies that they may be participating in a protest or demonstration, although the exact nature of their message is unclear.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-02

The image depicts a scene of two police officers standing on a city street, with a sign held by a man in the background that reads "WE ARE INNOCENT." The officers are wearing white shirts and yellow vests with black pants and hats. They are facing each other, engaged in conversation. In the foreground, a man is holding a sign that reads "WE ARE INNOCENT" in large letters. He is wearing a gray shirt and black pants. To the right of the officers, there is a black car parked on the side of the road. The background of the image shows a busy city street with several buildings and people walking around. There are also several signs and advertisements visible, including one for a restaurant and another for a store. Overall, the image appears to be a protest or demonstration, with the man holding the sign and the police officers present. The atmosphere seems tense, but the officers do not appear to be taking any action against the protesters.

Text analysis

Amazon

ARE
WE ARE
WE
Co.
RIMP
RIMP Co. COMPUTE FERAS
COMPUTE
RO
INNACENT
BL
FERAS

Google

GUM RO WE ARE INNOCENT 8AG TAURANT HS RIMP CO.CoMPHT ERA BL
RO
WE
ARE
INNOCENT
8AG
TAURANT
HS
CO.CoMPHT
BL
GUM
RIMP
ERA