Human Generated Data

Title

In the Near Future, New York

Date

2005

People

Artist: Sharon Hayes, American born 1970

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Human Generated Data

Title

In the Near Future, New York

People

Artist: Sharon Hayes, American born 1970

Date

2005

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Pedestrian 99.8
Human 99.8
Person 99.7
Person 99.7
Person 99.7
Pants 99.7
Apparel 99.7
Clothing 99.7
Person 99.5
Denim 99.1
Jeans 99.1
Person 98.1
Transportation 97.3
Vehicle 97.3
Car 97.3
Automobile 97.3
Person 96.2
Footwear 95.8
Shoe 95.8
Person 93.5
Shoe 90.2
Person 90.2
Shoe 89.6
Shoe 88.7
Coat 85
Jacket 85
Person 84
Shoe 81.3
Shoe 80.1
Town 76
City 76
Urban 76
Building 76
Street 75.6
Road 75.6
People 71.6
Downtown 67.1
Path 65.1
Overcoat 62.7
Crowd 61.6

Clarifai
created on 2019-11-16

street 99.3
city 98.7
people 98.6
road 98.2
police 97.4
offense 94.4
drag race 94.4
adult 94.3
group 92.7
urban 92.6
pavement 91.6
school 91.3
university 91.3
woman 91.2
education 90.4
battle 90.2
administration 89.8
man 89.7
rebellion 89.6
action 87.7

Imagga
created on 2019-11-16

tourist 40.3
city 35.8
sidewalk 35.4
street 35
person 31.9
traveler 28.3
people 27.4
skate 26.4
man 24.9
urban 23.6
architecture 18.9
walking 18
snow 17.8
male 17.2
outdoor 16.8
walk 16.2
town 15.8
pedestrian 15
adult 14.9
travel 14.8
building 14.5
winter 14.5
road 13.6
outdoors 12.1
men 12
portrait 11.7
tree 11.6
cold 11.2
women 11.1
lifestyle 10.8
park 10.7
group 10.5
outside 10.3
active 9.9
couple 9.6
boy 9.6
scene 9.5
buildings 9.5
day 9.4
happy 9.4
mother 9.4
weather 9
together 8.8
casual 8.5
leisure 8.3
sky 8.3
fun 8.2
trees 8
life 7.9
autumn 7.9
business 7.9
season 7.8
crowd 7.7
old 7.7
center 7.6
fashion 7.5
monument 7.5
tourism 7.4
action 7.4
shopping 7.3
cheerful 7.3
girls 7.3
children 7.3
child 7.2
face 7.1
private 7.1

Google
created on 2019-11-16

People 94.8
Pedestrian 90.8
Public space 85.4
Urban area 80.3
Walking 79.1
City 78.1
Tree 77.8
Street 75.3
Architecture 72.6
Crowd 71.5
Event 69.4
Metropolitan area 69.1
Tourism 60.9
Plant 58.5
Leisure 56.2
Downtown 53.9
Building 53.4
Sidewalk 52.6
Protest 52.1

Microsoft
created on 2019-11-16

clothing 99
jeans 98.5
outdoor 97.8
footwear 97.8
road 96.3
person 96.1
jacket 92.9
man 90.3
trousers 89.3
city 85.9
street 82.3
people 74.8
sidewalk 65.8
woman 61.3
coat 59.3
tree 56.1
way 51.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 13-25
Gender Male, 54.6%
Surprised 45%
Sad 45.2%
Fear 45%
Angry 45%
Happy 45%
Disgusted 45%
Confused 45%
Calm 54.8%

AWS Rekognition

Age 26-40
Gender Female, 50.4%
Happy 49.5%
Angry 50.3%
Disgusted 49.5%
Surprised 49.5%
Calm 49.6%
Sad 49.5%
Fear 49.5%
Confused 49.5%

AWS Rekognition

Age 49-67
Gender Male, 50.2%
Disgusted 49.5%
Confused 49.5%
Angry 49.6%
Happy 49.5%
Sad 50.1%
Calm 49.6%
Surprised 49.5%
Fear 49.6%

Feature analysis

Amazon

Person
Jeans
Car
Shoe
Jacket
Person 99.7%
Person 99.7%
Person 99.7%
Person 99.5%
Person 98.1%
Person 96.2%
Person 93.5%
Person 90.2%
Person 84%
Jeans 99.1%
Car 97.3%
Shoe 95.8%
Shoe 90.2%
Shoe 89.6%
Shoe 88.7%
Shoe 81.3%
Shoe 80.1%
Jacket 85%

Categories

Captions

OpenAI GPT

Created by gpt-4 on 2024-02-06

This image features an urban streetscape presumably in autumn, as indicated by the yellowing leaves on the trees. Individuals appear to be walking on the sidewalk, with one person holding up a blank sign or placard. The architecture suggests this may be a historical or downtown area of a city. The sky is overcast, and there is a mixture of people seen in casual attire, suggesting a variety of activities and purposes for their presence.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-30

The image shows a busy city street scene in an urban setting. Several people can be seen walking along the sidewalk, some holding up signs or banners. The buildings in the background appear to be historic, with architectural details visible. There are trees lining the street, their leaves turning yellow, indicating it is autumn. An American flag is visible, waving from one of the buildings. The overall scene conveys a sense of activity and energy in the city.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

The image depicts a man holding a sign on a city street, with several people walking in the background. The man is wearing a denim jacket and blue jeans, and he has his back to the camera. He is holding a white sign above his head with both hands. In the background, there are several people walking on the sidewalk, including a man in a black jacket and pants, a woman in a blue shirt and khaki pants, and another man in a black jacket and blue jeans. There are also several trees and buildings visible in the background, including a large stone building with columns and a red awning. The overall atmosphere of the image suggests that the man is protesting or demonstrating about something, possibly a political or social issue. The presence of the sign and the fact that he is holding it above his head suggest that he is trying to draw attention to his cause. The people in the background appear to be going about their daily business, unaware of the man's protest.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-02

The image depicts a person holding a sign in the air on a city sidewalk, surrounded by other pedestrians. The individual, dressed in a dark jacket and blue jeans, stands with their back to the camera, waving a light blue sign above their head. In the background, several people are walking in the opposite direction, while a few others stand on the sidewalk. A black fence is visible to the right, and a large stone building with columns and windows can be seen in the distance. The scene appears to be set in an urban area, possibly during the daytime.