Human Generated Data

Title

In the Near Future, New York

Date

2005

People

Artist: Sharon Hayes, American born 1970

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Human Generated Data

Title

In the Near Future, New York

People

Artist: Sharon Hayes, American born 1970

Date

2005

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Apparel 100
Footwear 100
Shoe 100
Clothing 100
Shoe 99.9
Person 99.8
Human 99.8
Person 99.8
Person 99.7
Person 99.6
Pants 99.5
Jeans 99.4
Denim 99.4
Person 99.4
Person 98.4
Person 98.4
Text 91.5
Person 90.5
Person 84.4
Building 81.5
Architecture 81.5
Female 77.6
Banner 76.4
Person 74.9
Person 74.8
Urban 74.3
Town 69.9
City 69.9
Transportation 68.2
Person 67.9
Vehicle 67.4
Girl 65.2
Downtown 63.9
Portrait 62.8
Photography 62.8
Face 62.8
Photo 62.8
Crowd 59.5
Woman 58.1
Person 57.8
Flagstone 57.5
Plant 57.2
Tree 57.2

Clarifai
created on 2019-11-16

people 99
battle 98.5
many 97.7
group 97.2
administration 96.6
rally 95.9
drag race 95.7
education 94.5
police 94.4
rebellion 94.3
offense 94
religion 93.1
man 92.9
election 92.7
woman 92.7
city 92.5
action 91.9
military 91.1
war 90.7
picket 90.4

Imagga
created on 2019-11-16

pedestrian 41.2
city 34.1
tourist 33.6
person 30
street 29.5
megaphone 26.4
man 24.2
people 23.4
sidewalk 23
traveler 22.8
building 22.8
acoustic device 21.2
road 19
male 18.4
urban 18.4
architecture 18
device 17.5
outdoors 16.8
outdoor 16.1
adult 15.6
men 14.6
business 14
day 13.3
town 13
travel 12.7
walking 12.3
lifestyle 12.3
attractive 11.9
world 11.7
park 11.5
cityscape 11.4
casual 11
sitting 10.3
square 10
businessman 9.7
buildings 9.5
life 9.3
one 9
couple 8.7
smiling 8.7
outside 8.6
traffic 8.6
sign 8.3
happy 8.1
student 8.1
transportation 8.1
bag 8
women 7.9
pavement 7.9
work 7.8
smile 7.8
standing 7.8
bench 7.8
tree 7.7
old 7.7
house 7.5
monument 7.5
leisure 7.5
technology 7.4
office 7.4
cheerful 7.3
group 7.3
computer 7.2
suit 7.2
looking 7.2
portrait 7.1
sky 7
modern 7

Google
created on 2019-11-16

Event 72.3
Protest 66.6
Pedestrian 64.7
Crowd 50.7

Microsoft
created on 2019-11-16

tree 99.8
person 98.5
outdoor 98
statue 94.2
clothing 93.5
man 92.4
footwear 88.1
woman 84.7
street 80.3
jeans 75
people 61.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 22-34
Gender Female, 54.8%
Happy 45%
Angry 45.5%
Disgusted 45.4%
Surprised 45%
Sad 46.7%
Fear 45.1%
Calm 51.8%
Confused 45.4%

AWS Rekognition

Age 19-31
Gender Female, 53.1%
Disgusted 45%
Happy 45%
Surprised 45%
Sad 54.2%
Fear 45.1%
Calm 45.4%
Angry 45.1%
Confused 45.1%

AWS Rekognition

Age 25-39
Gender Male, 50.3%
Confused 49.5%
Surprised 49.6%
Happy 49.5%
Sad 49.5%
Disgusted 49.5%
Angry 50.2%
Calm 49.6%
Fear 49.5%

AWS Rekognition

Age 24-38
Gender Male, 50.1%
Disgusted 49.5%
Calm 49.8%
Angry 49.5%
Confused 50.1%
Fear 49.5%
Sad 49.6%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 40-58
Gender Male, 50.1%
Disgusted 49.5%
Angry 49.5%
Fear 49.6%
Happy 49.5%
Confused 49.5%
Sad 50.3%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 23-35
Gender Female, 50.1%
Fear 49.5%
Sad 50.1%
Disgusted 49.5%
Surprised 49.6%
Calm 49.6%
Happy 49.5%
Angry 49.5%
Confused 49.5%

Feature analysis

Amazon

Shoe
Person
Jeans
Shoe 100%
Shoe 99.9%
Person 99.8%
Person 99.8%
Person 99.7%
Person 99.6%
Person 99.4%
Person 98.4%
Person 98.4%
Person 90.5%
Person 84.4%
Person 74.9%
Person 74.8%
Person 67.9%
Person 57.8%
Jeans 99.4%

Categories

Captions

OpenAI GPT

Created by gpt-4 on 2024-02-06

The image depicts an outdoor scene where an individual is holding up a sign with the text "Who Approved THE WAR in Vietnam?" There are other individuals around, some attending to various activities like pushing a stroller or using a phone. In the background, there's a large, ornate stone statue and a glimpse of a park with trees, indicating that the setting may be an urban public space. There's also a person in the far background holding what appears to be balloons.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-30

The image shows a public plaza or square, with a large stone monument or statue in the center. In the foreground, there is a group of people gathered, including a person holding up a sign that says "Who Approved THE WAR - in Vietnam??". The people appear to be engaged in some kind of protest or demonstration. There are trees and other structures visible in the background, suggesting an urban setting. The overall scene depicts a public space being used for a political or social protest.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

The image depicts a man holding a sign that reads, "Who Approved THE WAR in -Vietnam??" The man is standing in front of a stone monument with statues, surrounded by people. He is wearing a dark blue sweater and jeans, with his arms raised above his head to hold the sign. In the background, there are trees and other people walking around. The overall atmosphere suggests a protest or demonstration, with the man's sign indicating that he is expressing his opinion about the Vietnam War.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-02

The image depicts a protest scene in a public square, with a prominent statue of a woman in the background. The woman holding the sign is wearing a dark blue sweater and jeans, while the woman in the foreground is dressed in a black cardigan and brown pants. The man in the orange shirt is partially visible on the left side of the image. In the background, several people are standing around, some holding signs or balloons. A few individuals are sitting on the steps leading up to the statue, while others are walking around the square. The atmosphere appears to be one of peaceful protest, with the participants advocating for their cause in a calm and respectful manner. The overall mood of the image is one of determination and conviction, as the protesters express their opinions and beliefs in a public forum. The use of signs and banners adds a sense of organization and unity to the scene, emphasizing the collective nature of the protest.

Text analysis

Amazon

WAR
THE WAR
THE
Who
Who Aeproved
Aeproved
iN-Viernm??

Google

-ViT
Who Appmond WAR -ViT THE IN-
Who
Appmond
WAR
THE
IN-