Human Generated Data

Title

In the Near Future, New York

Date

2005

People

Artist: Sharon Hayes, American born 1970

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Human Generated Data

Title

In the Near Future, New York

People

Artist: Sharon Hayes, American born 1970

Date

2005

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Pants 100
Clothing 100
Apparel 100
Shoe 99.9
Footwear 99.9
Human 99.9
Person 99.9
Denim 99.8
Jeans 99.8
Person 99.8
Person 99.8
Person 99.6
Shoe 99.6
Person 99.5
Person 99.5
Person 99.3
Shoe 99.2
Person 99.1
Person 98.6
Person 98.6
Person 97.1
Shoe 97.1
Person 96.7
Shoe 96.7
Person 96.5
Crowd 92.8
Text 92.5
Person 87.7
Person 86.6
Person 84.4
Shoe 83.5
Person 82.9
Person 82.2
Person 79.7
Person 79.7
Parade 68.5
Leisure Activities 66.9
Person 60.8
People 55.5
Jeans 54.6

Clarifai
created on 2019-11-16

people 98.2
drag race 97.6
police 96.9
road 96.8
rally 96.5
battle 96.3
street 96.3
education 95.3
group 94.4
offense 94.3
city 94.3
many 94.1
school 93
man 92.5
election 92.5
crowd 92.2
administration 91.2
picket 90.7
flag 90.5
woman 90.4

Imagga
created on 2019-11-16

pedestrian 100
city 27.4
people 21.2
building 18.7
architecture 18.7
travel 17.6
road 17.1
street 16.6
person 15.4
man 14.1
tourist 13.9
sky 12.7
house 12.5
town 12
park 11.5
urban 11.3
male 11.3
group 11.3
old 11.1
sign 10.5
patriot 10.4
cityscape 10.4
flag 10.1
tree 10
business 9.7
outdoors 9.5
buildings 9.4
culture 9.4
clouds 9.3
outdoor 9.2
lake 9.2
tourism 9.1
new 8.9
trees 8.9
to 8.8
megaphone 8.6
monument 8.4
summer 8.4
landscape 8.2
spectator 8.1
water 8
day 7.8
work 7.8
adult 7.8
highway 7.7
walking 7.6
church 7.4
home 7.2
transportation 7.2
modern 7

Google
created on 2019-11-16

Protest 82.7
Event 78.9
Pedestrian 71.1
Demonstration 70.4
Crowd 66.3
Thoroughfare 57.7
Social work 52.1
Banner 51.4

Microsoft
created on 2019-11-16

person 99.8
tree 99.8
outdoor 99.2
handwriting 97.9
clothing 96.4
man 89.1
jeans 88.9
presentation 84.1
footwear 74.9
people 70
smile 57.6
woman 53.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-25
Gender Female, 53.6%
Fear 45%
Confused 45.2%
Happy 45%
Calm 45.8%
Surprised 45%
Sad 53.8%
Angry 45.1%
Disgusted 45%

AWS Rekognition

Age 31-47
Gender Male, 54.3%
Disgusted 45%
Happy 45%
Surprised 45.1%
Sad 45.1%
Fear 45%
Calm 54.5%
Angry 45.1%
Confused 45.1%

AWS Rekognition

Age 23-35
Gender Male, 53%
Disgusted 45%
Sad 45.1%
Calm 54.7%
Fear 45%
Happy 45%
Confused 45.1%
Angry 45%
Surprised 45%

AWS Rekognition

Age 29-45
Gender Male, 50.5%
Angry 49.5%
Calm 49.6%
Fear 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 50.4%
Sad 49.5%
Confused 49.5%

AWS Rekognition

Age 5-15
Gender Female, 50.5%
Angry 49.5%
Happy 49.5%
Fear 49.8%
Disgusted 49.5%
Sad 50.2%
Calm 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 13-23
Gender Female, 51.5%
Surprised 45.1%
Disgusted 45%
Sad 53.7%
Angry 45.5%
Calm 45.4%
Happy 45%
Fear 45.1%
Confused 45.2%

AWS Rekognition

Age 26-40
Gender Male, 50.5%
Sad 49.5%
Fear 49.5%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Calm 50.4%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 21-33
Gender Female, 50%
Angry 49.5%
Surprised 49.5%
Sad 49.5%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Calm 50.4%
Fear 49.5%

AWS Rekognition

Age 3-9
Gender Male, 50.1%
Disgusted 49.5%
Fear 50.3%
Calm 49.5%
Surprised 49.5%
Angry 49.5%
Confused 49.5%
Happy 49.5%
Sad 49.7%

AWS Rekognition

Age 27-43
Gender Male, 50.1%
Angry 49.5%
Surprised 49.8%
Sad 49.5%
Happy 49.7%
Calm 49.5%
Fear 49.5%
Confused 49.8%
Disgusted 49.5%

AWS Rekognition

Age 2-8
Gender Male, 52.9%
Happy 45%
Confused 45%
Calm 45%
Angry 45%
Disgusted 45%
Surprised 45%
Fear 45.3%
Sad 54.7%

AWS Rekognition

Age 47-65
Gender Female, 50.1%
Happy 49.5%
Fear 49.5%
Angry 49.7%
Confused 49.5%
Surprised 49.6%
Disgusted 49.5%
Calm 50.2%
Sad 49.6%

AWS Rekognition

Age 5-15
Gender Female, 50.1%
Sad 49.6%
Disgusted 49.5%
Fear 49.5%
Angry 49.6%
Happy 49.5%
Surprised 49.5%
Calm 50.2%
Confused 49.5%

AWS Rekognition

Age 4-12
Gender Female, 50.2%
Disgusted 49.6%
Happy 49.5%
Angry 49.5%
Fear 49.5%
Calm 49.5%
Sad 49.7%
Surprised 49.5%
Confused 50.1%

AWS Rekognition

Age 23-35
Gender Male, 50.2%
Fear 49.5%
Calm 49.5%
Disgusted 49.5%
Angry 49.6%
Surprised 49.5%
Happy 49.5%
Sad 50.4%
Confused 49.5%

AWS Rekognition

Age 13-25
Gender Male, 50.2%
Surprised 49.5%
Calm 50.3%
Happy 49.5%
Angry 49.5%
Fear 49.5%
Sad 49.5%
Confused 49.5%
Disgusted 49.5%

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe
Person
Jeans
Shoe 99.9%
Shoe 99.6%
Shoe 99.2%
Shoe 97.1%
Shoe 96.7%
Shoe 83.5%
Person 99.9%
Person 99.8%
Person 99.8%
Person 99.6%
Person 99.5%
Person 99.5%
Person 99.3%
Person 99.1%
Person 98.6%
Person 98.6%
Person 97.1%
Person 96.7%
Person 96.5%
Person 87.7%
Person 86.6%
Person 84.4%
Person 82.9%
Person 82.2%
Person 79.7%
Person 79.7%
Person 60.8%
Jeans 99.8%
Jeans 54.6%

Categories

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-04

The image depicts a public gathering in an outdoor urban area. There are several people present, engaging in what appears to be a demonstration or protest. One individual is holding a sign that reads, "Who Approved the WAR in -Vietnam??" Nearby, other people are sitting on steps, and some are taking photos. Behind the group, there are trees as well as high-rise buildings. A staircase leads to an elevated platform where more individuals are standing and observing.

Created by gpt-4 on 2024-02-06

This image portrays a gathering of people in an urban outdoor setting. There's a sign being held aloft that contains text questioning the approval of the Vietnam War. Around the area, multiple individuals are engaged in various activities, some are sitting on steps, others are standing, and there is a noticeable presence of people on an elevated walkway. The background is lined with trees, a bit of open sky, and the facade of a building.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-30

The image shows a protest or demonstration against the war in Vietnam. A young woman is holding up a sign that asks "Who Approved THE WAR in—Vietnam?", expressing her opposition to the war. There are several other people gathered around her, some watching and others also holding signs or placards. The scene appears to be taking place outdoors, with trees and buildings visible in the background.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

The image depicts a protest scene in a public area, with a man holding a sign that reads, "Who Approved THE WAR in -VIETNAM??". The man is wearing a purple jacket and blue jeans, and he stands out as the central figure in the image. In the background, there are several people gathered around, some of whom appear to be taking pictures or videos of the protest. There are also trees and buildings visible in the distance, which suggests that the protest is taking place in an urban setting. Overall, the image conveys a sense of activism and social commentary, as the man's sign and the surrounding crowd suggest a strong message being conveyed.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-03

The image depicts a man holding a sign in the middle of a crowd of people in a public space. The man is wearing a purple zip-up hoodie and blue jeans. He has short brown hair and is holding a white sign above his head with both hands. The sign reads "Who Approved THE WAR IN -VIETNAM??" in blue marker. The man appears to be standing in the middle of a busy public space, possibly a park or plaza. In the background, there are several people sitting on a concrete ledge, some of whom are taking pictures or videos with their phones. There are also several people walking around, some of whom are carrying bags or backpacks. The atmosphere appears to be one of protest or activism, with the man holding the sign drawing attention to himself. Overall, the image suggests that the man is trying to draw attention to the Vietnam War and possibly express his opposition to it. The use of a bold, handwritten sign and the man's prominent position in the image suggest that he is trying to make a statement and spark conversation about the war.

Text analysis

Amazon

WAR
THE
Who
Who Apprond
Apprond
-ViET
iN -ViET
iN

Google

Who Apprond WAR - Vienw THE -NI
Who
Apprond
WAR
-
Vienw
THE
-NI