Human Generated Data

Title

Unite or Perish, Chicago
Date

1968
People

Artist: John Simmons, American born 1950
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Fund for the Acquisition of Photographs, 2018.119
Copyright

© John Simmons

Human Generated Data

Title

Unite or Perish, Chicago

People

Artist: John Simmons, American born 1950

Date

1968

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Fund for the Acquisition of Photographs, 2018.119

Copyright

© John Simmons

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Person 99.7
Human 99.7
Person 99.6
Person 99.6
Person 99.5
Person 99.4
Person 99.3
Person 99.3
Word 97.8
Crowd 97.4
Person 95.9
Person 95.8
Protest 95.2
Parade 95.2
Text 93.1
Person 92.6
Person 92.5
Pedestrian 90.4
Person 89.5
Person 88.6
Apparel 87
Clothing 87
Shorts 87
Person 85.6
Person 82.8
Shoe 82.2
Footwear 82.2
Person 70.9
Person 69.8
Person 69.5
Person 67.7
Person 64.2
Banner 59.9
Shoe 56.1
Shoe 50.7

Clarifai
created on 2018-07-31

people 99.7
group together 98.7
group 97.5
many 97.5
man 94.7
crowd 93.2
adult 91.6
street 90.1
woman 87.8
war 84.8
administration 84
child 83.2
monochrome 81.7
military 79.4
leader 78.2
several 75.9
wear 70.6
vehicle 70.4
spectator 66.8
police 65.7

Imagga
created on 2018-07-31

pedestrian 53.8
man 26.9
snow 22.9
people 20.1
winter 19.6
landscape 17.9
walking 17.1
silhouette 16.6
cold 15.5
ski slope 15.4
person 15.3
slope 15.2
outdoors 15.1
male 14.9
wind instrument 14.5
sky 14
outdoor 13.8
brass 13.6
sport 13.2
mountain 12.9
travel 12.7
sunset 12.6
ski 12.2
beach 12
vacation 11.5
walk 11.4
couple 11.3
season 10.9
musical instrument 10.9
park 10.7
summer 10.3
water 10
tree 10
tourist 9.8
trees 9.8
forest 9.6
geological formation 9.5
men 9.4
lifestyle 9.4
trombone 9.3
clouds 9.3
adult 9.2
leisure 9.1
world 9.1
old 9.1
river 8.9
businessman 8.8
holiday 8.6
business 8.5
life 8.4
environment 8.2
danger 8.2
recreation 8.1
oboe 8.1
boy 7.8
destruction 7.8
disaster 7.8
snowy 7.8
freeze 7.8
active 7.6
wilderness 7.6
sign 7.5
dark 7.5
human 7.5
city 7.5
ocean 7.5
tourism 7.4
mountains 7.4
lake 7.3
protection 7.3
success 7.2
horizon 7.2
suit 7.2
sea 7

Google
created on 2018-07-31

photograph 95.1
black and white 88.7
infrastructure 87.9
photography 78.5
tree 78.3
monochrome photography 73.1
history 72.2
monochrome 67.6
street 61.9
recreation 61.2
vehicle 55.8
crowd 54.6
vintage clothing 53.9
plant 52.2
tourism 50.2

Microsoft
created on 2018-07-31

tree 100
outdoor 100
sky 100
walking 82.2
people 81.8
group 72.5
way 46.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 54.6%
Calm 45.9%
Surprised 45%
Disgusted 45%
Happy 45%
Confused 45%
Sad 53.9%
Angry 45.1%

AWS Rekognition

Age 23-38
Gender Female, 55%
Disgusted 45.1%
Calm 52.1%
Surprised 45.2%
Angry 45.1%
Happy 45.2%
Sad 47.1%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 52.2%
Confused 45.2%
Sad 45.6%
Surprised 45.3%
Happy 45.1%
Disgusted 45.4%
Angry 45.4%
Calm 53%

AWS Rekognition

Age 10-15
Gender Female, 54.6%
Angry 45.2%
Disgusted 45.1%
Sad 50.1%
Calm 48%
Confused 45.2%
Surprised 45.2%
Happy 46.1%

AWS Rekognition

Age 10-15
Gender Female, 53.4%
Angry 45.1%
Surprised 45%
Calm 46%
Sad 53.9%
Disgusted 45%
Confused 45%
Happy 45%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Confused 49.5%
Happy 49.5%
Calm 49.7%
Disgusted 49.5%
Angry 49.6%
Sad 50%
Surprised 49.5%

AWS Rekognition

Age 23-38
Gender Male, 53.7%
Confused 45.2%
Surprised 45.1%
Sad 53.2%
Calm 46.2%
Angry 45.3%
Disgusted 45%
Happy 45%

AWS Rekognition

Age 14-25
Gender Female, 54.7%
Surprised 45.4%
Angry 45.9%
Confused 46%
Disgusted 45.7%
Happy 45.3%
Sad 50%
Calm 46.8%

AWS Rekognition

Age 14-23
Gender Female, 50.5%
Sad 50.4%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 17-27
Gender Female, 53.3%
Disgusted 45%
Sad 53.4%
Angry 45.3%
Surprised 45%
Happy 45.1%
Calm 46%
Confused 45.1%

AWS Rekognition

Age 4-7
Gender Male, 53.6%
Disgusted 45.1%
Happy 45%
Surprised 45.1%
Angry 45.4%
Calm 48.9%
Confused 45.2%
Sad 50.2%

AWS Rekognition

Age 19-36
Gender Female, 50.4%
Calm 49.7%
Sad 50.2%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.3%
Confused 49.6%
Happy 49.9%
Calm 49.6%
Surprised 49.6%
Disgusted 49.6%
Sad 49.7%
Angry 49.6%

AWS Rekognition

Age 20-38
Gender Male, 53.8%
Calm 48.2%
Angry 45.5%
Surprised 45.3%
Sad 49.4%
Happy 45.1%
Confused 45.4%
Disgusted 46.1%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Sad 49.7%
Calm 49.5%
Angry 50.1%
Confused 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Calm 49.7%
Disgusted 49.5%
Sad 50.2%
Happy 49.5%
Angry 49.5%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 30-47
Gender Female, 50.3%
Surprised 49.5%
Happy 49.5%
Angry 49.7%
Calm 49.7%
Sad 49.9%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 27-44
Gender Female, 50.1%
Angry 49.6%
Disgusted 49.5%
Happy 49.5%
Calm 49.6%
Sad 50.2%
Confused 49.6%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50%
Disgusted 49.6%
Angry 49.6%
Sad 49.7%
Happy 49.7%
Calm 49.7%
Confused 49.6%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Confused 49.5%
Angry 49.6%
Disgusted 49.5%
Sad 49.8%
Calm 49.8%
Happy 49.7%
Surprised 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Angry 50%
Disgusted 49.5%
Confused 49.5%
Sad 50%
Surprised 49.5%
Calm 49.5%
Happy 49.5%

AWS Rekognition

Age 17-27
Gender Female, 50.4%
Surprised 49.6%
Happy 49.5%
Confused 49.6%
Angry 49.5%
Calm 49.7%
Disgusted 49.5%
Sad 50.1%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Calm 49.8%
Confused 49.5%
Sad 50.1%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 10-15
Gender Female, 50%
Confused 49.6%
Angry 49.7%
Disgusted 49.8%
Calm 49.6%
Happy 49.6%
Surprised 49.6%
Sad 49.7%

AWS Rekognition

Age 20-38
Gender Male, 50.1%
Surprised 49.5%
Angry 49.7%
Sad 49.7%
Calm 49.9%
Confused 49.6%
Disgusted 49.6%
Happy 49.5%

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 10
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 82.2%

Text analysis

Amazon

ATTLEGR
IETNAM
PERISI
MERICA
UNITE:
UNITE
A
MERICA MERICALUNITEL UNITE
IS
THE SLACKN IS
THE SLACKN
1968
MERICALUNITEL
PERISN
Ccg 1968
ATTLEGR .R
Ccg
Simo
ir Simo A
.R
!
ir

Google

GO BLACY ANCAR UNION BATTLEGPERD MIETNAM
GO
BLACY
ANCAR
UNION
BATTLEGPERD
MIETNAM