Human Generated Data

Title

Demonstration in a stadium. Tabriz

Date

1979

People

Artist: Gilles Peress, French born 1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.407

Copyright

© Gilles Peress/Magnum Photos

Human Generated Data

Title

Demonstration in a stadium. Tabriz

People

Artist: Gilles Peress, French born 1946

Date

1979

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Person 99.1
Human 99.1
Handrail 98.5
Banister 98.5
Person 97.7
Person 97.1
Person 96.7
Person 95.5
Apparel 94
Clothing 94
Face 93.5
Crowd 92.4
Audience 92.4
Person 90.2
Person 86.7
Person 83.7
People 78.5
Person 77.2
Person 76.1
Staircase 75.7
Person 75.5
Person 70.1
Photography 68.1
Portrait 68.1
Photo 68.1
Person 66.3
Female 66
Indoors 61.5
Interior Design 61.5
Coat 60.9
Overcoat 60.9
Person 58.7
Head 58.5
Girl 57.2
Person 44.6

Clarifai
created on 2018-02-09

people 99.8
group 98.9
many 98.3
adult 97.4
woman 97
nun 96.5
religion 95.3
crowd 95.2
wear 94.9
administration 94.8
veil 94.8
man 93.3
ceremony 89.3
hijab 89.3
group together 87.7
war 86.9
monochrome 86.5
leader 85.9
child 85.2
offense 84.6

Imagga
created on 2018-02-09

person 27.5
man 25.5
male 24.4
adult 22.1
device 21
harp 19.4
people 18.4
world 18.1
music 17.1
portrait 15.5
lifestyle 15.2
fan 14.9
black 14.7
business 13.4
instrument 13.1
musician 12.8
couple 12.2
play 12.1
sitting 12
playing 11.8
piano 11.7
guy 11.6
indoors 11.4
hand 11.4
attractive 11.2
corporate 11.2
holding 10.7
musical 10.5
follower 10.5
handsome 9.8
performance 9.6
hands 9.6
support 9.4
casual 9.3
face 9.2
stage 9.2
building 8.9
washboard 8.9
businessman 8.8
concert 8.7
urban 8.7
women 8.7
love 8.7
happiness 8.6
formal 8.6
life 8.5
sound 8.4
city 8.3
executive 8.3
fashion 8.3
happy 8.1
office 8
body 8
job 8
professional 7.9
work 7.8
model 7.8
pretty 7.7
serious 7.6
fingers 7.6
females 7.6
one person 7.5
laptop 7.5
keyboard 7.5
entertainment 7.4
light 7.4
suit 7.2
looking 7.2

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

person 97.1
outdoor 94.2
people 72.1
crowd 16.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-47
Gender Female, 99.1%
Happy 1.3%
Disgusted 4%
Sad 17.3%
Calm 68.7%
Angry 4.4%
Confused 1.4%
Surprised 2.8%

AWS Rekognition

Age 26-43
Gender Female, 99.5%
Calm 74%
Angry 2%
Confused 0.7%
Disgusted 7%
Surprised 1.6%
Happy 4.4%
Sad 10.4%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Angry 46.8%
Calm 49.8%
Surprised 45.5%
Confused 45.1%
Happy 45.8%
Disgusted 45.6%
Sad 46.4%

AWS Rekognition

Age 27-44
Gender Male, 95.7%
Surprised 0.2%
Happy 0.1%
Disgusted 0.1%
Confused 0.9%
Sad 93.2%
Angry 0.7%
Calm 4.8%

AWS Rekognition

Age 35-52
Gender Female, 89.7%
Disgusted 0.3%
Sad 49.2%
Happy 0.5%
Calm 45.7%
Angry 1%
Surprised 2.6%
Confused 0.8%

AWS Rekognition

Age 26-44
Gender Male, 50.1%
Happy 45.1%
Calm 54.8%
Angry 45%
Disgusted 45%
Sad 45%
Confused 45%
Surprised 45.1%

AWS Rekognition

Age 14-25
Gender Female, 90.1%
Calm 19.9%
Angry 12.3%
Confused 3.2%
Surprised 5.5%
Sad 50%
Disgusted 5%
Happy 4.1%

AWS Rekognition

Age 15-25
Gender Female, 82.9%
Angry 1.4%
Disgusted 2.1%
Surprised 7.8%
Calm 65.9%
Happy 1.8%
Confused 19.3%
Sad 1.7%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Happy 45.1%
Disgusted 45.4%
Angry 45.2%
Calm 53.9%
Surprised 45.2%
Sad 45.2%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Angry 45%
Happy 45%
Disgusted 45%
Confused 45%
Sad 55%
Calm 45%
Surprised 45%

AWS Rekognition

Age 35-52
Gender Female, 98.6%
Calm 7.1%
Happy 27.5%
Surprised 4.9%
Confused 4.4%
Disgusted 8.7%
Sad 39.8%
Angry 7.6%

AWS Rekognition

Age 35-52
Gender Male, 51.9%
Calm 45.9%
Sad 45.3%
Surprised 45.2%
Happy 53%
Confused 45.1%
Angry 45.2%
Disgusted 45.4%

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Happy 45.1%
Surprised 45.3%
Angry 45.2%
Sad 51.8%
Confused 45.1%
Disgusted 45.2%
Calm 47.4%

AWS Rekognition

Age 19-36
Gender Female, 54.8%
Angry 45.2%
Disgusted 45.2%
Sad 46.3%
Calm 52.9%
Surprised 45.1%
Happy 45.2%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Happy 45.4%
Surprised 45.4%
Angry 45.6%
Sad 50%
Confused 45.3%
Disgusted 45.2%
Calm 48.1%

AWS Rekognition

Age 16-27
Gender Female, 54.1%
Angry 45.1%
Disgusted 45%
Sad 53.1%
Calm 46.5%
Surprised 45.1%
Happy 45.1%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Female, 54.4%
Surprised 45.1%
Disgusted 45.4%
Confused 45%
Happy 45.1%
Calm 46.3%
Sad 52.9%
Angry 45.2%

AWS Rekognition

Age 15-25
Gender Female, 54.3%
Happy 46.3%
Sad 45.6%
Calm 50.3%
Confused 45.7%
Angry 45.6%
Disgusted 45.6%
Surprised 45.8%

AWS Rekognition

Age 26-43
Gender Female, 53.8%
Angry 45.2%
Calm 54%
Confused 45%
Surprised 45.2%
Sad 45.2%
Disgusted 45.2%
Happy 45.1%

AWS Rekognition

Age 17-27
Gender Female, 50.2%
Calm 49.7%
Happy 49.5%
Angry 49.6%
Confused 49.5%
Sad 50%
Disgusted 49.5%
Surprised 49.6%

AWS Rekognition

Age 35-55
Gender Female, 51.4%
Disgusted 45.1%
Angry 45.1%
Sad 52.7%
Happy 45%
Calm 47%
Surprised 45%
Confused 45%

AWS Rekognition

Age 27-44
Gender Female, 50.5%
Confused 49.5%
Angry 49.5%
Sad 49.8%
Calm 49.9%
Disgusted 49.5%
Surprised 49.5%
Happy 49.7%

AWS Rekognition

Age 16-27
Gender Female, 54.9%
Happy 45%
Surprised 45.2%
Sad 52.4%
Angry 45.5%
Disgusted 45.3%
Confused 45.8%
Calm 45.9%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Sad 50.3%
Surprised 49.5%
Calm 49.6%
Happy 49.5%
Confused 49.5%
Angry 49.6%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Calm 45.2%
Happy 54.6%
Surprised 45.1%
Confused 45%
Disgusted 45%
Sad 45%
Angry 45.1%

AWS Rekognition

Age 29-45
Gender Female, 50.3%
Surprised 49.5%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Calm 49.8%
Sad 50.1%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Female, 51.6%
Happy 45.7%
Calm 46%
Angry 45.6%
Disgusted 45.7%
Surprised 45.6%
Sad 51%
Confused 45.4%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Confused 49.5%
Sad 50.2%
Disgusted 49.6%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Calm 49.6%

AWS Rekognition

Age 23-38
Gender Male, 50.5%
Calm 50.4%
Sad 49.5%
Surprised 49.5%
Angry 49.5%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Sad 50.5%
Confused 49.5%
Disgusted 49.5%
Calm 49.5%

AWS Rekognition

Age 4-9
Gender Female, 54.7%
Calm 45.4%
Surprised 45.3%
Disgusted 45.5%
Angry 45.1%
Sad 46.8%
Confused 45.1%
Happy 51.9%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Sad 50.3%
Calm 49.6%
Surprised 49.5%

AWS Rekognition

Age 26-44
Gender Female, 50.2%
Angry 49.5%
Sad 50.4%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Calm 49.5%

AWS Rekognition

Age 35-52
Gender Female, 54.5%
Happy 45%
Sad 48.4%
Calm 51.1%
Confused 45%
Angry 45.2%
Disgusted 45.2%
Surprised 45.1%

AWS Rekognition

Age 23-38
Gender Male, 54.5%
Disgusted 45.8%
Surprised 45.6%
Angry 47.8%
Happy 45.5%
Sad 47.1%
Confused 45.9%
Calm 47.3%

AWS Rekognition

Age 35-52
Gender Male, 50.3%
Calm 49.6%
Angry 50.3%
Surprised 49.5%
Sad 49.5%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 16-27
Gender Male, 50.1%
Confused 49.5%
Happy 49.5%
Sad 49.6%
Surprised 49.6%
Disgusted 49.7%
Angry 49.6%
Calm 49.9%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a group of people standing in front of a crowd 95.1%
a group of people standing in front of a crowd of people 94.8%
a group of people sitting and standing in front of a crowd 93.3%

Text analysis

Amazon

K