Human Generated Data

Title

Untitled (Minneapolis)
Date

1980s
People

Artist: Gilles Peress, French born 1946
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.390
Copyright

© Gilles Peress/Magnum Photos

Human Generated Data

Title

Untitled (Minneapolis)

People

Artist: Gilles Peress, French born 1946

Date

1980s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Person 99.9
Human 99.9
Person 99.7
Person 99.2
Building 99.2
Person 99
Person 97.5
Arena 97.2
Stadium 97.2
Footwear 96.7
Shoe 96.7
Clothing 96.7
Apparel 96.7
Person 96.4
Audience 92.2
Crowd 92.2
People 80.6
Field 76
Face 73
Person 69.2
Skin 62.4
Mascot 56
Person 51.7

Clarifai
created on 2018-02-09

people 99.7
adult 97.7
group together 97.7
many 96.2
two 95.9
man 94.9
one 91.6
wear 89.5
group 89.5
athlete 89.4
portrait 89.1
outfit 89
woman 87.1
leader 86.6
several 85.1
sports equipment 84.4
administration 84
baseball 83.2
football player 83.1
recreation 82.1

Imagga
created on 2018-02-09

person 41.7
man 32.3
adult 31.3
male 28.4
people 27.3
black 24.8
guy 22.6
portrait 22
sport 21.7
stage 21.3
brass 19.8
model 18.7
sexy 18.5
face 17
active 16
athlete 15.9
performer 15.5
attractive 15.4
music 15.2
posing 15.1
dark 15
player 14.9
style 14.8
fitness 14.5
lifestyle 14.5
one 13.4
performance 13.4
dance 13.3
musician 13
studio 12.9
expression 12.8
singer 12.2
platform 11.8
fashion 11.3
human 11.3
body 11.2
entertainment 11
exercise 10.9
clothing 10.8
handsome 10.7
casual 10.2
sensuality 10
guitar 9.9
cool 9.8
concert 9.7
couple 9.6
hand 9.1
pose 9.1
planner 9
fun 9
ballplayer 9
healthy 8.8
love 8.7
play 8.6
men 8.6
hat 8.4
outdoor 8.4
pretty 8.4
contestant 8.4
action 8.3
training 8.3
sensual 8.2
cornet 8.1
professional 8.1
weapon 8.1
microphone 8.1
looking 8
hair 7.9
rock 7.8
musical 7.7
muscular 7.6
supporter 7.6
passion 7.5
emotion 7.4
fit 7.4
playing 7.3
teenager 7.3
dress 7.2
dancer 7.1

Google
created on 2018-02-09

white 96.5
people 96.2
black 96.1
man 95.5
photograph 95.3
black and white 87.9
photography 85
snapshot 81.8
male 80.8
crowd 79.6
standing 74.3
monochrome 73.3
human 71.8
monochrome photography 69
recreation 68.6
darkness 65
muscle 64.8
player 64.4
fun 61.6
style 59.3

Microsoft
created on 2018-02-09

person 99.8
outdoor 90.6
people 56.5
crowd 25.7

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Male, 97.2%
Confused 3.7%
Angry 76.7%
Surprised 4.4%
Happy 1%
Calm 7.9%
Disgusted 4.2%
Sad 2.1%

AWS Rekognition

Age 35-52
Gender Female, 53%
Confused 4%
Angry 4.4%
Surprised 3.2%
Happy 1.2%
Calm 80.9%
Disgusted 2.6%
Sad 3.7%

AWS Rekognition

Age 26-43
Gender Female, 94.7%
Surprised 3.7%
Disgusted 4.3%
Confused 3.4%
Happy 2.1%
Calm 71.2%
Sad 7.6%
Angry 7.8%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Happy 49.5%
Surprised 49.5%
Angry 50.2%
Sad 49.6%
Confused 49.5%
Disgusted 49.5%
Calm 49.6%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Confused 49.5%
Sad 49.5%
Disgusted 50.1%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Calm 49.8%

AWS Rekognition

Age 26-44
Gender Male, 50.4%
Angry 49.8%
Sad 49.5%
Confused 49.5%
Disgusted 49.5%
Surprised 50%
Happy 49.5%
Calm 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Angry 49.7%
Disgusted 49.6%
Sad 49.9%
Calm 49.6%
Surprised 49.6%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Male, 50.1%
Happy 49.8%
Sad 50.1%
Calm 49.6%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Sad 49.7%
Calm 49.7%
Surprised 49.6%
Angry 49.6%
Happy 49.6%
Confused 49.6%
Disgusted 49.7%

AWS Rekognition

Age 9-14
Gender Female, 50.4%
Confused 49.5%
Sad 49.9%
Surprised 49.6%
Angry 49.6%
Calm 49.6%
Happy 49.7%
Disgusted 49.7%

AWS Rekognition

Age 23-38
Gender Male, 50.2%
Calm 49.6%
Sad 49.9%
Confused 49.6%
Disgusted 49.6%
Happy 49.5%
Surprised 49.6%
Angry 49.7%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Angry 49.6%
Happy 49.5%
Disgusted 49.8%
Calm 49.8%
Sad 49.7%
Surprised 49.5%
Confused 49.6%

Feature analysis

Amazon

Person 99.9%
Shoe 96.7%

Captions

Microsoft

a group of people standing in front of a crowd 90.3%
a person standing in front of a crowd 90.2%
a person standing in front of a crowd of people 90.1%

Text analysis

Amazon

Siot
Chie