Human Generated Data

Title

Joy Reagon and Jessie Harris, Peggy Dammond and Sam Block, Dorie Ladner

Date

1963, printed 2010

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2012.25

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Joy Reagon and Jessie Harris, Peggy Dammond and Sam Block, Dorie Ladner

People

Artist: Danny Lyon, American born 1942

Date

1963, printed 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.8
Person 99.8
Person 99.8
Person 99.7
Person 99.5
Person 99
Person 98.9
Face 98.4
Person 98.1
Person 97.7
Person 97.4
Person 94.1
Apparel 92.8
Clothing 92.8
Overcoat 92.7
Coat 92.7
Accessory 91.4
Accessories 91.4
Head 90.5
Glasses 87.6
Glasses 82.2
Crowd 80.3
People 76.5
Smile 74.2
Portrait 68.6
Photo 68.6
Photography 68.6
Finger 68.2
Audience 66.5
Tuxedo 66.4
Sunglasses 64.1
Female 63
Man 62.9
Text 60.3
Suit 60.1
Hair 60
Glasses 58.7

Clarifai
created on 2018-02-10

people 99.8
group 98.6
adult 97.9
leader 96.2
portrait 96.1
man 96
administration 94.5
two 93.9
group together 91.2
woman 90.6
actor 89.6
eyewear 89.6
three 87.9
four 84.4
music 82.3
wear 82.2
musician 79.4
outfit 78.8
facial expression 78.8
one 78.7

Imagga
created on 2018-02-10

man 45.1
male 38.6
happy 35.8
sibling 34.2
couple 34
people 32.9
smiling 30.4
love 30
businessman 27.4
adult 27.2
handsome 25.9
person 25.2
businesswoman 24.6
business 24.3
smile 24.3
happiness 22.7
corporate 22.4
professional 21.2
portrait 20.7
cheerful 20.3
husband 20.3
groom 20.1
businesspeople 19.9
suit 19.8
attractive 19.6
mature 19.5
together 19.3
kin 18.7
office 18.5
colleagues 18.5
grandma 18.1
executive 17.9
outdoors 17.9
group 17.7
parent 17.5
confident 17.3
world 17.3
team 17
family 16.9
necktie 16.7
married 16.3
father 16.2
senior 15.9
computer 15.2
looking 15.2
lifestyle 15.2
indoors 15
elderly 14.4
meeting 14.1
work 14.1
success 13.7
laptop 13.7
two 13.6
face 13.5
mother 13.4
romance 13.4
standing 13
dad 13
teamwork 13
sitting 12.9
men 12.9
wedding 12.9
partners 12.6
day 12.6
wife 12.3
home 12
grandfather 12
successful 11.9
old 11.9
communication 11.8
businessmen 11.7
daughter 11.7
romantic 11.6
30s 11.6
working 11.5
formal 11.5
desk 11.3
celebration 11.2
expression 11.1
casual 11
indoor 11
holding 10.7
affection 10.6
job 10.6
corporation 10.6
color 10.6
bride 10.6
workplace 10.5
marriage 10.5
pair 10.4
women 10.3
manager 10.3
40s 9.7
partner 9.7
loving 9.5
building 9.5
relationship 9.4
camera 9.2
20s 9.2
friendly 9.2
pretty 9.1
child 9
30 35 years 8.8
coworkers 8.8
grandmother 8.8
middle aged 8.8
boyfriend 8.7
outside 8.6
tie 8.5
adults 8.5
horizontal 8.4
joy 8.4
worker 8.3
aged 8.2
garment 7.9
businesswomen 7.9
good looking 7.8
retired 7.8
2 7.8
mid adult 7.7
modern 7.7
partnership 7.7
staff 7.7
bouquet 7.6
smart 7.5
doctor 7.5
company 7.4
park 7.4

Google
created on 2018-02-10

Microsoft
created on 2018-02-10

person 98
man 93.5
standing 81.5
academic costume 75.2
posing 63.7
necktie 20.9
staring 17

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 70.9%
Disgusted 31.1%
Happy 10.2%
Calm 26.3%
Sad 5.1%
Angry 11%
Surprised 10.1%
Confused 6.2%

AWS Rekognition

Age 23-38
Gender Female, 52.5%
Happy 7.2%
Surprised 14.4%
Angry 5.4%
Confused 13.4%
Disgusted 37%
Calm 20.3%
Sad 2.2%

AWS Rekognition

Age 16-27
Gender Female, 99.9%
Happy 13.6%
Sad 2.8%
Surprised 5.6%
Confused 4.5%
Calm 65.9%
Angry 4.4%
Disgusted 3%

AWS Rekognition

Age 26-43
Gender Female, 99.7%
Surprised 5.4%
Calm 47%
Sad 6.7%
Confused 12.5%
Angry 4.3%
Happy 14.8%
Disgusted 9.4%

AWS Rekognition

Age 26-43
Gender Male, 83.7%
Calm 23.3%
Sad 5.5%
Happy 29.8%
Angry 5.5%
Surprised 15.5%
Disgusted 10.7%
Confused 9.6%

AWS Rekognition

Age 20-38
Gender Male, 99.4%
Disgusted 4.2%
Confused 4.8%
Surprised 0.9%
Calm 79.5%
Angry 4.4%
Happy 0.3%
Sad 5.9%

AWS Rekognition

Age 35-52
Gender Male, 99.1%
Confused 5.4%
Calm 40.1%
Happy 0.9%
Disgusted 27%
Angry 9.5%
Sad 14.7%
Surprised 2.5%

AWS Rekognition

Age 26-43
Gender Male, 78.7%
Sad 1.9%
Calm 86.2%
Disgusted 0.9%
Surprised 2.5%
Angry 1.2%
Happy 5.7%
Confused 1.7%

AWS Rekognition

Age 23-38
Gender Female, 60.5%
Disgusted 5.2%
Sad 14.9%
Calm 55.8%
Surprised 5.7%
Happy 1%
Confused 6.9%
Angry 10.4%

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 41
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Glasses 87.6%
Sunglasses 64.1%
Suit 60.1%

Captions

Microsoft

a group of people posing for the camera 91.7%
a couple of people posing for the camera 87.9%
a man and woman posing for a photo 74.5%