Human Generated Data

Title

Zellner, Bernice Reagon, Cordell Reagon, Dottie Miller (Zellner), and Avon Rollins

Date

1963, printed 2010

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2013.111

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Zellner, Bernice Reagon, Cordell Reagon, Dottie Miller (Zellner), and Avon Rollins

People

Artist: Danny Lyon, American born 1942

Date

1963, printed 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.5
Person 99.5
Person 99.3
Clothing 99.3
Apparel 99.3
Person 99.2
Person 99
Person 98.7
Sunglasses 98.3
Accessories 98.3
Accessory 98.3
Shirt 97.9
Man 80.4
Face 80.3
People 78.4
Photography 62
Photo 62
Female 61.5
Dress Shirt 60.7
Portrait 60
Sleeve 58.6

Clarifai
created on 2018-02-09

people 99.9
group 99.9
group together 99.6
adult 99.1
leader 98.5
man 98.2
several 98.2
five 97.4
four 97.3
administration 97
facial expression 96.4
three 96.3
woman 94.7
many 93.5
wear 92.7
portrait 89.9
music 87.8
two 86.9
outfit 84.3
chair 84

Imagga
created on 2018-02-09

man 39.6
male 35.5
person 29.9
people 26.2
senior 21.5
adult 18.3
business 18.2
businessman 17.6
happy 16.9
couple 16.5
elderly 16.3
group 15.3
men 14.6
old 13.9
golfer 13.8
patient 13.8
looking 13.6
mature 13
player 12.6
team 12.5
happiness 11.7
job 11.5
professional 11.4
portrait 11
life 10.6
office 10.4
black 10.2
casual 10.2
two 10.2
smiling 10.1
active 10.1
spectator 10
aged 9.9
family 9.8
case 9.7
sport 9.7
retired 9.7
student 9.2
health 9
world 8.9
to 8.8
medical 8.8
husband 8.7
writing 8.7
work 8.6
day 8.6
nurse 8.6
smile 8.5
teacher 8.5
camera 8.3
care 8.2
child 8.1
home 8
grandfather 7.9
boy 7.8
standing 7.8
sitting 7.7
contestant 7.7
sky 7.6
chart 7.6
marriage 7.6
wife 7.6
meeting 7.5
engineer 7.5
silhouette 7.4
holding 7.4
sibling 7.4
room 7.4
worker 7.3
lifestyle 7.2
school 7.2
handsome 7.1
love 7.1

Microsoft
created on 2018-02-09

person 97.7
outdoor 95.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 74.2%
Calm 41.6%
Disgusted 1.6%
Angry 5.9%
Happy 7.9%
Confused 7.6%
Surprised 5.4%
Sad 30.1%

AWS Rekognition

Age 35-52
Gender Male, 99.3%
Calm 29.3%
Sad 36.6%
Surprised 6.4%
Disgusted 3.5%
Happy 4.8%
Angry 9.5%
Confused 9.9%

AWS Rekognition

Age 26-43
Gender Male, 79.8%
Confused 9%
Sad 4.1%
Disgusted 4.2%
Happy 19.4%
Angry 6.9%
Surprised 17.4%
Calm 39.1%

AWS Rekognition

Age 20-38
Gender Male, 97.7%
Disgusted 20.9%
Sad 9.1%
Calm 6.1%
Surprised 14.5%
Happy 25.2%
Confused 12%
Angry 12.1%

AWS Rekognition

Age 26-43
Gender Male, 57%
Disgusted 39.1%
Sad 18.7%
Calm 14.9%
Surprised 6.6%
Happy 2%
Confused 6.7%
Angry 11.9%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 40
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Likely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Sunglasses 98.3%

Captions

Microsoft

a group of people posing for a photo 93.9%
a group of people posing for the camera 93.8%
a group of people posing for a picture 93.7%