Human Generated Data

Title

Untitled (studio portrait of family with mother and six children)

Date

c. 1938, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5779

Human Generated Data

Title

Untitled (studio portrait of family with mother and six children)

People

Artist: Durette Studio, American 20th century

Date

c. 1938, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.7
Person 99.7
Person 99.6
Person 99.6
Person 99.5
Family 99.5
People 99.5
Person 99.3
Person 97.8
Person 97.2
Footwear 96.8
Apparel 96.8
Clothing 96.8
Shoe 96.8
Person 96.1
Shoe 61.7
Shoe 53
Shoe 51.9
Shoe 51

Clarifai
created on 2019-11-16

people 100
group 99.8
group together 99.6
many 99.1
child 98
adult 97.5
woman 97.1
several 96.4
man 95.2
offspring 94.8
wear 92.7
family 92.7
five 89.4
administration 88.9
leader 88.4
sibling 87.4
boy 85.6
four 83.3
outfit 82.8
music 81.3

Imagga
created on 2019-11-16

kin 91.5
world 32.4
people 29
silhouette 25.6
man 25.5
male 24.8
person 19.7
men 18.9
group 17.7
adult 17.1
business 14.6
sport 14.4
child 14.1
black 13.8
businessman 13.2
couple 13.1
boy 13
family 12.4
human 12
player 11.5
portrait 11
active 10.8
sunset 10.8
athlete 10.7
love 10.3
ballplayer 10.1
happy 10
dress 9.9
together 9.6
play 9.5
outdoor 9.2
pose 9.1
team 9
contestant 8.9
women 8.7
happiness 8.6
walking 8.5
nurse 8.5
friendship 8.4
fun 8.2
girls 8.2
shadow 8.1
success 8
posing 8
travel 7.7
crowd 7.7
youth 7.7
walk 7.6
power 7.6
fashion 7.5
dark 7.5
leisure 7.5
teen 7.3
exercise 7.3
suit 7.2
body 7.2
interior 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

person 100
clothing 99
posing 97
group 93.8
standing 93.2
footwear 89.3
smile 87.1
man 85.8
text 85.1
woman 80.3
people 78.1
black and white 71
family 18.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 8-18
Gender Female, 53.9%
Disgusted 45%
Surprised 45%
Happy 45%
Confused 45.4%
Sad 51.9%
Fear 45.1%
Angry 45.2%
Calm 47.4%

AWS Rekognition

Age 13-23
Gender Female, 52.8%
Angry 46.9%
Sad 46.4%
Happy 45%
Disgusted 45.2%
Calm 51.1%
Confused 45.2%
Surprised 45%
Fear 45.1%

AWS Rekognition

Age 40-58
Gender Male, 54.5%
Angry 45%
Fear 45%
Confused 45%
Calm 54.9%
Sad 45%
Disgusted 45%
Surprised 45%
Happy 45%

AWS Rekognition

Age 19-31
Gender Male, 53.7%
Sad 45.1%
Angry 45.1%
Calm 49.4%
Happy 45.1%
Surprised 45%
Confused 50.1%
Disgusted 45%
Fear 45%

AWS Rekognition

Age 8-18
Gender Female, 50.9%
Angry 46.6%
Sad 51.6%
Confused 45.2%
Disgusted 45.1%
Surprised 45%
Happy 45%
Fear 45%
Calm 46.4%

AWS Rekognition

Age 26-42
Gender Female, 50.7%
Happy 51.9%
Fear 45.2%
Angry 45.2%
Confused 45.2%
Surprised 45.1%
Disgusted 45.1%
Calm 47%
Sad 45.3%

AWS Rekognition

Age 15-27
Gender Female, 54.6%
Happy 53.6%
Confused 45%
Calm 46.3%
Fear 45%
Angry 45%
Surprised 45%
Disgusted 45%
Sad 45%

AWS Rekognition

Age 13-25
Gender Female, 52.5%
Angry 45%
Sad 45%
Confused 45%
Surprised 45%
Happy 45%
Disgusted 45%
Calm 54.9%
Fear 45%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 96.8%

Captions

Microsoft

a group of people posing for a photo 98.5%
a group of people posing for a picture 98.4%
a group of people posing for the camera 98.3%