Human Generated Data

Title

Untitled (four women posing in victorian parlor)

Date

c. 1905-1910, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5955

Human Generated Data

Title

Untitled (four women posing in victorian parlor)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1910, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-30

Human 99.8
Person 99.8
Person 99.7
Person 99.6
Person 99.5
Nature 89.2
Outdoors 86.3
Female 70.9
People 66.1
Apparel 61.6
Clothing 61.6
Girl 60.3
Sailor Suit 57.1
Sleeve 56.4
Face 55.4

Clarifai
created on 2019-05-30

people 100
group 99.7
child 99.2
adult 99
wear 97.5
music 96.5
woman 95.5
portrait 95.4
group together 94.8
man 94.5
musician 94.5
room 93.8
four 93.7
administration 92.9
offspring 92.6
several 92.3
two 92.1
three 91.7
five 90.6
family 88.6

Imagga
created on 2019-05-30

child 39.4
happy 37
male 34.6
people 29.6
smiling 28.2
brother 27.7
man 27.5
family 26.7
mother 23.7
adult 23.7
love 23.7
home 23.1
together 22.8
couple 20.9
portrait 20.1
smile 19.9
person 19.9
kid 19.5
father 19.4
parent 19.1
happiness 18.8
lifestyle 18.1
children 17.3
husband 15.4
casual 15.2
wife 15.2
fun 15
daughter 13.6
looking 13.6
two 13.5
indoors 13.2
boy 13
cheerful 13
group 12.9
youth 12.8
kin 12.5
sibling 12.2
world 11.8
childhood 11.6
room 11.5
interior 11.5
classroom 11.4
face 11.4
togetherness 11.3
indoor 11
cute 10.8
school 10.5
son 10.4
black 10.4
friends 10.3
teen 10.1
20s 10.1
teenager 10
girls 10
house 10
affection 9.7
standing 9.6
dad 9.5
education 9.5
kids 9.4
camera 9.2
joy 9.2
human 9
30s 8.7
married 8.6
leisure 8.3
new 8.1
women 7.9
baby 7.9
day 7.8
nightlife 7.8
nightclub 7.8
affectionate 7.7
men 7.7
couch 7.7
dancing 7.7
attractive 7.7
expression 7.7
bride 7.7
loving 7.6
life 7.6
enjoying 7.6
teacher 7.5
friendship 7.5
one 7.5
clothing 7.4
back 7.3
groom 7.2
to 7.1
modern 7

Google
created on 2019-05-30

Microsoft
created on 2019-05-30

wall 98.7
clothing 98.4
human face 96.6
smile 93.7
woman 91.6
indoor 88.5
window 86.1
person 85.3
old 82.5
posing 80.3
black 69.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 15-25
Gender Male, 52.5%
Angry 45.3%
Disgusted 45.5%
Surprised 45.2%
Confused 45.2%
Happy 45.1%
Sad 45.4%
Calm 53.3%

AWS Rekognition

Age 17-27
Gender Female, 50.2%
Surprised 45.1%
Happy 45.1%
Calm 53.7%
Confused 45.1%
Angry 45.3%
Disgusted 45.2%
Sad 45.4%

AWS Rekognition

Age 14-25
Gender Male, 54.7%
Angry 45.4%
Confused 45.3%
Disgusted 45.1%
Surprised 45.2%
Happy 45.2%
Calm 51.1%
Sad 47.7%

AWS Rekognition

Age 20-38
Gender Male, 51.7%
Angry 45.5%
Surprised 45.3%
Confused 45.3%
Calm 51.6%
Happy 45.3%
Disgusted 45.3%
Sad 46.7%

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people posing for a photo in front of a window 92.9%
a group of people posing for a photo 92.8%
a group of people standing in front of a window 91.1%