Human Generated Data

Title

Untitled (studio portrait of family with mother and six children)

Date

c. 1938, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5780

Human Generated Data

Title

Untitled (studio portrait of family with mother and six children)

People

Artist: Durette Studio, American 20th century

Date

c. 1938, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.8
Person 99.8
Person 99.7
Person 99.1
Person 99
Family 99
People 99
Person 98.4
Clothing 96.5
Apparel 96.5
Person 96.3
Person 95.2
Shorts 78.2
Shoe 72.1
Footwear 72.1
Furniture 59.4
Couch 59.4
Performer 55.8

Clarifai
created on 2019-11-16

people 100
group 99.8
woman 98.9
child 98.9
family 98.1
actress 98
group together 97.7
wear 97.2
adult 97
music 96.5
offspring 96.2
outfit 96
dancer 95.6
dancing 95
man 94.3
actor 93.5
several 93
four 92.5
singer 92.4
facial expression 92.1

Imagga
created on 2019-11-16

kin 100
people 29
man 25.5
silhouette 24.8
male 24.2
adult 20.8
group 19.3
person 18.9
portrait 17.5
family 16.9
happy 15.7
black 15.6
sunset 15.3
sport 15
happiness 14.9
mother 14.1
world 13.9
youth 13.6
fun 13.5
love 13.4
child 13.3
friendship 13.1
couple 13.1
boy 13
men 12.9
fashion 12.8
women 12.6
lifestyle 12.3
together 12.3
attractive 11.9
summer 10.9
human 10.5
outdoors 10.4
friends 10.3
girls 10
outdoor 9.9
father 9.8
joy 9.2
pretty 9.1
exercise 9.1
fitness 9
active 9
team 9
dance 8.9
sky 8.9
style 8.9
kid 8.9
smiling 8.7
model 8.5
face 8.5
business 8.5
athlete 8.5
beach 8.4
dark 8.3
action 8.3
leisure 8.3
park 8.2
sexy 8
businessman 7.9
daughter 7.9
urban 7.9
parent 7.8
dusk 7.6
head 7.6
power 7.6
togetherness 7.5
holding 7.4
teen 7.3
20s 7.3
teenager 7.3
pose 7.2
dress 7.2
celebration 7.2
cute 7.2
recreation 7.2
smile 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

person 99.6
clothing 99.4
smile 97.5
posing 95.4
human face 95.2
baby 93.5
toddler 92
boy 84.5
standing 83.3
woman 82.8
footwear 76.6
man 74.6
text 72
child 64.8
black and white 59.7
group 55.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 54.9%
Sad 48.8%
Angry 45.1%
Calm 48.6%
Happy 46.7%
Surprised 45.1%
Confused 45.2%
Disgusted 45.3%
Fear 45.2%

AWS Rekognition

Age 43-61
Gender Male, 96.9%
Confused 0.5%
Calm 98.2%
Sad 0.5%
Surprised 0.2%
Happy 0.2%
Disgusted 0.1%
Fear 0%
Angry 0.2%

AWS Rekognition

Age 4-12
Gender Female, 98.5%
Happy 79.8%
Sad 11.3%
Disgusted 1%
Fear 1.2%
Calm 4.8%
Angry 0.9%
Confused 0.6%
Surprised 0.3%

AWS Rekognition

Age 25-39
Gender Female, 98.5%
Disgusted 11%
Happy 63.2%
Angry 8.8%
Calm 3.8%
Surprised 2.5%
Confused 4.5%
Sad 1.8%
Fear 4.4%

AWS Rekognition

Age 6-16
Gender Male, 52.2%
Calm 80%
Disgusted 0.4%
Happy 0.4%
Fear 1.6%
Confused 0.6%
Angry 4.5%
Surprised 0.4%
Sad 12.1%

AWS Rekognition

Age 12-22
Gender Female, 52.5%
Disgusted 45%
Sad 55%
Happy 45%
Surprised 45%
Calm 45%
Fear 45%
Confused 45%
Angry 45%

AWS Rekognition

Age 14-26
Gender Female, 54.9%
Fear 45%
Angry 45%
Calm 54.6%
Surprised 45%
Happy 45%
Confused 45%
Sad 45.2%
Disgusted 45%

AWS Rekognition

Age 1-5
Gender Male, 51.9%
Disgusted 45.1%
Happy 45.1%
Angry 50.3%
Fear 45.1%
Sad 45.2%
Surprised 45.4%
Confused 46.6%
Calm 47.2%

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 72.1%

Captions

Microsoft

Alexandra Feodorovna, Sara Allgood posing for a photo 97.4%
Alexandra Feodorovna, Sara Allgood posing for the camera 97.3%
Alexandra Feodorovna, Sara Allgood posing for a picture 97.2%