Human Generated Data

Title

Untitled (studio portrait of African American woman with four children)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6959

Human Generated Data

Title

Untitled (studio portrait of African American woman with four children)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.8
Person 99.8
Shoe 99.8
Apparel 99.8
Clothing 99.8
Footwear 99.8
Person 99.4
Shoe 99.1
Person 98.4
Person 98.1
People 96.5
Family 95.1
Person 93.8
Shoe 91.6
Photography 62.7
Photo 62.7
Baby 53.1

Imagga
created on 2022-01-23

kin 70.9
child 70.6
family 63.2
mother 50.4
father 47.6
happy 40.8
parent 39.3
male 37.3
smiling 34
together 33.3
love 33.2
people 31.8
man 31.6
home 31.1
daughter 30.4
grandfather 30
children 29.2
kid 27.5
son 27.2
boy 27
happiness 25.1
dad 24.9
portrait 24
grandma 23.9
husband 22.9
couple 22.7
fun 22.5
lifestyle 22.4
baby 21.7
smile 21.4
childhood 20.6
kids 19.8
adult 19.4
person 19.2
casual 18.7
joy 18.4
wife 18
senior 17.8
cute 17.2
cheerful 16.3
togetherness 16.1
indoors 15.8
little 15
brother 14.8
playing 14.6
two 14.4
men 13.8
girls 13.7
affectionate 13.6
women 13.5
laughing 13.2
group 12.9
sitting 12.9
parents 12.7
sibling 12.7
30s 12.5
interior 12.4
enjoying 12.3
outdoors 12
mom 11.6
care 11.5
room 11
house 10.9
leisure 10.8
offspring 10.7
couch 10.6
toddler 10.5
loving 10.5
old 10.5
mature 10.2
youth 10.2
adorable 10.2
holding 9.9
granddaughter 9.9
sister 9.8
boys 9.7
diversity 9.6
looking 9.6
elderly 9.6
black 9
grandchild 8.9
generations 8.9
grandmother 8.8
hug 8.7
standing 8.7
generation 8.7
married 8.6
laugh 8.6
race 8.6
face 8.5
clothing 8.1
juvenile 8
embracing 7.8
40s 7.8
middle aged 7.8
thirties 7.8
ethnicity 7.7
infant 7.7
looking camera 7.7
school 7.6
ethnic 7.6
friends 7.5
three 7.5
hold 7.4
indoor 7.3
relaxing 7.3
holiday 7.2
day 7.1

Google
created on 2022-01-23

Face 98.3
Footwear 98
Photograph 94.3
White 92.2
Black 89.8
Standing 86.4
Mammal 85.5
Style 84.1
Shorts 81.7
Toddler 81.6
Happy 80
People 79.6
Adaptation 79.2
Baby 78.9
Monochrome 76.4
Monochrome photography 75.8
Child 75
Vintage clothing 74.7
Snapshot 74.3
Event 70

Microsoft
created on 2022-01-23

person 99.9
baby 98
toddler 97.8
human face 97.7
clothing 97.7
child 96.2
wall 96.1
smile 94.5
indoor 91.6
standing 88.9
boy 87.6
young 82
little 76.3
posing 69.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-36
Gender Female, 100%
Calm 99.9%
Surprised 0%
Angry 0%
Confused 0%
Sad 0%
Fear 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 6-12
Gender Male, 99.9%
Confused 41.1%
Calm 31.6%
Happy 23.2%
Angry 1.9%
Surprised 0.7%
Disgusted 0.6%
Sad 0.5%
Fear 0.4%

AWS Rekognition

Age 6-14
Gender Male, 99.6%
Happy 66.7%
Confused 21%
Angry 6.5%
Disgusted 1.6%
Calm 1.5%
Surprised 1.4%
Fear 0.9%
Sad 0.4%

AWS Rekognition

Age 0-6
Gender Male, 100%
Calm 99.4%
Confused 0.5%
Disgusted 0%
Angry 0%
Surprised 0%
Happy 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 6-12
Gender Male, 100%
Sad 33.1%
Confused 29.1%
Calm 26.6%
Fear 5.1%
Angry 3.2%
Surprised 1.4%
Disgusted 0.8%
Happy 0.6%

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 99.8%
Baby 53.1%

Captions

Microsoft

a group of people standing next to a little girl posing for a photo 87.8%
a young boy standing next to a little girl posing for a photo 77.7%
a group of people standing next to a little girl posing for a picture 77.6%