Human Generated Data

Title

Untitled (studio portrait of African American woman with four children)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6957

Human Generated Data

Title

Untitled (studio portrait of African American woman with four children)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 99.6
Footwear 99.4
Apparel 99.4
Shoe 99.4
Clothing 99.4
Person 99.2
Baby 99
Shoe 98.7
Person 98
Shoe 97.5
People 97.2
Family 95.7
Shoe 95.7
Person 83.9
Shoe 66.6
Photo 61.9
Photography 61.9
Shoe 55.5

Imagga
created on 2022-01-23

kin 95.7
family 66.8
mother 61.6
child 60.4
father 50.9
parent 46.8
happy 43.3
male 38.8
daughter 35.7
smiling 34.8
love 34.8
home 31.9
man 31.6
people 31.3
together 29.8
kid 27.5
children 27.4
son 26.9
portrait 26.6
couple 26.2
boy 26.1
dad 25.9
happiness 25.9
husband 24.8
grandfather 22.9
fun 22.5
smile 22.1
baby 21.6
childhood 21.5
casual 21.2
lifestyle 21
adult 19.4
grandma 19.2
wife 19
senior 18.8
cute 18.7
joy 18.4
cheerful 17.9
little 17.7
men 17.2
kids 17
indoors 16.7
group 16.1
laughing 16.1
women 15.8
mom 15.5
affectionate 15.5
30s 15.4
togetherness 15.1
brother 14.9
parents 14.7
sitting 14.6
playing 14.6
person 13.9
girls 13.7
couch 13.5
loving 13.4
holding 13.2
care 12.4
outdoors 12
two 11.9
sibling 11.8
looking camera 11.6
enjoying 11.4
standing 11.3
old 11.2
grandmother 10.8
sister 10.8
boys 10.7
face 10.7
interior 10.6
four 10.6
elderly 10.5
mature 10.2
adorable 10.2
room 10
house 10
granddaughter 9.9
clothing 9.9
generations 9.9
black 9.6
generation 9.6
sofa 9.6
day 9.4
offspring 9.2
leisure 9.1
grandchild 8.9
living room 8.8
parenthood 8.8
embracing 8.8
40s 8.8
thirties 8.8
infant 8.7
married 8.6
laugh 8.6
toddler 8.6
race 8.6
human 8.3
relaxing 8.2
looking 8
middle aged 7.8
affection 7.7
attractive 7.7
diversity 7.7
studio 7.6
living 7.6
relaxed 7.5
three 7.5
park 7.4
blond 7.2

Google
created on 2022-01-23

Face 98.4
Hair 98.3
Photograph 94.3
Black 89.7
Standing 86.4
Gesture 85.3
Style 84.1
Happy 84
Black-and-white 83.9
Smile 83.1
Toddler 81.7
People 79.2
Fun 77.5
Vintage clothing 74.5
Snapshot 74.3
Shorts 73.8
Monochrome photography 73.4
Monochrome 73.3
Child 70.2
Curtain 69.8

Microsoft
created on 2022-01-23

person 99.8
baby 98.7
toddler 98.5
human face 97.8
child 97.8
clothing 97.5
smile 92.2
boy 91.5
indoor 89
standing 84.1
young 80
girl 78.9
posing 77.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-36
Gender Female, 99.6%
Calm 97.5%
Sad 1.4%
Fear 0.2%
Surprised 0.2%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 0-4
Gender Male, 99.9%
Calm 76%
Sad 20.5%
Confused 1.9%
Angry 0.4%
Disgusted 0.4%
Fear 0.3%
Happy 0.3%
Surprised 0.3%

AWS Rekognition

Age 6-14
Gender Male, 94.3%
Happy 94.7%
Confused 3.7%
Surprised 0.6%
Calm 0.3%
Disgusted 0.2%
Fear 0.2%
Sad 0.2%
Angry 0.1%

AWS Rekognition

Age 4-12
Gender Male, 99.7%
Happy 89.7%
Confused 3.3%
Calm 2.9%
Fear 1.6%
Surprised 1.3%
Angry 0.5%
Disgusted 0.4%
Sad 0.3%

AWS Rekognition

Age 6-14
Gender Male, 99.3%
Calm 99.1%
Confused 0.4%
Happy 0.2%
Fear 0.1%
Sad 0.1%
Surprised 0%
Angry 0%
Disgusted 0%

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 99.4%
Baby 99%

Captions

Microsoft

a little girl posing for a photo 94%
a boy and girl posing for a photo 86.1%
a boy and a girl posing for a photo 86%