Human Generated Data

Title

Untitled (studio portrait of African American woman with four children)
Date

c. 1945
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6956

Human Generated Data

Title

Untitled (studio portrait of African American woman with four children)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Shoe 99.8
Clothing 99.8
Footwear 99.8
Apparel 99.8
Human 99.8
Person 99.8
Shoe 99.8
Person 99.7
Person 99.3
Shoe 98.7
Person 97.4
People 97.2
Shoe 96.2
Family 94.7
Baby 70.4

Imagga
created on 2022-01-23

kin 82
child 58.8
family 57
mother 52.1
father 41.4
happy 40.7
male 39.4
parent 36.4
man 33.6
home 33.5
smiling 33.3
together 31.6
couple 30.5
daughter 29.6
people 29
grandma 27.3
love 26.8
husband 24.8
senior 24.4
happiness 24.3
kid 23.9
children 22.8
son 22.8
portrait 22
grandfather 22
boy 21.7
smile 21.4
adult 20.1
wife 19
lifestyle 18.8
cheerful 18.7
casual 18.7
indoors 18.5
fun 18
dad 17.8
joy 17.5
person 16.8
baby 15.9
sitting 15.5
women 15
men 14.6
togetherness 14.2
two 13.6
30s 13.5
loving 13.4
old 13.2
laughing 13.2
standing 13
group 12.9
childhood 12.5
elderly 12.5
enjoying 12.3
cute 12.2
room 12
playing 11.9
girls 11.9
affectionate 11.6
couch 11.6
looking camera 11.5
mature 11.2
day 11
parents 10.8
married 10.6
looking 10.4
house 10
grandchild 9.9
interior 9.7
little 9.7
outdoors 9.7
retired 9.7
brother 9.6
three 9.3
face 9.2
leisure 9.1
generations 8.9
grandmother 8.8
living room 8.8
40s 8.8
middle aged 8.8
thirties 8.8
life 8.7
sofa 8.6
sit 8.5
hospital 8.5
kids 8.5
holding 8.3
relaxing 8.2
clothing 8.1
medical 7.9
granddaughter 7.9
70s 7.9
two people 7.8
youth 7.7
friends 7.5
relaxed 7.5
human 7.5
adorable 7.4
lady 7.3
holiday 7.2

Google
created on 2022-01-23

Face 98.4
Hairstyle 95.1
Shoe 95.1
Photograph 94.2
Shorts 91.6
Black 89.7
Standing 86.4
Gesture 85.3
Black-and-white 84.4
Style 84.1
Happy 83.9
Smile 83.8
Toddler 81.1
Adaptation 79.4
Fun 78.1
Vintage clothing 76
Monochrome 74.4
Snapshot 74.3
Monochrome photography 74.2
Child 71.7

Microsoft
created on 2022-01-23

person 99.9
baby 98.9
toddler 98.7
clothing 96.8
human face 96.7
child 94
standing 92.8
smile 90.5
indoor 85.2
boy 84.9
young 84.2
posing 77.3
text 67
family 19

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-4
Gender Male, 98.2%
Calm 73.1%
Sad 22.7%
Angry 1.2%
Confused 1.1%
Happy 0.6%
Surprised 0.5%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 4-12
Gender Male, 99.9%
Happy 92.4%
Confused 3%
Fear 2.4%
Calm 1.1%
Surprised 0.7%
Disgusted 0.2%
Angry 0.2%
Sad 0.1%

AWS Rekognition

Age 23-33
Gender Female, 100%
Calm 87.7%
Sad 3.8%
Confused 2.1%
Disgusted 2%
Surprised 1.3%
Angry 1.2%
Happy 1.1%
Fear 0.9%

AWS Rekognition

Age 4-10
Gender Male, 90.9%
Happy 99.9%
Confused 0%
Surprised 0%
Calm 0%
Sad 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 6-14
Gender Male, 99.2%
Calm 96.7%
Sad 1%
Confused 0.9%
Fear 0.5%
Surprised 0.3%
Happy 0.3%
Angry 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 99.8%
Person 99.8%
Baby 70.4%

Captions

Microsoft

a group of people standing next to a little girl posing for a photo 86.4%
a group of people standing next to a little girl posing for a picture 86.3%
a group of people posing for a photo 86.2%