Human Generated Data

Title

Untitled (studio portrait of African American woman with four children)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6958

Human Generated Data

Title

Untitled (studio portrait of African American woman with four children)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.7
Person 99.7
Person 99.6
Footwear 99.3
Clothing 99.3
Apparel 99.3
Shoe 99.3
Person 98.8
Person 98.2
Shoe 97.3
People 96.6
Family 96.3
Person 96.2
Shoe 92.4
Baby 67.8
Photo 61.1
Photography 61.1
Newborn 57.5

Imagga
created on 2022-01-23

child 67
family 64.1
mother 58.8
father 51.4
kin 48.8
grandfather 47
parent 46.5
happy 43.9
male 38.2
smiling 36.9
love 35.5
together 35.1
daughter 32.3
man 32.3
home 31.1
people 30.7
kid 30.2
dad 28.7
son 26.7
baby 26.6
children 26.5
boy 26.1
happiness 25.9
portrait 25.3
smile 24.3
fun 24
husband 23.9
couple 23.5
lifestyle 22.4
senior 21.6
grandma 21.1
joy 20.9
kids 20.7
childhood 20.6
casual 20.4
sibling 20.3
adult 20.1
cheerful 18.7
cute 18.7
sitting 18.1
brother 18
wife 17.1
togetherness 17
indoors 16.7
person 16.2
little 15.9
playing 15.5
affectionate 15.5
men 15.5
30s 15.4
two 14.4
group 13.7
girls 13.7
couch 13.5
loving 13.4
enjoying 13.3
laughing 13.2
parents 12.7
women 12.7
mom 12.6
face 12.1
outdoors 12
infant 11.6
holding 11.6
generation 11.5
old 11.2
adorable 11.1
house 10.9
leisure 10.8
sister 10.8
care 10.7
interior 10.6
diversity 10.6
mature 10.2
grandmother 9.8
middle aged 9.7
thirties 9.7
looking camera 9.6
married 9.6
laugh 9.6
elderly 9.6
race 9.6
toddler 9.6
friends 9.4
room 9.1
offspring 8.9
grandchild 8.9
granddaughter 8.9
embracing 8.8
40s 8.8
boys 8.7
hug 8.7
day 8.6
play 8.6
living 8.5
youth 8.5
friendship 8.4
black 8.4
camera 8.3
joyful 8.3
juvenile 8.2
relaxing 8.2
clothing 8.1
looking 8
generations 7.9
sixties 7.9
living room 7.8
mum 7.8
standing 7.8
relaxed 7.5
enjoyment 7.5
park 7.4
domestic 7.2
blond 7.2

Google
created on 2022-01-23

Face 98.3
Photograph 94.2
White 92.2
Black 89.5
Standing 86.4
Style 83.9
Shorts 81
Happy 79.5
Toddler 78.1
People 78
Vintage clothing 75.5
Baby 74.4
Snapshot 74.3
Fun 73.8
Monochrome 73
Monochrome photography 71.3
Event 70.7
Child 68.7
Stock photography 64.9
Room 64.5

Microsoft
created on 2022-01-23

person 99.9
baby 98.3
human face 97.8
toddler 97.8
clothing 97
child 96.9
smile 92.7
boy 89.3
indoor 87.3
text 75.1
posing 67.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Female, 100%
Calm 99.7%
Confused 0.1%
Angry 0.1%
Surprised 0%
Fear 0%
Sad 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 4-12
Gender Male, 99.9%
Happy 84.9%
Confused 5.4%
Fear 5.2%
Angry 1.6%
Calm 1%
Surprised 0.8%
Disgusted 0.7%
Sad 0.5%

AWS Rekognition

Age 6-14
Gender Male, 98.2%
Confused 83.5%
Calm 8%
Angry 6.9%
Sad 0.7%
Disgusted 0.3%
Happy 0.2%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 6-12
Gender Male, 99.9%
Calm 51.2%
Sad 34.1%
Angry 9.2%
Fear 1.9%
Confused 1.2%
Surprised 0.9%
Disgusted 0.8%
Happy 0.7%

AWS Rekognition

Age 0-4
Gender Male, 100%
Calm 100%
Confused 0%
Disgusted 0%
Surprised 0%
Happy 0%
Sad 0%
Angry 0%
Fear 0%

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 99.3%

Captions

Microsoft

a group of people posing for a photo 97.1%
a group of kids posing for a photo 93.6%
a group of children posing for a photo 93.5%