Human Generated Data

Title

Untitled (couple with little girl in white dress)

Date

c. 1940

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1301

Human Generated Data

Title

Untitled (couple with little girl in white dress)

People

Artist: Durette Studio, American 20th century

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.7
Apparel 99.7
Person 99.4
Human 99.4
Footwear 98.5
Shoe 98.5
Person 97.9
Person 97.3
Shoe 90
People 81.2
Pants 72.5
Countryside 64.7
Nature 64.7
Outdoors 64.7
Shoe 62
Girl 60.6
Female 60.6
Furniture 59.6
Shoe 57.9
Chair 56
Photography 55.2
Face 55.2
Portrait 55.2
Photo 55.2

Imagga
created on 2022-01-23

brother 65.1
child 62.3
family 55.2
father 46.8
mother 44.4
happy 42
kid 40.8
parent 38.9
male 33.2
people 31.8
love 31.6
smiling 29.7
boy 29.6
happiness 28.2
smile 27.8
man 27.6
dad 27.5
sibling 27.5
children 26.4
home 26.3
together 26.3
fun 26.2
daughter 25.3
son 24.5
cute 23.7
childhood 23.3
portrait 22.7
joy 21.7
cheerful 21.1
lifestyle 21
baby 20.7
casual 19.5
little 19.4
couple 19.2
bow tie 18.5
adult 18.1
youth 17.9
person 16.6
husband 16.2
two 15.3
kids 15.1
indoors 14.9
holding 14.9
sitting 13.8
parents 13.7
girls 13.7
clothing 13.5
necktie 13.1
kin 12.9
group 12.9
looking 12.8
playing 12.8
leisure 12.5
togetherness 12.3
standing 12.2
attractive 11.9
women 11.9
boys 11.6
loving 11.5
wife 11.4
play 11.2
mom 10.7
face 10.7
affection 10.6
interior 10.6
men 10.3
relationship 10.3
house 10
outdoors 9.7
affectionate 9.7
offspring 9.6
education 9.5
enjoying 9.5
color 9.5
friendship 9.4
three 9.3
studio 9.1
old 9.1
care 9.1
garment 9
generations 8.9
mommy 8.9
grandmother 8.8
parenthood 8.8
infant 8.7
30s 8.7
generation 8.6
toddler 8.6
expression 8.5
school 8.5
friends 8.5
domestic 8.4
adorable 8.3
teen 8.3
life 8.2
handsome 8
black 7.9
day 7.9
hug 7.7
gift 7.7
diversity 7.7
laugh 7.7
race 7.6
grandfather 7.6
senior 7.5
room 7.5
mature 7.4
joyful 7.4
pretty 7

Google
created on 2022-01-23

Footwear 98.3
Smile 96.4
Shoe 95.8
Black 89.5
Gesture 85
Style 83.8
Happy 79.3
Picture frame 78.4
Monochrome photography 74.1
Monochrome 74.1
Vintage clothing 72.7
Event 72.4
Tie 71.7
Collar 71.4
Formal wear 68.9
Suit 68.2
Baby 66
Lap 63.9
Sitting 63.6
Classic 63.5

Microsoft
created on 2022-01-23

person 99.7
clothing 96.9
smile 96.4
human face 94.2
baby 88.7
indoor 87.4
toddler 86.9
black 79.4
text 77.3
footwear 63.8
woman 52.1
posing 49.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-36
Gender Female, 100%
Happy 99.6%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0%
Calm 0%
Sad 0%

AWS Rekognition

Age 26-36
Gender Male, 98.6%
Calm 89.4%
Angry 7%
Sad 1.2%
Happy 0.6%
Confused 0.6%
Disgusted 0.5%
Fear 0.3%
Surprised 0.3%

AWS Rekognition

Age 1-7
Gender Female, 100%
Calm 53.5%
Happy 35.6%
Disgusted 7.4%
Surprised 1.5%
Angry 0.7%
Confused 0.5%
Sad 0.4%
Fear 0.4%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 40
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Shoe 98.5%

Captions

Microsoft

a little girl posing for a photo 90.7%
a small child is holding a teddy bear 61.6%
a little girl holding a teddy bear 61.5%