Human Generated Data

Title

Untitled (mother, father in uniform, and infant, seated, half-length)

Date

c. 1940

People

Artist: Michael Disfarmer, American 1884 - 1959

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Neal and Susan Yanofsky, 2006.265

Human Generated Data

Title

Untitled (mother, father in uniform, and infant, seated, half-length)

People

Artist: Michael Disfarmer, American 1884 - 1959

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.6
Human 99.6
Person 99.4
People 95.9
Family 87.6
Clothing 76.3
Apparel 76.3
Military 71.5
Military Uniform 71.5
Female 66.1
Face 66.1
Girl 61.3
Baby 59.4
Accessory 59.4
Accessories 59.4
Glasses 59.4
Officer 58.8
Newborn 56.5
Soldier 55.8

Imagga
created on 2022-03-05

family 60.5
child 58.9
father 54.6
mother 44.8
parent 43.9
dad 42.3
sibling 42.1
happy 38.9
male 38.9
kin 38.4
love 33.9
son 33.7
together 31.6
happiness 30.6
smiling 30.4
portrait 29.1
daughter 28.8
boy 28.7
brother 28.7
kid 28.4
smile 27.1
man 26.9
people 26.2
baby 24.6
cute 24.4
couple 24.4
home 23.9
adult 23.9
fun 23.2
children 22.8
joy 22.6
childhood 21.5
husband 20
two 19.5
girls 19.2
casual 17.8
wife 16.1
kids 16
little 15.9
women 15
cheerful 14.6
mom 14.5
group 14.5
face 13.5
person 13.5
men 12.9
parents 12.7
holding 12.4
lifestyle 12.3
room 11.9
life 11.7
attractive 11.2
adorable 11.1
parenthood 10.7
toddler 10.5
expression 10.2
playing 10
interior 9.7
indoors 9.7
infant 9.7
generation 9.6
sitting 9.5
clothing 9.4
senior 9.4
youth 9.4
house 9.2
pretty 9.1
old 9.1
care 9.1
color 8.9
grandmother 8.8
sister 8.8
hugging 8.8
newborn 8.8
boys 8.7
standing 8.7
grandfather 8.6
laughing 8.5
friends 8.5
relationship 8.4
black 8.4
pink 8.4
studio 8.4
leisure 8.3
school 8.1
grandma 8
generations 7.9
brunette 7.8
companion 7.8
30s 7.7
years 7.7
diversity 7.7
married 7.7
enjoying 7.6
togetherness 7.6
friendship 7.5
three 7.4
mature 7.4
teen 7.4
joyful 7.4
year 7.3
handsome 7.1

Google
created on 2022-03-05

Picture frame 93.3
Hat 87.2
Sleeve 85.4
Gesture 85.3
Art 79.7
Toddler 77.5
Vintage clothing 75.7
Baby 73.7
Collar 69.9
Font 68
Event 66.4
Child 64.7
Stock photography 64.4
Room 63.7
Uniform 60.9
Retro style 56.1
Cap 55.9
Classic 55.9
Portrait 55.7
Family 55.6

Microsoft
created on 2022-03-05

wall 99.4
human face 98.9
baby 98.3
clothing 98
text 97.4
toddler 94.5
posing 89.7
smile 88.1
black 87.6
person 87.5
old 71.8
child 71.2
boy 65.5
photograph 62.7
vintage 33.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Female, 100%
Calm 72.3%
Disgusted 11.1%
Surprised 3.6%
Confused 3.4%
Angry 3.3%
Sad 2.9%
Happy 2.2%
Fear 1.2%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Calm 99.6%
Confused 0.1%
Sad 0.1%
Angry 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 0-3
Gender Female, 100%
Surprised 63.2%
Calm 23.4%
Fear 6.9%
Happy 3.4%
Angry 1%
Disgusted 1%
Sad 0.6%
Confused 0.4%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 1
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Glasses 59.4%

Captions

Microsoft

a vintage photo of a man and woman posing for a picture 89.4%
a vintage photo of a man and a woman posing for a picture 89.3%
a vintage photo of a man and woman posing for the camera 87.3%