Human Generated Data

Title

Untitled (older man with baby)

Date

c. 1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.442

Human Generated Data

Title

Untitled (older man with baby)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Newborn 98.6
Human 98.6
Person 98.3
Baby 86.8
Furniture 78.9
Couch 78.9
Face 73.6
Portrait 62.8
Photography 62.8
Photo 62.8
Sitting 56.3

Imagga
created on 2022-01-23

father 60.3
dad 59.9
parent 54.2
child 53.2
baby 52.9
neonate 43.9
home 35.1
mother 34.3
family 30.3
grandfather 30.2
male 29.6
man 28.2
happy 27
adult 25.9
love 24.5
couple 21.8
people 21.8
happiness 20.4
daughter 19.7
indoors 18.5
husband 18.1
smiling 18.1
kid 17.7
sitting 17.2
cute 16.5
wife 16.1
attractive 15.4
casual 15.3
interior 15
couch 14.5
portrait 14.2
grandma 14.2
holding 14
lifestyle 13.7
childhood 12.5
house 12.5
care 12.4
patient 12.2
boy 12.2
room 11.9
children 11.9
joy 11.7
together 11.4
cheerful 11.4
females 11.4
life 10.9
sofa 10.5
human 10.5
fun 10.5
bed 10.4
adults 10.4
black 10.2
smile 10
face 9.9
newborn 9.7
affectionate 9.7
married 9.6
nurse 9.5
son 9.5
senior 9.4
old 9.1
sexy 8.8
affection 8.7
infant 8.7
clothing 8.6
chair 8.5
relationship 8.4
pretty 8.4
hand 8.4
person 8.3
inside 8.3
women 7.9
half length 7.8
30s 7.7
elderly 7.7
living 7.6
togetherness 7.6
relaxation 7.5
indoor 7.3
relaxing 7.3
dress 7.2
domestic 7.2
looking 7.2
handsome 7.1
little 7.1

Google
created on 2022-01-23

Face 98.3
Arm 94.4
Tie 87.5
Baby 76.9
Toddler 76.1
Suit 74.6
Vintage clothing 73.4
Lap 72.1
Formal wear 71.4
Blazer 71
Sitting 69.7
Event 67.2
Collar 66.1
Stock photography 62.1
Chest 60
Photo caption 56.8
Monochrome photography 55.7
Retro style 51.7
Beard 51.4
Monochrome 51.1

Microsoft
created on 2022-01-23

person 100
baby 98.2
man 97.8
human face 96.5
clothing 89.6
toddler 89.1
black and white 85.2
text 72.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 65-75
Gender Male, 99.9%
Calm 75.7%
Confused 16.3%
Sad 5.7%
Angry 0.9%
Fear 0.6%
Surprised 0.4%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 0-3
Gender Female, 87.6%
Calm 97%
Happy 0.9%
Angry 0.5%
Disgusted 0.4%
Sad 0.4%
Fear 0.3%
Surprised 0.3%
Confused 0.2%

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Baby 86.8%

Captions

Microsoft

a man holding a baby 76.7%
a man sitting on a couch 76.6%
a man sitting on a bed 76.5%