Human Generated Data

Title

Untitled (older man with baby)

Date

c. 1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.440

Human Generated Data

Title

Untitled (older man with baby)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Furniture 99.8
Chair 99.8
Newborn 98.7
Human 98.7
Person 97.5
Sitting 90.2
Face 89.9
Couch 88.2
Photo 69.7
Portrait 69.7
Photography 69.7
Person 68
Baby 67
Man 59.7
Apparel 59.2
Clothing 59.2
Interior Design 56.8
Indoors 56.8

Imagga
created on 2022-01-23

grandma 80.2
senior 36.6
grandfather 35.7
home 35.1
people 32.4
man 30.3
male 29.2
elderly 28.7
person 26.9
nurse 25.4
indoors 24.6
mature 24.2
happy 23.8
retired 23.3
family 23.1
medical 23
patient 22.4
couple 21.8
old 20.9
adult 20.3
husband 19.1
care 18.9
lifestyle 18.8
portrait 18.8
health 18.8
mother 18.4
room 17.4
smiling 17.4
sitting 17.2
doctor 16.9
retirement 16.3
wife 15.2
parent 14.4
illness 14.3
happiness 14.1
professional 14
hospital 13.8
love 13.4
cheerful 13
stethoscope 13
occupation 12.8
casual 12.7
older 12.6
married 12.5
child 12.4
smile 12.1
together 11.4
face 11.4
inside 11
aged 10.9
two people 10.7
interior 10.6
lady 10.6
help 10.2
house 10
holding 9.9
70s 9.8
caring 9.8
job 9.7
office 9.6
daughter 9.5
females 9.5
men 9.5
lab coat 9.1
indoor 9.1
uniform 9.1
clinic 8.9
specialist 8.9
looking 8.8
hair 8.7
table 8.7
two 8.5
attractive 8.4
joy 8.4
clothing 8.3
camera 8.3
human 8.3
playing 8.2
father 8.2
kid 8
physician 7.8
middle aged 7.8
couch 7.7
sick 7.7
30s 7.7
expression 7.7
medical instrument 7.7
talking 7.6
hand 7.6
horizontal 7.5
glasses 7.4
joyful 7.4
instrument 7.3
pensioner 7.3
active 7.2
women 7.1
syringe 7.1

Google
created on 2022-01-23

Tie 88.5
Suit 80.3
Toddler 78.2
Lap 78
People 77.7
Vintage clothing 73.9
Formal wear 72.1
Blazer 71.2
Baby 70.9
Event 70.9
Sitting 68.3
Art 68.1
Monochrome photography 66.9
Chair 66.6
Room 64.8
Stock photography 64.1
Monochrome 63.4
Collar 61.1
Comfort 60.4
Retro style 57.3

Microsoft
created on 2022-01-23

person 99.9
wall 98.8
man 96.9
baby 95.8
human face 93.1
clothing 91.1
indoor 88.1
toddler 84.3
text 81.3
black and white 70.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 66-76
Gender Male, 99%
Angry 67.2%
Confused 20.6%
Calm 10.7%
Surprised 0.5%
Sad 0.4%
Happy 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 0-3
Gender Female, 78.2%
Calm 99.6%
Confused 0.1%
Surprised 0.1%
Happy 0.1%
Disgusted 0%
Angry 0%
Sad 0%
Fear 0%

Microsoft Cognitive Services

Age 61
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%
Baby 67%

Captions

Microsoft

a man wearing a suit and tie 96.9%
a man in a suit and tie 96.8%
a man holding a baby 61.4%