Human Generated Data

Title

Untitled (Billie and Tommy Bert Alexander)

Date

c. 1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.448

Human Generated Data

Title

Untitled (Billie and Tommy Bert Alexander)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Newborn 98.5
Baby 98.5
Human 98.5
Person 98.1
Face 92.1
Person 84.3
Person 72.5
Photography 68.4
Portrait 68.4
Photo 68.4
People 59

Imagga
created on 2022-01-23

parent 97.3
father 86
mother 77.5
dad 75.8
child 61.1
family 54.3
male 45.2
son 40.2
happy 35.8
home 34.3
love 34
happiness 32.9
daughter 31.5
man 29.6
people 29.6
kin 29
couple 27.9
baby 27.7
kid 27.5
adult 27.2
smiling 24.6
together 22.8
husband 22
lifestyle 20.3
indoors 20.2
little 19.5
portrait 19.4
cute 19.4
boy 19.1
sitting 18.9
childhood 18.8
cheerful 18.7
casual 18.7
children 18.2
joy 17.6
wife 17.1
fun 15.7
holding 15.7
smile 15.7
affectionate 15.5
couch 15.5
loving 14.3
offspring 14.1
30s 13.5
interior 13.3
old 13.3
parents 12.7
domestic 12.2
relationship 12.2
room 11.9
parenthood 11.7
face 11.4
kids 11.3
men 11.2
color 11.1
leisure 10.8
living room 10.8
bonding 10.7
newborn 10.7
mom 10.7
affection 10.6
looking 10.4
women 10.3
two 10.2
adorable 10.2
fatherhood 9.9
attractive 9.8
pretty 9.8
motherhood 9.8
sofa 9.6
living 9.5
adults 9.5
togetherness 9.5
20s 9.2
indoor 9.1
girls 9.1
generations 8.9
pregnant 8.8
pregnancy 8.8
half length 8.8
hug 8.7
brunette 8.7
infant 8.7
mid adult 8.7
four 8.6
play 8.6
toddler 8.6
mature 8.4
studio 8.4
playing 8.2
relaxing 8.2
lovely 8
brother 7.9
caring 7.9
life 7.8
black 7.8
40s 7.8
two people 7.8
boys 7.8
looking camera 7.7
married 7.7
enjoying 7.6
females 7.6
laughing 7.6
enjoyment 7.5
senior 7.5
group 7.3
dress 7.2
clothing 7.2
blond 7.2
romantic 7.1

Google
created on 2022-01-23

Face 98.4
Arm 94.4
Standing 86.4
Toddler 80.9
Baby 80.4
Vintage clothing 76.1
Sitting 69.7
Monochrome photography 66.8
Gesture 65.8
Monochrome 65.6
Child 65.3
Picture frame 63.3
Art 62.6
Event 62.5
Stock photography 62.2
Room 57.9
Portrait 57.3
Family 54.1
Retro style 53.7
Classic 53.4

Microsoft
created on 2022-01-23

person 99.5
human face 98.9
toddler 98.8
clothing 98.1
child 91.8
boy 80.3
smile 74.4
baby 69.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 99.9%
Calm 57.9%
Sad 38.9%
Disgusted 0.9%
Happy 0.7%
Angry 0.5%
Surprised 0.5%
Fear 0.4%
Confused 0.3%

AWS Rekognition

Age 0-3
Gender Female, 100%
Surprised 99.2%
Calm 0.5%
Happy 0.1%
Sad 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%
Confused 0%

Microsoft Cognitive Services

Age 0
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%

Captions

Microsoft

a woman holding a baby 93.3%
a person holding a baby 88.7%
a woman holding a baby 82.5%