Human Generated Data

Title

Untitled (mother and son)

Date

c. 1940

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1326

Human Generated Data

Title

Untitled (mother and son)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.9
Apparel 99.9
Human 99.5
Person 99.5
Person 99
Female 95.5
Shorts 90.7
Skirt 90.1
Woman 80.8
Girl 71.2
Footwear 69.5
Tartan 66.7
Plaid 66.7
Boot 55.7
Sitting 55.4

Imagga
created on 2022-01-23

sibling 44.2
kin 41.2
child 34.4
male 33.1
love 32.4
father 32
family 31.2
man 30.9
people 30.7
parent 30.4
mother 29.9
portrait 28.5
couple 27.9
happy 27.6
brother 24.1
adult 23.4
person 22
happiness 22
husband 21
dad 20.6
black 19.9
wife 19.9
body 19.2
studio 19
lifestyle 18.8
smile 17.8
smiling 17.4
together 16.7
boy 16.5
face 16.3
sexy 16.1
dark 15.9
fun 15.7
model 15.6
attractive 15.4
world 15.3
son 15.3
cute 15.1
fashion 14.3
human 14.3
baby 13.4
home 12.8
casual 12.7
one 12.7
hair 12.7
blond 12.1
daughter 12
kid 11.5
married 11.5
passion 11.3
relationship 11.2
skin 11
joy 10.9
childhood 10.8
holding 10.7
women 10.3
youth 10.2
sensual 10
romantic 9.8
lady 9.7
little 9.7
loving 9.5
leisure 9.1
looking 8.8
hug 8.7
men 8.6
togetherness 8.5
adorable 8.3
cheerful 8.1
posing 8
sitting 7.7
pretty 7.7
expression 7.7
seductive 7.7
two 7.6
hand 7.6
erotic 7.6
relaxed 7.5
senior 7.5
girls 7.3
sensuality 7.3
romance 7.1
interior 7.1
life 7

Google
created on 2022-01-23

Smile 95.4
Flash photography 86.5
Sleeve 86.5
Gesture 85.3
Tints and shades 77.2
Vintage clothing 77.1
Room 67.9
Event 66.4
Classic 65.5
Monochrome 64.7
Sitting 64.5
Fun 64.4
Stock photography 63.7
Child 62
Picture frame 61.4
Art 60.5
Toddler 59.6
Rectangle 58.6
Portrait 57.5
Retro style 56.7

Microsoft
created on 2022-01-23

text 99.2
human face 98.1
clothing 98.1
smile 96.9
wall 96.6
person 96.3
posing 89.2
dress 80.9
black 80.4
old 63.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-38
Gender Female, 100%
Happy 98.6%
Surprised 0.4%
Angry 0.2%
Fear 0.2%
Confused 0.2%
Disgusted 0.1%
Calm 0.1%
Sad 0%

AWS Rekognition

Age 2-10
Gender Male, 99.9%
Calm 59.9%
Confused 21.5%
Angry 8.8%
Happy 4.1%
Disgusted 2.2%
Sad 2%
Surprised 1.1%
Fear 0.3%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a person posing for a photo 95.9%
a man and a woman posing for a photo 82.2%
a man and woman posing for a photo 77.1%

Text analysis

Amazon

(T33A2AMT2A