Human Generated Data

Title

Untitled (woman seated with arms around two children, all three wearing angled hats)
Date

c. 1940, printed later
People

Artist: Paul Gittings, American 1900 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12845

Human Generated Data

Title

Untitled (woman seated with arms around two children, all three wearing angled hats)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.7
Human 99.7
Person 99.5
Apparel 99.2
Clothing 99.2
Face 97.2
Person 96.6
Hat 91.1
Hat 89.2
Female 88.3
People 85.8
Smile 84.7
Girl 75.8
Baby 75.2
Shorts 75.1
Photography 75.1
Photo 75.1
Portrait 75.1
Kid 72.5
Child 72.5
Teen 67.4
Woman 66.2
Shoe 64.7
Footwear 64.7
Plant 61.9
Floor 59.8
Sitting 59.6
Text 55.1

Clarifai
created on 2019-11-16

people 99.9
child 99.8
portrait 98.5
two 98.5
group 98.2
son 97.9
three 97.6
facial expression 97.3
wear 97.1
offspring 97.1
sibling 95.2
four 93.7
adult 93
retro 93
baby 92.6
outfit 90.9
monochrome 90.6
group together 90.2
family 90.1
uniform 87.9

Imagga
created on 2019-11-16

kin 67.7
love 36.3
couple 34.9
mother 29.9
adult 29.8
people 29.6
man 28.2
happy 27
parent 26.5
portrait 25.9
male 25.3
fashion 24.9
attractive 24.5
father 23.7
daughter 22.9
sexy 22.5
smile 21.4
family 21.4
happiness 21.2
child 20.7
dad 19.6
smiling 18.1
relationship 17.8
face 17.8
sibling 17.8
hair 17.4
black 17.4
women 17.4
person 17.3
cute 17.2
model 17.1
pretty 16.8
together 16.7
lady 15.4
brother 15.2
brunette 14.8
boy 13.9
body 13.6
two 13.6
dress 13.6
husband 13.5
passion 13.2
sensuality 12.7
hugging 12.7
style 12.6
girlfriend 12.5
posing 12.4
holding 12.4
lifestyle 12.3
hug 11.6
lovers 11.6
boyfriend 11.6
studio 11.4
wife 11.4
togetherness 11.3
men 11.2
expression 11.1
youth 11.1
casual 11
girls 10.9
joy 10.9
romance 10.7
romantic 10.7
human 10.5
fun 10.5
skin 10.2
room 10
children 10
cheerful 9.8
kid 9.8
home 9.6
erotic 9.5
hand 9.1
make 9.1
gorgeous 9.1
handsome 8.9
group 8.9
sepia 8.8
pair 8.5
dark 8.4
clothing 8.2
looking 8
embracing 7.8
dating 7.8
sexual 7.7
desire 7.7
lingerie 7.7
married 7.7
laugh 7.7
old 7.7
loving 7.6
elegance 7.6
adorable 7.4
sensual 7.3
blond 7.2
lovely 7.1
look 7

Google
created on 2019-11-16

Photograph 96.8
People 95.4
Snapshot 86
Child 76.5
Photography 72.5
Black-and-white 68.3
Vintage clothing 66.6
Family 65.5
Picture frame 60.7
Retro style 60.1
Stock photography 59.4
Smile 54

Microsoft
created on 2019-11-16

human face 98.4
person 98.4
smile 97.3
baby 97.3
posing 96.9
clothing 96.7
toddler 96.6
boy 90
text 89.5
window 81.6
old 73.2
group 63.2
child 56.3
vintage 40.8
family 22.6
picture frame 7.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 98.8%
Calm 0.2%
Sad 0.8%
Fear 0.7%
Confused 0.3%
Angry 0.2%
Happy 97.5%
Disgusted 0.1%
Surprised 0.2%

AWS Rekognition

Age 1-7
Gender Female, 84.9%
Surprised 0.1%
Confused 0.1%
Calm 0.5%
Happy 99.2%
Sad 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 23-37
Gender Female, 99.1%
Fear 2.5%
Sad 0.4%
Happy 31.5%
Calm 0.4%
Angry 1.6%
Surprised 7.7%
Disgusted 0.8%
Confused 55.1%

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Hat 91.1%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 97.6%
a vintage photo of a group of people sitting posing for the camera 97.1%
a vintage photo of a group of people posing for a picture 97%