Human Generated Data

Title

Untitled (portrait of four children)

Date

1910

People

Artist: Hamblin Studio, American active 1930s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2157

Human Generated Data

Title

Untitled (portrait of four children)

People

Artist: Hamblin Studio, American active 1930s

Date

1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.2
Human 99.2
Person 98.6
Face 96.6
Person 96.3
Clothing 93.6
Apparel 93.6
Person 89.8
Smile 83
Head 80.2
People 80
Portrait 63.7
Photography 63.7
Photo 63.7
Boy 59.7
Hair 59.3
Accessories 58.8
Accessory 58.8
Child 57.7
Kid 57.7
Hat 56.3
Collage 55.8
Poster 55.8
Advertisement 55.8

Clarifai
created on 2019-06-01

people 99.9
portrait 99.5
group 98.7
adult 98.6
monochrome 98.6
facial expression 97.6
child 96
man 95.6
woman 94.8
wear 94
two 94
retro 90.1
wedding 88.6
three 88.6
offspring 88.4
art 88.2
son 88.2
girl 87.8
veil 84.3
affection 84.1

Imagga
created on 2019-06-01

male 35.5
happy 35.1
portrait 34.9
man 34.4
couple 32.2
adult 30.4
people 30.1
love 30
brother 28.3
sibling 27.7
smiling 27.5
happiness 27.4
smile 27.1
person 25.1
attractive 22.4
face 22
two 21.2
together 21
grandfather 19.5
lifestyle 19.5
joy 19.2
pretty 18.9
family 18.7
women 18.2
mother 18
child 17.7
cheerful 17.1
cute 16.5
looking 16
senior 15.9
mature 15.8
romance 15.2
men 14.6
buddy 14.4
brunette 13.9
boy 13.9
expression 13.6
husband 13.6
daughter 13.5
togetherness 13.2
relationship 13.1
lady 13
human 12.7
hair 12.7
affection 12.6
marriage 12.3
fashion 12.1
fun 12
casual 11.9
model 11.7
romantic 11.6
elderly 11.5
wife 11.4
holding 10.7
father 10.7
loving 10.5
life 10.4
black 10.3
bride 9.9
handsome 9.8
kid 9.7
hug 9.7
married 9.6
youth 9.4
guy 9.3
professional 9.3
adorable 9.2
studio 9.1
business 9.1
sensual 9.1
old 9.1
little 8.8
couples 8.8
look 8.8
parent 8.7
affectionate 8.7
eyes 8.6
modern 8.4
teenager 8.2
healthy 8.2
blond 8.1
childhood 8.1
group 8.1
success 8
sexy 8
corporate 7.7
boyfriend 7.7
mustache 7.7
hat 7.7
girlfriend 7.7
friends 7.5
pensioner 7.5
close 7.4
style 7.4
positive 7.4
joyful 7.3
20s 7.3
successful 7.3
girls 7.3
dress 7.2
businessman 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

wall 99.4
human face 98.5
smile 94.8
person 94.4
posing 93.4
clothing 89.5
old 85.4
black and white 78.6
standing 75.8
man 74
black 69.4
picture frame 6

Face analysis

Amazon

AWS Rekognition

Age 23-38
Gender Male, 95%
Disgusted 0.2%
Calm 98.8%
Angry 0.1%
Sad 0.4%
Surprised 0.2%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 23-38
Gender Female, 67.8%
Happy 3.4%
Angry 2.6%
Surprised 2.9%
Disgusted 0.9%
Sad 18.4%
Calm 69.3%
Confused 2.4%

AWS Rekognition

Age 15-25
Gender Female, 72%
Sad 5.9%
Happy 1.8%
Surprised 2.8%
Calm 79.5%
Disgusted 6%
Confused 0.9%
Angry 3.1%

AWS Rekognition

Age 26-44
Gender Female, 72.6%
Happy 10.8%
Calm 56%
Angry 4.4%
Confused 3.8%
Surprised 6.8%
Sad 12.5%
Disgusted 5.7%

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 96%
a group of people posing for a photo 95.9%
a vintage photo of a group of people posing for a picture 95.8%