Human Generated Data

Title

Untitled (four children, two seated, two standing, full-length, mountain and lake backdrop)
Date

c.1856 - c.1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3862

Human Generated Data

Title

Untitled (four children, two seated, two standing, full-length, mountain and lake backdrop)

People

Artist: Unidentified Artist,

Date

c.1856 - c.1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3862

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Person 99
Human 99
Person 98.3
Person 97.7
People 96.4
Person 96.2
Family 86.4
Clothing 66.6
Apparel 66.6
Art 64.5
Baby 55.3

Clarifai
created on 2021-04-03

child 99.9
people 99.7
baby 99.6
portrait 99.4
son 99.4
family 97
group 96.5
art 96.3
girl 96.3
two 95
offspring 94.8
wear 94.4
boy 92.4
sibling 91.3
three 91.3
sepia 90.9
woman 88.7
documentary 85.3
retro 84.9
man 83.6

Imagga
created on 2021-04-03

kin 88.2
man 30.9
brother 29.9
portrait 26.5
male 24.9
people 24
person 23.8
adult 23.3
black 23.3
family 23.1
love 21.3
attractive 20.3
face 18.5
child 18.1
boy 17.4
human 17.2
mother 17
couple 16.6
dark 15.9
happy 15.7
father 15.6
hair 15.1
model 14.8
youth 14.5
sexy 14.5
happiness 14.1
sibling 13.9
fashion 13.6
parent 12.9
body 12.8
dress 12.6
cute 12.2
style 11.9
kid 11.5
pretty 11.2
old 11.2
sensuality 10.9
hand 10.6
brunette 10.5
antique 10.4
expression 10.2
two 10.2
lifestyle 10.1
dad 9.8
posing 9.8
lady 9.7
one 9.7
together 9.6
casual 9.3
makeup 9.1
romantic 8.9
home 8.8
sepia 8.7
women 8.7
smile 8.6
head 8.4
lips 8.3
vintage 8.3
girls 8.2
childhood 8.1
romance 8
smiling 8
culture 7.7
husband 7.6
wife 7.6
healthy 7.6
elegance 7.6
passion 7.5
relationship 7.5
world 7.5
children 7.3
fitness 7.2
suit 7.2
looking 7.2
handsome 7.1
interior 7.1
modern 7
look 7

Google
created on 2021-04-03

Standing 86.4
Sleeve 83.7
Baby 79.6
Vintage clothing 77.8
Toddler 77.4
Tints and shades 73.4
Chair 71.6
Child 71.1
Room 70.3
Classic 70
Art 69.6
Picture frame 69.2
Pattern 63.9
Sitting 62.5
Stock photography 62.2
History 61.4
Antique 61.1
Retro style 57.8
Monochrome 57.4
Paper product 55

Microsoft
created on 2021-04-03

human face 98.9
baby 97.7
clothing 97.4
toddler 96.5
person 96.4
text 94.5
child 93.6
smile 90.7
boy 90
old 46.3
posing 44.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-33
Gender Female, 91.9%
Angry 93.7%
Calm 3.9%
Sad 1.1%
Confused 0.4%
Disgusted 0.3%
Surprised 0.3%
Fear 0.3%
Happy 0%

AWS Rekognition

Age 16-28
Gender Female, 97.1%
Calm 81.5%
Angry 9.7%
Sad 7.4%
Fear 0.4%
Happy 0.4%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 2-8
Gender Female, 84.9%
Angry 94.9%
Calm 1.1%
Disgusted 1%
Fear 0.9%
Sad 0.7%
Surprised 0.6%
Confused 0.5%
Happy 0.2%

AWS Rekognition

Age 0-4
Gender Male, 62.2%
Calm 43%
Sad 18.8%
Confused 15.5%
Fear 10.8%
Angry 6.7%
Surprised 3.5%
Disgusted 1.2%
Happy 0.5%

Microsoft Cognitive Services

Age 17
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 1
Gender Female

Microsoft Cognitive Services

Age 2
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%

Categories

Imagga

paintings art 43.1%
streetview architecture 28.7%
events parties 21.1%
text visuals 3.2%
people portraits 2.4%