Human Generated Data

Title

Untitled (two children)

Date

c. 1900

People

Artist: Heath Studio, American early 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1842

Human Generated Data

Title

Untitled (two children)

People

Artist: Heath Studio, American early 20th century

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1842

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.5
Human 99.5
Person 98.4
Art 87.7
Advertisement 81.3
Poster 79.9
Painting 70.6
Furniture 63.2
Photography 62.8
Photo 62.8
People 62
Face 61.9
Portrait 61.3
Baby 56.7
Collage 55.1

Clarifai
created on 2023-10-25

child 99.4
people 99.1
portrait 98.8
painting 98.3
baby 98
art 97.8
two 96.8
wear 96.3
retro 95.1
son 94.7
sepia 94.6
affection 94.3
vintage 92.3
offspring 90.7
girl 90.7
nostalgia 90
family 88.6
three 86.1
paper 85.4
furniture 85.2

Imagga
created on 2021-12-14

kin 59.4
child 39.8
mother 30.4
parent 24.4
sibling 24
family 24
people 24
happy 23.8
portrait 22.6
love 22.1
couple 21.8
man 21.5
male 20.9
father 19.3
baby 19.2
happiness 18.8
smiling 17.4
smile 15.7
bride 15.3
dad 15
black 14.4
face 14.2
daughter 14
cute 13.6
boy 13
two 12.7
wife 12.3
adult 12.3
wedding 12
attractive 11.9
kid 11.5
person 11.5
statue 11.4
old 11.1
lifestyle 10.8
holding 10.7
lady 10.5
married 10.5
together 10.5
husband 10.5
pretty 10.5
fun 10.5
culture 10.3
dress 9.9
childhood 9.8
cheerful 9.8
bouquet 9.4
relationship 9.4
future 9.3
art 9.2
vintage 9.1
fashion 9
religion 9
romantic 8.9
sepia 8.7
marriage 8.5
youth 8.5
studio 8.4
joy 8.4
adorable 8.3
world 8.2
little 7.9
hair 7.9
brunette 7.8
antique 7.8
sculpture 7.8
casual 7.6
head 7.6
outdoors 7.5
symbol 7.4
girls 7.3
decoration 7.2
son 7.2
home 7.2

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

clothing 98.3
text 98.3
human face 98
person 97.8
child 97.1
baby 96.8
wall 96.7
toddler 96.5
indoor 90.3
smile 88.4
posing 61.1
old 60.1
painting 56.2
boy 50.4
picture frame 10.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 94.4%
Calm 99.6%
Happy 0.2%
Sad 0.1%
Confused 0%
Angry 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 2-8
Gender Female, 95.2%
Calm 73.7%
Confused 10.1%
Sad 7.2%
Surprised 6.9%
Fear 1.1%
Disgusted 0.5%
Angry 0.4%
Happy 0.2%

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 70.6%

Categories

Imagga

people portraits 68.6%
paintings art 30.3%