Human Generated Data

Title

Stephen Pearson Brown, Stephen Orman Brown and Mollie Brown Doore, Dover, Maine

Date

c. 1895

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of John McAndrew, P1971.19

Human Generated Data

Title

Stephen Pearson Brown, Stephen Orman Brown and Mollie Brown Doore, Dover, Maine

People

Artist: Unidentified Artist,

Date

c. 1895

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of John McAndrew, P1971.19

Machine Generated Data

Tags

Amazon
created on 2022-06-03

Face 98.8
Human 98.8
Person 98.4
Person 96.4
Couch 95.4
Furniture 95.4
Smile 94.6
People 87.2
Female 81.6
Portrait 73.9
Photo 73.9
Photography 73.9
Person 68.7
Child 67.8
Kid 67.8
Cushion 67.7
Girl 65.4
Woman 62.8
Family 58.3
Painting 56.5
Art 56.5
Living Room 55.7
Indoors 55.7
Room 55.7

Clarifai
created on 2023-10-30

people 99.9
child 99.8
two 99.2
sepia 98.5
man 98.4
son 98.3
family 97.8
portrait 97.7
offspring 97.5
adult 97.4
group 97.3
nostalgia 97
sibling 96
retro 95.1
three 94.8
affection 94.2
interaction 93.8
sit 93.7
boy 93.6
wear 93.5

Imagga
created on 2022-06-03

people 26.8
child 26
man 24.2
person 23.2
happy 20
world 19.5
adult 18.5
male 17.5
love 16.6
portrait 16.2
happiness 14.9
smiling 14.5
face 14.2
mother 14
couple 13.9
family 13.3
room 12.9
smile 12.8
home 12.8
one 12.7
pretty 12.6
life 12.6
fun 12
old 11.1
youth 11.1
dress 10.8
fashion 10.6
human 10.5
body 10.4
lifestyle 10.1
cheerful 9.7
groom 9.5
house 9.2
sexy 8.8
hair 8.7
women 8.7
attractive 8.4
parent 8.1
looking 8
interior 8
art 8
sofa 7.9
sculpture 7.9
boy 7.8
statue 7.8
bride 7.7
relax 7.6
head 7.6
passion 7.5
vintage 7.4
style 7.4
blond 7.3
girls 7.3
black 7.2
father 7.2
religion 7.2
baby 7
husband 7

Google
created on 2022-06-03

Microsoft
created on 2022-06-03

text 98.9
human face 98.4
person 98.4
wall 96.8
clothing 96
book 90.2
smile 88
old 78.1
man 67.5
vintage 32.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Confused 87%
Calm 11.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.6%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 6-14
Gender Female, 71.1%
Calm 98.2%
Surprised 6.5%
Fear 5.9%
Sad 2.3%
Confused 0.3%
Disgusted 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 12-20
Gender Male, 94.4%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Happy 0%
Disgusted 0%
Angry 0%

Microsoft Cognitive Services

Age 19
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Painting 56.5%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2022-06-03

a vintage photo of a person 91.8%
a vintage photo of a boy 71.5%
a vintage photo of a girl 71.4%

Text analysis

Amazon

97

Google

26