Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Ellis Memorial and Eldridge House": Ellis Memorial and Eldridge House, Boston, Mass.: A Day in the Country. Kindergarten Children.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3018.3

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Ellis Memorial and Eldridge House": Ellis Memorial and Eldridge House, Boston, Mass.: A Day in the Country. Kindergarten Children.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3018.3

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Leisure Activities 96
Human 91.6
Person 91.6
Person 90.3
Musical Instrument 89.9
Person 86.1
Person 80.3
Person 80.3
Art 73.9
Banjo 72.8
Painting 70.3
Text 59.3

Clarifai
created on 2019-06-06

people 99
group 97.2
retro 97.1
adult 97
art 96.7
vintage 96.6
print 96.6
wear 95.7
veil 95.2
illustration 94.9
two 94.2
man 93.1
nostalgia 92.8
lithograph 91.2
sepia 89.8
old 89.6
antique 88.9
woman 85.7
painting 85.3
mammal 84.8

Imagga
created on 2019-06-06

adult 20.1
field 20.1
banjo 19.6
people 19
portrait 18.1
stringed instrument 16.4
person 16.3
face 16.3
musical instrument 15.1
model 14.8
pretty 14.7
outdoor 14.5
grunge 14.5
sketch 13.8
cute 13.6
summer 13.5
drawing 13.2
vintage 12.4
man 12.1
women 11.9
ball 11.8
child 11.5
country 11.4
soccer ball 11.3
sexy 11.2
fun 11.2
one 11.2
hair 11.1
smiling 10.8
male 10.7
rural 10.6
fashion 10.5
human 10.5
attractive 10.5
old 10.4
art 10.2
black 10.2
happiness 10.2
joy 10
outdoors 9.7
outside 9.4
head 9.2
book jacket 9.2
currency 9
meadow 9
representation 8.8
brunette 8.7
grass 8.7
day 8.6
youth 8.5
money 8.5
hand 8.3
banking 8.3
jacket 8.3
cash 8.2
retro 8.2
happy 8.1
cheerful 8.1
lifestyle 7.9
game equipment 7.8
ancient 7.8
culture 7.7
relaxation 7.5
decoration 7.5
free 7.5
close 7.4
freedom 7.3
lady 7.3
business 7.3
gorgeous 7.2
dirty 7.2
dress 7.2
equipment 7.2
farm 7.1
smile 7.1
love 7.1
envelope 7

Google
created on 2019-06-06

Photograph 96.2
Retro style 82.8
Snapshot 82
Grass 68.8
Adaptation 67
Vintage clothing 66.6
Art 50.2

Microsoft
created on 2019-06-06

person 83.2
human face 79
clothing 74.3
smile 62.4
old 42.4
stone 11.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 9-14
Gender Male, 55.4%
Disgusted 4.4%
Calm 65.9%
Confused 1.2%
Happy 3.1%
Surprised 1.7%
Angry 3.2%
Sad 20.6%

AWS Rekognition

Age 26-43
Gender Male, 75.9%
Calm 87%
Disgusted 2.4%
Surprised 1.2%
Angry 2.3%
Sad 3.9%
Confused 1.6%
Happy 1.6%

AWS Rekognition

Age 26-43
Gender Female, 86.7%
Sad 77%
Angry 2.5%
Calm 11.6%
Confused 1.9%
Happy 3.8%
Disgusted 1%
Surprised 2.2%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Happy 45.2%
Calm 51.9%
Sad 46.3%
Surprised 45.4%
Angry 45.4%
Confused 45.1%
Disgusted 45.6%

AWS Rekognition

Age 10-15
Gender Male, 51.7%
Disgusted 45.2%
Happy 45.2%
Angry 46.7%
Calm 49.7%
Surprised 45.1%
Confused 45.3%
Sad 47.9%

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 17
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 91.6%
Painting 70.3%

Categories

Imagga

paintings art 86.1%
pets animals 9.9%
streetview architecture 1.1%
nature landscape 1.1%

Captions

Text analysis

Amazon

3

Google

3
3