Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Ellis Memorial and Eldridge House": Ellis Memorial and Eldridge House, Boston, Mass.: A Day in the Country. Kindergarten Children.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3018.2

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Ellis Memorial and Eldridge House": Ellis Memorial and Eldridge House, Boston, Mass.: A Day in the Country. Kindergarten Children.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3018.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 96.7
Person 96.7
Person 94.9
Person 94.2
Art 84.6
Person 82.4
People 74
Text 71.9
Person 71.4
Painting 71.4
Person 68.2
Face 60.1
Photo 57.9
Portrait 57.9
Photography 57.9
Person 44.8

Clarifai
created on 2019-06-06

art 98.5
print 98
illustration 97.6
people 97.5
old 95
group 94.8
cavalry 94.1
town 93.6
building 93.5
lithograph 93.5
vintage 92.7
vehicle 92.5
no person 92.4
man 92
architecture 92
house 91.6
painting 90.3
adult 90.1
military 89.7
ancient 89.7

Imagga
created on 2019-06-06

graffito 100
decoration 96.2
grunge 33.2
vintage 32.3
old 28.6
sketch 25.5
retro 25.4
drawing 22.6
antique 21.6
aged 19.9
paper 19.6
art 19.5
texture 18.8
ancient 17.3
representation 16.4
design 14.1
painting 13.6
wall 13.1
old fashioned 12.4
pattern 12.3
travel 12
cash 11.9
dirty 11.8
architecture 11.7
currency 11.7
grain 11.1
money 11.1
banking 11
letter 11
graphic 10.9
landmark 10.8
religion 10.8
tourism 10.7
text 10.5
grungy 10.4
historic 10.1
space 10.1
rough 10
color 10
city 10
stamp 9.7
damaged 9.5
church 9.3
wallpaper 9.2
note 9.2
frame 9.2
global 9.1
black 9
history 8.9
material 8.9
world 8.9
postage 8.8
building 8.8
grime 8.8
textured 8.8
structure 8.8
symbol 8.8
artistic 8.7
stain 8.7
mail 8.6
worn 8.6
culture 8.6
window 8.4
paint 8.2
bank 8.1
business 7.9
postmark 7.9
smudged 7.9
crumpled 7.8
obsolete 7.7
bill 7.6
finance 7.6
weathered 7.6
envelope 7.5
map 7.5
brown 7.4
backgrounds 7.3
financial 7.1
country 7

Google
created on 2019-06-06

Art 82.8
Illustration 80.4
Visual arts 71.1
Room 65.7
Photography 62.4
Painting 61.3
Stock photography 59.4

Microsoft
created on 2019-06-06

text 98.8
book 97.1
old 93.6
person 92
clothing 88.7
human face 84.3
vintage 35.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-9
Gender Male, 54.8%
Surprised 45%
Calm 45.1%
Happy 45%
Angry 45.1%
Sad 54.6%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 6-13
Gender Female, 74%
Surprised 0.4%
Disgusted 0.5%
Angry 2.9%
Sad 92.4%
Happy 0.9%
Confused 0.6%
Calm 2.2%

AWS Rekognition

Age 10-15
Gender Male, 67.9%
Confused 4.4%
Angry 18.5%
Disgusted 2%
Calm 6.9%
Happy 6.5%
Surprised 4.5%
Sad 57.2%

AWS Rekognition

Age 4-7
Gender Female, 54.9%
Confused 45.5%
Disgusted 45.3%
Calm 46.6%
Sad 49%
Angry 45.5%
Happy 47.6%
Surprised 45.5%

AWS Rekognition

Age 16-27
Gender Male, 51.5%
Happy 45.1%
Sad 45.2%
Confused 45.3%
Calm 52.7%
Angry 45.8%
Disgusted 45.6%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Male, 51.1%
Surprised 45.1%
Sad 45.3%
Disgusted 45.5%
Happy 45.2%
Confused 45.1%
Calm 53.5%
Angry 45.3%

AWS Rekognition

Age 4-9
Gender Female, 52.8%
Confused 45%
Calm 45%
Disgusted 45%
Sad 54.9%
Happy 45%
Angry 45.1%
Surprised 45%

AWS Rekognition

Age 26-43
Gender Male, 53.5%
Disgusted 45.1%
Confused 45.1%
Happy 45.4%
Sad 53.8%
Surprised 45.1%
Calm 45.3%
Angry 45.2%

AWS Rekognition

Age 20-38
Gender Female, 54.3%
Happy 45.9%
Angry 45.3%
Calm 45.8%
Sad 52.5%
Surprised 45.2%
Confused 45.1%
Disgusted 45.2%

AWS Rekognition

Age 11-18
Gender Female, 54.1%
Disgusted 49.5%
Confused 45.2%
Calm 45.1%
Surprised 45.4%
Happy 45.6%
Sad 47.9%
Angry 46.2%

AWS Rekognition

Age 11-18
Gender Male, 50.4%
Surprised 45.2%
Angry 45.4%
Sad 53.1%
Happy 45.5%
Disgusted 45.1%
Calm 45.3%
Confused 45.3%

AWS Rekognition

Age 16-27
Gender Male, 52.8%
Confused 45.4%
Happy 47.4%
Surprised 45.5%
Calm 47.5%
Angry 45.8%
Sad 48%
Disgusted 45.3%

AWS Rekognition

Age 20-38
Gender Female, 54.4%
Angry 46.4%
Calm 46.1%
Sad 46.7%
Surprised 46.1%
Disgusted 46%
Happy 47.3%
Confused 46.3%

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 16
Gender Male

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.7%
Painting 71.4%

Captions

Text analysis

Google

S2,3 2 2-
2
2-
S2,3