Human Generated Data

Title

Social Settlements: United States. New Jersey. Newark. "Newark Social Settlement Association": The Newark Social Settlement Association, Newark, N.J.: Neighbors (Irish Girls)
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3127.2

Human Generated Data

Title

Social Settlements: United States. New Jersey. Newark. "Newark Social Settlement Association": The Newark Social Settlement Association, Newark, N.J.: Neighbors (Irish Girls)

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3127.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Poster 99.6
Advertisement 99.6
Person 99
Human 99
Person 98.2
Person 97.6
Person 95.4
Text 86.4
Clothing 84.3
Apparel 84.3
People 61.4

Clarifai
created on 2019-06-06

people 100
group 99.5
adult 98.8
woman 97.5
two 96.3
wear 94.2
man 93.9
offspring 93.7
facial expression 92.9
portrait 92.7
three 91.8
several 91.5
child 91.4
leader 91.4
group together 91
administration 90.4
actress 90.2
home 89.8
four 88
family 87.9

Imagga
created on 2019-06-06

statue 51.6
architecture 43.5
building 37.6
sculpture 35.6
monument 27.1
city 25
stone 24.5
old 24.4
landmark 24.4
art 22.8
ancient 21.6
history 21.5
famous 21.4
tourism 19.8
historic 18.3
travel 18.3
culture 18
house 17
palace 16.9
facade 16.6
column 16.3
religion 16.1
structure 15.8
marble 15.6
historical 15.1
exterior 14.7
cemetery 13.8
kin 13.3
detail 12.9
window 12.6
antique 12.1
town 12.1
wall 12
buildings 11.3
church 11.1
tourist 11
architectural 10.6
musical instrument 10.1
arch 10.1
memorial 9.9
attraction 9.6
roman 9.4
traditional 9.1
balcony 9
style 8.9
accordion 8.9
baroque 8.8
sightseeing 8.8
urban 8.7
museum 8.7
fountain 8.7
windows 8.6
decoration 8.6
construction 8.6
capital 8.5
religious 8.4
street 8.3
columns 7.8
carving 7.8
heritage 7.7
world 7.7
god 7.7
home 7.2
keyboard instrument 7.1
shop 7

Google
created on 2019-06-06

People 97.1
Photograph 96.1
Snapshot 84.9
Vintage clothing 81.1
Family 69.8
Photography 62.4
Child 61.3
History 57.6
Classic 56.7

Microsoft
created on 2019-06-06

clothing 98.8
smile 97.8
human face 95
person 87.3
text 87.2
woman 85.3
old 76.9
black 75.3
man 66.8
vintage 27.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 97.9%
Sad 5.9%
Calm 1.1%
Happy 67.8%
Surprised 4.1%
Angry 7.4%
Disgusted 7.1%
Confused 6.6%

AWS Rekognition

Age 10-15
Gender Female, 79.9%
Happy 0.8%
Disgusted 1.7%
Angry 2%
Confused 2%
Calm 77.6%
Surprised 0.3%
Sad 15.6%

AWS Rekognition

Age 20-38
Gender Male, 94.9%
Happy 3.8%
Disgusted 7.7%
Angry 28.5%
Confused 15.6%
Calm 27.7%
Surprised 4.2%
Sad 12.6%

AWS Rekognition

Age 26-43
Gender Male, 99%
Surprised 0.7%
Calm 76.6%
Happy 1%
Angry 1.9%
Sad 12.3%
Disgusted 1.6%
Confused 5.8%

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster 99.6%
Person 99%

Categories

Imagga

paintings art 99.3%

Captions

Microsoft
created on 2019-06-06

a vintage photo of a person 89.6%
a vintage photo of a person 89.5%
a vintage photo of some people 89.1%

Text analysis

Amazon

Neighbors
(rish
Neighbors (rish Giris
Giris

Google

Neighbors (rish Grls)
Neighbors
(rish
Grls)