Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "University House": University House, Philadelphia, Pa.: Want "to belong"

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3270.5

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "University House": University House, Philadelphia, Pa.: Want "to belong"

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3270.5

Machine Generated Data

Tags

Amazon
created on 2022-07-02

Person 99.9
Human 99.9
Person 99.8
Person 99.8
Boy 96.3
Clothing 89.7
Apparel 89.7
Shoe 80
Footwear 80
People 77.5
Face 71.9
Kid 64.4
Child 64.4
Door 60.9
Outdoors 59.9
Sailor Suit 55.7

Imagga
created on 2022-07-02

world 36.3
kin 22.1
man 20.8
room 19.4
classroom 18.3
statue 16.2
sibling 15.6
male 15.1
people 15.1
blackboard 14.5
person 14.3
old 13.9
city 13.3
historic 12.8
wall 12.8
architecture 12.5
building 12.4
black 12
vintage 11.6
child 11
portrait 11
adult 10.8
urban 10.5
ancient 10.4
monument 10.3
dress 9.9
boy 9.6
historical 9.4
decoration 9.2
family 8.9
interior 8.8
soldier 8.8
antique 8.7
sculpture 8.6
men 8.6
culture 8.5
face 8.5
grunge 8.5
business 8.5
mask 8.2
dirty 8.1
helmet 8.1
history 8
art 7.8
dark 7.5
tourism 7.4
style 7.4
school 7.4
retro 7.4
light 7.3
life 7.3
aged 7.2
travel 7

Google
created on 2022-07-02

Photograph 94.2
Black 89.8
Standing 86.4
Line 82.3
Tints and shades 76.9
Vintage clothing 75
Snapshot 74.3
Door 74.1
Monochrome 70.7
Sitting 66
Child 64.9
Uniform 63.8
Room 63.6
Smile 63.4
Stock photography 62.9
Monochrome photography 60.8
History 60.8
Building 60.4
Art 56.8
Fun 54

Microsoft
created on 2022-07-02

outdoor 99
text 98.4
clothing 98.1
person 94.2
man 70.5
human face 56.8
posing 38.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 97.2%
Angry 76.4%
Calm 10.2%
Surprised 6.6%
Fear 6.1%
Sad 4.9%
Confused 4.6%
Disgusted 0.9%
Happy 0.5%

AWS Rekognition

Age 10-18
Gender Male, 99.1%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 1.1%
Angry 1%
Confused 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 18-26
Gender Male, 95%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Happy 0%
Angry 0%
Disgusted 0%

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Shoe 80%

Text analysis

Amazon

SRRb

Google

SRRb