Human Generated Data

Title

Social Settlements: United States. Maryland. Baltimore. "Lawrence House": The Lawrence House, Baltimore, Md.: Irish, German and Italian Families.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2948.1

Human Generated Data

Title

Social Settlements: United States. Maryland. Baltimore. "Lawrence House": The Lawrence House, Baltimore, Md.: Irish, German and Italian Families.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2948.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.7
Person 99.7
Person 98.9
Person 98.6
People 97.3
Person 95.2
Person 94.4
Person 93.6
Family 92.4
Person 89.6
Clothing 85.7
Apparel 85.7
Footwear 77.5
Shoe 77.5
Shoe 72.5
Coat 71.6
Shoe 67.1
Military 66.7
Military Uniform 66.7
Officer 62
Soldier 60.8
Overcoat 58.7
Shoe 58.1

Clarifai
created on 2019-06-05

people 100
group 99.4
child 98.8
group together 98.2
adult 98
administration 96.4
offspring 95.7
leader 94.2
three 93.5
five 93.4
sibling 93.4
many 93.3
four 93.3
several 93.1
man 93.1
woman 91.7
wear 90.2
war 87.8
portrait 87.1
son 85.9

Imagga
created on 2019-06-05

street 22.1
kin 20.8
building 19.3
musical instrument 19.2
city 19.1
people 19
wind instrument 18.2
man 16.8
male 16.3
old 15.3
person 15.1
architecture 14.1
brass 13.7
adult 12.3
clothing 12.1
portrait 11.6
urban 11.4
stone 11
dirty 10.8
uniform 10.5
tourism 9.9
military 9.7
statue 9.5
women 9.5
wall 9.4
weapon 9.2
travel 9.1
history 8.9
military uniform 8.7
tourist 8.5
accordion 8.4
monument 8.4
sax 8.3
landmark 8.1
device 8
soldier 7.8
boy 7.8
scene 7.8
war 7.8
youth 7.7
sculpture 7.6
house 7.6
world 7.5
dark 7.5
human 7.5
holding 7.4
historic 7.3
danger 7.3
brick 7.1
posing 7.1

Google
created on 2019-06-05

People 97.3
Photograph 96.1
Snapshot 86
Standing 81.9
Family 74.2
Vintage clothing 72.9
House 68.3
Child 57.3
Classic 56.7
History 54.1

Microsoft
created on 2019-06-05

building 99.9
person 99.8
clothing 99.1
posing 98.8
old 98.6
outdoor 97.5
smile 96.7
standing 90.6
woman 84.8
human face 83.3
house 79
black 77.3
man 70.7
group 66.5
white 65.1
vintage 58.9
dress 54.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-9
Gender Male, 76.9%
Disgusted 2.7%
Confused 11.6%
Angry 7.7%
Happy 7.5%
Calm 30.8%
Surprised 6.9%
Sad 32.8%

AWS Rekognition

Age 26-43
Gender Female, 75.1%
Calm 17.2%
Sad 42.8%
Happy 13.6%
Angry 7.7%
Disgusted 10%
Confused 3.9%
Surprised 4.7%

AWS Rekognition

Age 35-52
Gender Male, 96.5%
Happy 37.7%
Angry 10.2%
Disgusted 5.4%
Confused 5.7%
Sad 15.9%
Calm 23.6%
Surprised 1.3%

AWS Rekognition

Age 9-14
Gender Male, 76.1%
Surprised 2.4%
Happy 6.6%
Sad 41.7%
Calm 38.7%
Confused 2.7%
Disgusted 0.8%
Angry 7.1%

AWS Rekognition

Age 10-15
Gender Female, 77.4%
Calm 6.7%
Surprised 3.1%
Disgusted 11.2%
Confused 15.8%
Happy 14.5%
Angry 6.4%
Sad 42.5%

AWS Rekognition

Age 30-47
Gender Male, 64.7%
Calm 25.3%
Angry 4.1%
Confused 2.2%
Sad 57.2%
Happy 1.3%
Disgusted 8.9%
Surprised 1%

AWS Rekognition

Age 57-77
Gender Female, 77.8%
Surprised 0.6%
Happy 1.8%
Sad 71.1%
Calm 0.6%
Confused 1%
Disgusted 21.8%
Angry 3.1%

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 15
Gender Male

Microsoft Cognitive Services

Age 17
Gender Male

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 2
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 77.5%

Categories

Imagga

people portraits 99.2%

Text analysis

Amazon

SO