Human Generated Data

Title

Social Settlements: United States. Maryland. Baltimore. "Lawrence House": The Lawrence House, Baltimore, Md.: Irish, German and Italian Families.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Human Generated Data

Title

Social Settlements: United States. Maryland. Baltimore. "Lawrence House": The Lawrence House, Baltimore, Md.: Irish, German and Italian Families.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon

Human 99.7
Person 99.7
Person 98.9
Person 98.6
People 97.3
Person 95.2
Person 94.4
Person 93.6
Family 92.4
Person 89.6
Clothing 85.7
Apparel 85.7
Shoe 77.5
Footwear 77.5
Shoe 72.5
Coat 71.6
Shoe 67.1
Military Uniform 66.7
Military 66.7
Officer 62
Soldier 60.8
Overcoat 58.7
Shoe 58.1

Clarifai

people 100
group 99.4
child 98.8
group together 98.2
adult 98
administration 96.4
offspring 95.7
leader 94.2
three 93.5
five 93.4
sibling 93.4
many 93.3
four 93.3
several 93.1
man 93.1
woman 91.7
wear 90.2
war 87.8
portrait 87.1
son 85.9

Imagga

street 22.1
kin 20.8
building 19.3
musical instrument 19.2
city 19.1
people 19
wind instrument 18.2
man 16.8
male 16.3
old 15.3
person 15.1
architecture 14.1
brass 13.7
adult 12.3
clothing 12.1
portrait 11.6
urban 11.4
stone 11
dirty 10.8
uniform 10.5
tourism 9.9
military 9.7
statue 9.5
women 9.5
wall 9.4
weapon 9.2
travel 9.1
history 8.9
military uniform 8.7
tourist 8.5
accordion 8.4
monument 8.4
sax 8.3
landmark 8.1
device 8
soldier 7.8
boy 7.8
scene 7.8
war 7.8
youth 7.7
sculpture 7.6
house 7.6
world 7.5
dark 7.5
human 7.5
holding 7.4
historic 7.3
danger 7.3
brick 7.1
posing 7.1

Google

People 97.3
Photograph 96.1
Snapshot 86
Standing 81.9
Family 74.2
Vintage clothing 72.9
House 68.3
Child 57.3
Classic 56.7
History 54.1

Microsoft

building 99.9
person 99.8
clothing 99.1
posing 98.8
old 98.6
outdoor 97.5
smile 96.7
standing 90.6
woman 84.8
human face 83.3
house 79
black 77.3
man 70.7
group 66.5
white 65.1
vintage 58.9
dress 54.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-9
Gender Male, 76.9%
Disgusted 2.7%
Confused 11.6%
Angry 7.7%
Happy 7.5%
Calm 30.8%
Surprised 6.9%
Sad 32.8%

AWS Rekognition

Age 26-43
Gender Female, 75.1%
Calm 17.2%
Sad 42.8%
Happy 13.6%
Angry 7.7%
Disgusted 10%
Confused 3.9%
Surprised 4.7%

AWS Rekognition

Age 35-52
Gender Male, 96.5%
Happy 37.7%
Angry 10.2%
Disgusted 5.4%
Confused 5.7%
Sad 15.9%
Calm 23.6%
Surprised 1.3%

AWS Rekognition

Age 9-14
Gender Male, 76.1%
Surprised 2.4%
Happy 6.6%
Sad 41.7%
Calm 38.7%
Confused 2.7%
Disgusted 0.8%
Angry 7.1%

AWS Rekognition

Age 10-15
Gender Female, 77.4%
Calm 6.7%
Surprised 3.1%
Disgusted 11.2%
Confused 15.8%
Happy 14.5%
Angry 6.4%
Sad 42.5%

AWS Rekognition

Age 30-47
Gender Male, 64.7%
Calm 25.3%
Angry 4.1%
Confused 2.2%
Sad 57.2%
Happy 1.3%
Disgusted 8.9%
Surprised 1%

AWS Rekognition

Age 57-77
Gender Female, 77.8%
Surprised 0.6%
Happy 1.8%
Sad 71.1%
Calm 0.6%
Confused 1%
Disgusted 21.8%
Angry 3.1%

Microsoft Cognitive Services

Age 2
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 17
Gender Male

Microsoft Cognitive Services

Age 15
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 77.5%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 97.6%
a vintage photo of a group of people posing for a picture 97.5%
a vintage photo of a group of people standing in front of a building 96.2%

Text analysis

Amazon

SO