Human Generated Data

Title

Social Settlements: United States. Maryland. Baltimore. "Lawrence House": The Lawrence House, Baltimore, Md.: Irish, German and Italian Families.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2948.3

Human Generated Data

Title

Social Settlements: United States. Maryland. Baltimore. "Lawrence House": The Lawrence House, Baltimore, Md.: Irish, German and Italian Families.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Wheel 99.6
Machine 99.6
Human 97.9
Person 97.9
Person 97.7
Transportation 97
Vehicle 97
Carriage 97
Wagon 94.7
Horse Cart 58.4

Clarifai
created on 2019-06-05

people 100
adult 99.2
vehicle 97.9
group 97.7
two 96.7
home 95.9
one 94.9
man 93
administration 92.5
transportation system 92.2
woman 92.1
leader 91.8
wear 91.4
military 91.1
many 90.2
three 88.9
several 86.7
group together 86.4
carriage 84.1
four 80.7

Imagga
created on 2019-06-05

architecture 35.5
sculpture 30.8
old 26.5
statue 26
ancient 25.1
building 24.6
monument 22.4
art 21.3
tourism 19.8
travel 19.7
history 19.7
stone 19.7
marble 17.3
landmark 17.1
column 16.7
stucco 16.6
structure 15.8
historic 15.6
antique 14.4
wall 14.1
groom 14
famous 14
culture 13.7
city 13.3
tourist 13
detail 12.9
religion 12.5
church 12
decoration 11.8
facade 11.5
support 11.4
historical 11.3
house 11.1
step 11
dress 10.8
construction 10.3
vintage 9.9
romantic 9.8
balcony 9.6
grunge 9.4
device 9.4
town 9.3
newspaper 8.7
fountain 8.2
sketch 8.1
brick 8.1
drawing 8.1
creation 8.1
bride 8
interior 8
artistic 7.8
texture 7.6
traditional 7.5
place 7.4
style 7.4
man 7.4
retro 7.4
street 7.4
wedding 7.4
design 7.3
palace 7.2

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

building 99.6
outdoor 95.8
old 95.5
person 92.9
clothing 91.1
cart 86.3
black 80.4
wheel 66.3
white 62.8
child 55.3
carriage 40.7
vintage 36.5
family 22.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 15-25
Gender Male, 59.6%
Angry 8.7%
Calm 45.1%
Disgusted 4.4%
Happy 6.9%
Surprised 3.2%
Sad 23.4%
Confused 8.4%

AWS Rekognition

Age 14-25
Gender Female, 52.2%
Sad 49.5%
Happy 45.2%
Surprised 45.3%
Disgusted 45.3%
Angry 49.2%
Calm 45.2%
Confused 45.3%

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 21
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Wheel 99.6%
Person 97.9%

Captions

Microsoft

a vintage photo of a horse drawn carriage 95.7%
a vintage photo of a person riding a horse in front of a building 89.4%
a black and white photo of a horse drawn carriage 89.3%

Text analysis

Amazon

SLI

Google

SI
SI