Human Generated Data

Title

Housing, Conditions: United States. New York. Construction Camps: Housing Conditions: New York: Interior of Room in Old Stone Barracks.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1658.3

Human Generated Data

Title

Housing, Conditions: United States. New York. Construction Camps: Housing Conditions: New York: Interior of Room in Old Stone Barracks.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.1
Person 99.1
Person 98.6
Apparel 82
Clothing 82
Military 81.1
Military Uniform 81.1
Furniture 80.8
Officer 68.5
Sitting 67.1
Face 65.8
People 62.9
Brick 57.2
Bed 56.6
Soldier 56.1

Clarifai
created on 2019-06-07

people 99.9
man 98.5
adult 98.4
military 97.4
war 97
two 95.8
soldier 94.7
one 93.3
group 92.7
art 91.6
wear 90.4
sit 90.1
old 89.4
administration 88.9
group together 88.8
woman 88.3
three 87.7
portrait 86.9
uniform 86.7
four 85.8

Imagga
created on 2019-06-07

shovel 61.1
hand tool 43.9
tool 36.3
stone 21.6
architecture 21.1
old 20.2
structure 17.7
history 17
ancient 16.4
travel 16.2
fountain 15.2
dirty 14.5
person 14.4
building 14.3
man 14.1
religion 13.4
art 12.4
memorial 11.7
outdoor 11.5
sculpture 11.5
wall 11
danger 10.9
religious 10.3
male 10
vintage 9.9
statue 9.9
outdoors 9.8
people 9.5
culture 9.4
grunge 9.4
monument 9.3
adult 9.1
sky 8.9
temple 8.9
holiday 8.6
historical 8.5
fashion 8.3
park 8.2
detail 8
child 7.8
construction 7.7
attractive 7.7
traditional 7.5
city 7.5
tourism 7.4
vacation 7.4
protection 7.3
megalith 7.2
portrait 7.1
mountain 7.1
snow 7.1

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

clothing 96.2
person 94.7
drawing 90.4
old 89.8
human face 67.7
sketch 60.9
painting 52
vintage 32.6
stone 29.8

Face analysis

Amazon

Google

AWS Rekognition

Age 26-43
Gender Male, 77.3%
Surprised 3.1%
Calm 32.3%
Happy 9.5%
Confused 2.8%
Sad 42.2%
Disgusted 2.5%
Angry 7.4%

AWS Rekognition

Age 45-66
Gender Female, 54.5%
Confused 1.6%
Calm 6%
Disgusted 0.9%
Happy 0.4%
Angry 3%
Surprised 1%
Sad 87.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a vintage photo of a person 83.1%
a vintage photo of a boy 60.6%
a vintage photo of a person 60.5%

Text analysis

Amazon

ITALY
6

Google

ITALY
ITALY