Human Generated Data

Title

Housing, Conditions: United States. Illinois. Chicago. Lodging Houses: Housing Conditions Chicago,: 1-room apartment in furnished rooming house on the West Side: 8 families now living in this house originally occupied by single family.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1645.2

Human Generated Data

Title

Housing, Conditions: United States. Illinois. Chicago. Lodging Houses: Housing Conditions Chicago,: 1-room apartment in furnished rooming house on the West Side: 8 families now living in this house originally occupied by single family.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Human 98.7
Person 98.7
Person 98.6
Person 97.4
Clinic 93.5
Hospital 93
Person 88.2
Person 85.1
Operating Theatre 68.8
Furniture 64

Clarifai
created on 2019-06-04

people 99.9
group 99.2
adult 98.9
group together 98.2
many 95.2
leader 95
one 94.1
man 93.9
several 93.5
two 92.9
administration 92.5
woman 91.1
three 90.5
four 88.9
wear 88.3
vehicle 88
war 87.6
furniture 87.5
military 84.2
room 83

Imagga
created on 2019-06-04

architecture 24.3
old 22.3
building 22
city 19.1
metropolitan 18.9
religion 17.9
man 16.8
people 16.2
ancient 15.6
statue 15.2
history 14.3
church 13.9
male 13.5
sculpture 13.4
travel 13.4
monument 13.1
culture 12.8
tourism 12.4
art 12.4
person 12
stone 11.9
god 11.5
town 11.1
historical 10.3
famous 10.2
urban 9.6
men 9.4
shop 9.4
house 9.3
historic 9.2
vintage 9.1
facade 8.8
seller 8.7
antique 8.7
world 8.5
religious 8.4
place 8.4
color 8.3
street 8.3
tourist 8.3
family 8
life 7.9
palace 7.8
scene 7.8
portrait 7.8
wall 7.7
vestment 7.6
catholic 7.5
window 7.4
tradition 7.4
inside 7.4
group 7.3
figure 7.2
aged 7.2
gown 7.1
indoors 7
mercantile establishment 7

Google
created on 2019-06-04

Furniture 56.7
History 54.1

Microsoft
created on 2019-06-04

person 95
clothing 94.6
indoor 94
furniture 74
man 73.2
drawing 70.4

Face analysis

Amazon

Google

AWS Rekognition

Age 60-90
Gender Male, 51.2%
Confused 45.2%
Angry 45.2%
Happy 52.1%
Sad 46.2%
Disgusted 45.3%
Surprised 45.2%
Calm 45.8%

AWS Rekognition

Age 38-57
Gender Male, 53.6%
Sad 45.4%
Happy 45.3%
Angry 45.4%
Calm 52.6%
Surprised 45.4%
Confused 45.5%
Disgusted 45.3%

AWS Rekognition

Age 35-52
Gender Female, 53%
Calm 53%
Confused 45.3%
Sad 45.7%
Angry 45.6%
Happy 45.1%
Disgusted 45.2%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 51.9%
Confused 45.3%
Disgusted 45.3%
Sad 48%
Angry 46.8%
Happy 45.2%
Surprised 45.2%
Calm 49.2%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Happy 49.5%
Sad 50.2%
Calm 49.6%
Confused 49.5%
Angry 49.5%
Disgusted 49.6%
Surprised 49.5%

AWS Rekognition

Age 23-38
Gender Male, 50.1%
Confused 49.6%
Angry 49.9%
Calm 49.5%
Disgusted 49.8%
Sad 49.6%
Happy 49.5%
Surprised 49.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a group of people standing in a room 91.8%
a group of people in a room 91.7%
a group of people that are standing in a room 88%

Text analysis

Google

ANS
ANS