Human Generated Data

Title

Charity, Hospitals: United States. New York. New York City. Metropolitan Hospital, Blackwell's Island: Metropolitan Hospital, New York City: Tuberculosis Infirmary Interior of Dining Pavilion.: "Part 1. of panoramic view."

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.786.1

Human Generated Data

Title

Charity, Hospitals: United States. New York. New York City. Metropolitan Hospital, Blackwell's Island: Metropolitan Hospital, New York City: Tuberculosis Infirmary Interior of Dining Pavilion.: "Part 1. of panoramic view."

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.786.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 98.8
Person 98.8
Restaurant 98.8
Person 98.8
Person 98.5
Person 98.4
Person 98.4
Person 97.5
Person 97.4
Person 97.2
Person 97.1
Person 95.8
Person 92.8
Cafeteria 92.7
Building 91.4
Person 90
Person 88.7
Person 85.1
Person 81.5
Factory 75.2
Person 74.2
Person 72.7
Person 72
Food 56.3
Food Court 56.3
Person 45.5

Clarifai
created on 2019-06-07

people 100
many 99.9
group 99.2
adult 97.9
group together 97.5
administration 93.9
crowd 93.8
woman 93.3
man 92.7
education 89.8
war 88.3
military 87.7
teacher 85.6
wear 84.6
furniture 84.2
room 84
leader 83.3
child 82.8
sit 80.3
school 80.2

Imagga
created on 2019-06-07

room 38.2
classroom 37
people 22.8
old 20.2
man 18.1
person 14.9
family 14.2
brass 14
building 13.5
history 13.4
couple 13
city 12.5
love 11.8
architecture 11.7
vintage 11.7
antique 11.6
hospital 11.5
male 11.3
home 11.2
historic 11
wind instrument 11
restaurant 10.4
school 10.4
ancient 10.4
adult 10.1
happy 10
hall 10
sculpture 9.9
statue 9.5
life 8.9
new 8.9
interior 8.8
indoors 8.8
world 8.7
table 8.6
men 8.6
travel 8.4
monument 8.4
girls 8.2
aged 8.1
religion 8.1
women 7.9
holiday 7.9
musical instrument 7.9
scene 7.8
culture 7.7
mother 7.7
student 7.6
historical 7.5
house 7.5
senior 7.5
tourism 7.4
structure 7.4
art 7.4
cheerful 7.3
decoration 7.2
uniform 7.1
portrait 7.1
happiness 7

Google
created on 2019-06-07

Crowd 81.3
Room 71.4
Event 67
Monochrome 54.4
Meal 53.1
Building 50.8

Microsoft
created on 2019-06-07

person 98.2
indoor 97.4
clothing 90.5
man 82.9
group 64.5
table 59.3
old 55
school 54
furniture 51.2
restaurant 22.7
clothes 22
dining room 13.9
crowd 1.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-66
Gender Male, 53.8%
Disgusted 45.1%
Sad 45.1%
Angry 45.1%
Calm 53.4%
Confused 45.1%
Surprised 45.7%
Happy 45.6%

AWS Rekognition

Age 29-45
Gender Male, 54%
Confused 46.1%
Disgusted 46.4%
Surprised 45.5%
Sad 47.1%
Happy 45.6%
Angry 47.4%
Calm 46.9%

AWS Rekognition

Age 35-52
Gender Male, 54.1%
Disgusted 45.1%
Angry 45.6%
Sad 47.7%
Happy 45.2%
Calm 49.6%
Surprised 45.9%
Confused 45.9%

AWS Rekognition

Age 48-68
Gender Male, 54.6%
Surprised 45.5%
Sad 45.4%
Disgusted 45.1%
Calm 51.2%
Happy 45.1%
Angry 47.4%
Confused 45.4%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Sad 45.4%
Happy 45.4%
Angry 45.4%
Surprised 45.3%
Disgusted 47.5%
Confused 45.3%
Calm 50.8%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Disgusted 49.5%
Surprised 49.5%
Confused 49.5%
Calm 49.5%
Angry 49.5%
Happy 49.5%
Sad 50.4%

AWS Rekognition

Age 57-77
Gender Male, 50.4%
Angry 49.6%
Surprised 49.5%
Confused 49.5%
Sad 50.2%
Disgusted 49.5%
Happy 49.5%
Calm 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Sad 49.6%
Confused 49.6%
Calm 49.7%
Angry 49.6%
Disgusted 49.6%
Happy 50%
Surprised 49.6%

AWS Rekognition

Age 45-63
Gender Male, 50.4%
Surprised 49.6%
Confused 49.6%
Disgusted 49.6%
Angry 49.6%
Calm 50%
Happy 49.6%
Sad 49.6%

AWS Rekognition

Age 20-38
Gender Male, 54.4%
Sad 45.6%
Surprised 45.8%
Disgusted 45.9%
Confused 45.4%
Happy 49.4%
Calm 46.6%
Angry 46.4%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Calm 49.6%
Confused 49.7%
Happy 49.7%
Disgusted 49.6%
Sad 49.6%
Angry 49.6%
Surprised 49.7%

AWS Rekognition

Age 16-27
Gender Female, 50.1%
Calm 49.6%
Surprised 49.6%
Confused 49.5%
Angry 49.6%
Sad 49.9%
Happy 49.8%
Disgusted 49.6%

AWS Rekognition

Age 45-65
Gender Female, 50.2%
Angry 49.6%
Sad 49.8%
Happy 49.6%
Disgusted 49.6%
Calm 49.9%
Surprised 49.6%
Confused 49.5%

AWS Rekognition

Age 30-47
Gender Male, 50.4%
Calm 49.8%
Angry 49.6%
Disgusted 49.6%
Happy 49.6%
Confused 49.6%
Sad 49.8%
Surprised 49.5%

AWS Rekognition

Age 48-68
Gender Female, 50.2%
Disgusted 49.6%
Surprised 49.5%
Confused 49.5%
Sad 50.3%
Happy 49.5%
Calm 49.5%
Angry 49.5%

AWS Rekognition

Age 30-47
Gender Female, 50.5%
Sad 49.8%
Disgusted 49.8%
Happy 49.6%
Calm 49.6%
Surprised 49.5%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Surprised 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 50.4%
Angry 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 57-77
Gender Male, 50.3%
Surprised 49.5%
Happy 49.6%
Calm 49.6%
Angry 49.6%
Disgusted 49.5%
Sad 50.2%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50%
Calm 49.5%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Sad 50.4%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50%
Surprised 49.6%
Happy 49.6%
Sad 49.7%
Confused 49.6%
Disgusted 49.7%
Angry 49.6%
Calm 49.7%

AWS Rekognition

Age 4-9
Gender Female, 50.4%
Happy 49.6%
Angry 49.7%
Surprised 49.5%
Disgusted 49.9%
Confused 49.5%
Calm 49.6%
Sad 49.8%

AWS Rekognition

Age 14-25
Gender Female, 50.5%
Angry 49.5%
Surprised 49.6%
Sad 49.7%
Disgusted 49.5%
Confused 49.6%
Happy 50%
Calm 49.6%

AWS Rekognition

Age 15-25
Gender Male, 50.3%
Sad 49.8%
Surprised 49.6%
Calm 49.6%
Disgusted 49.5%
Confused 49.6%
Angry 49.6%
Happy 49.9%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Happy 49.7%
Surprised 49.6%
Sad 49.7%
Confused 49.5%
Disgusted 49.6%
Calm 49.7%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Sad 50.2%
Confused 49.6%
Disgusted 49.6%
Angry 49.6%
Happy 49.5%
Surprised 49.5%
Calm 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.2%
Confused 49.5%
Sad 49.5%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Calm 50.4%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Angry 49.6%
Surprised 49.5%
Sad 49.8%
Confused 49.5%
Happy 49.9%
Calm 49.6%
Disgusted 49.6%

AWS Rekognition

Age 10-15
Gender Female, 50.5%
Confused 49.6%
Surprised 49.6%
Happy 49.7%
Sad 50%
Disgusted 49.5%
Angry 49.5%
Calm 49.6%

AWS Rekognition

Age 4-9
Gender Male, 50.1%
Confused 49.5%
Disgusted 50.1%
Calm 49.8%
Angry 49.5%
Happy 49.5%
Sad 49.5%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Female, 58.6%
Sad 2.7%
Surprised 2.7%
Disgusted 2.2%
Confused 4.9%
Happy 1.6%
Calm 84.8%
Angry 1%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Surprised 49.6%
Disgusted 49.7%
Happy 49.7%
Sad 49.7%
Angry 49.8%
Calm 49.5%
Confused 49.6%

AWS Rekognition

Age 17-27
Gender Female, 50.5%
Surprised 49.5%
Confused 49.6%
Disgusted 49.7%
Angry 49.6%
Calm 49.8%
Happy 49.6%
Sad 49.7%

AWS Rekognition

Age 26-43
Gender Male, 52.1%
Sad 49.9%
Happy 45.2%
Angry 45.6%
Surprised 45.2%
Disgusted 45.8%
Confused 45.3%
Calm 47.9%

AWS Rekognition

Age 23-38
Gender Female, 50%
Happy 49.5%
Calm 49.6%
Disgusted 49.5%
Angry 49.6%
Surprised 49.6%
Sad 50.1%
Confused 49.6%

AWS Rekognition

Age 4-7
Gender Female, 50.5%
Disgusted 49.5%
Happy 49.6%
Confused 49.5%
Sad 50.2%
Angry 49.5%
Surprised 49.5%
Calm 49.6%

AWS Rekognition

Age 35-55
Gender Female, 50.5%
Sad 49.7%
Happy 49.7%
Angry 49.6%
Surprised 49.6%
Disgusted 49.6%
Confused 49.7%
Calm 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Disgusted 49.6%
Surprised 49.6%
Angry 49.6%
Happy 49.6%
Sad 49.9%
Calm 49.7%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Happy 49.5%
Angry 49.7%
Calm 49.6%
Surprised 49.5%
Disgusted 49.7%
Sad 49.9%
Confused 49.5%

AWS Rekognition

Age 45-65
Gender Female, 50.4%
Calm 49.5%
Angry 49.8%
Confused 49.6%
Surprised 49.5%
Sad 49.6%
Happy 49.6%
Disgusted 49.9%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.6%
Surprised 49.6%
Angry 49.6%
Happy 49.7%
Sad 49.9%
Calm 49.6%
Confused 49.5%

AWS Rekognition

Age 12-22
Gender Female, 50.1%
Surprised 49.5%
Disgusted 49.5%
Sad 49.7%
Angry 49.7%
Confused 49.5%
Calm 49.8%
Happy 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Calm 49.7%
Happy 49.6%
Disgusted 49.5%
Surprised 49.5%
Angry 49.6%
Sad 50.1%
Confused 49.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%