Human Generated Data

Title

Charity, Tuberculosis: United States. Massachusetts. Rutland. Massachusetts State Sanatorium: Massachusetts State Sanatorium: A group of Patients

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2766.2

Human Generated Data

Title

Charity, Tuberculosis: United States. Massachusetts. Rutland. Massachusetts State Sanatorium: Massachusetts State Sanatorium: A group of Patients

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 98.7
Person 98.7
Person 98.6
Person 98.5
Person 98.4
Person 97
Person 93.4
Crowd 90.3
Person 89.8
Person 85.2
Person 84.1
Nature 82.5
Person 81.7
Person 81.6
Person 74.1
Sitting 72.9
Clothing 72.5
Apparel 72.5
People 70.2
Audience 68.4
Person 60.6
Outdoors 56
Person 48.5

Clarifai
created on 2019-06-05

people 99.9
many 99.2
group 98.8
adult 98.7
administration 98.7
woman 96.7
group together 96.2
man 95.6
leader 94.5
military 93.5
war 92.2
wear 85.8
home 85.5
education 84.4
child 83
several 80.4
soldier 78.2
chair 74.3
sit 73.8
vehicle 72.8

Imagga
created on 2019-06-05

city 26.6
building 21.8
architecture 18.2
people 15.6
tourism 14.8
man 14.8
street 14.7
window 13.5
urban 13.1
travel 12.7
person 12.3
business 12.1
historic 11.9
old 11.8
musical instrument 11.6
monument 11.2
wall 11.1
history 10.7
brass 10.7
nurse 10.5
tourist 10.4
dirty 9.9
landmark 9.9
statue 9.8
door 9.7
life 9.5
uniform 9.2
room 9.2
clothing 9.2
industrial 9.1
black 9
adult 8.9
military 8.7
lamp 8.6
male 8.6
house 8.5
world 8.5
stone 8.4
gun 8.2
bass 8.2
wind instrument 8
women 7.9
photographer 7.9
work 7.8
structure 7.8
soldier 7.8
destruction 7.8
entrance 7.7
war 7.7
device 7.7
walk 7.6
historical 7.5
station 7.4
town 7.4
exterior 7.4
danger 7.3
road 7.2
religion 7.2
prison 7.1
indoors 7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

building 99.5
person 98.4
clothing 98.3
outdoor 93.4
man 90.6
group 68.9
footwear 67.2
people 66.9

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Female, 52.4%
Sad 50.7%
Angry 45.2%
Calm 46.6%
Confused 45.1%
Happy 47.2%
Surprised 45.1%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54%
Disgusted 45.1%
Happy 45.1%
Surprised 45.1%
Angry 45.4%
Confused 45.2%
Calm 46.9%
Sad 52.3%

AWS Rekognition

Age 45-66
Gender Male, 54.5%
Disgusted 45.3%
Surprised 45.1%
Angry 45.8%
Confused 46%
Sad 50%
Calm 47.6%
Happy 45.2%

AWS Rekognition

Age 35-52
Gender Male, 51.9%
Calm 45.1%
Sad 45.2%
Disgusted 45%
Happy 45%
Surprised 45%
Angry 54.6%
Confused 45.1%

AWS Rekognition

Age 27-44
Gender Male, 50.3%
Calm 47.6%
Angry 48.6%
Disgusted 45.8%
Sad 47%
Surprised 45.4%
Happy 45.3%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Female, 51.3%
Sad 46.5%
Angry 45.2%
Calm 52.6%
Happy 45.2%
Disgusted 45.1%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 48-68
Gender Male, 50%
Calm 45.3%
Confused 45.1%
Angry 45.1%
Surprised 45%
Disgusted 45.1%
Sad 54.4%
Happy 45.1%

AWS Rekognition

Age 23-38
Gender Male, 54.1%
Disgusted 45.1%
Confused 45.1%
Angry 45.2%
Happy 45.1%
Calm 50.3%
Surprised 45.1%
Sad 49.1%

AWS Rekognition

Age 35-52
Gender Male, 52.9%
Calm 49.7%
Disgusted 46.3%
Confused 45.7%
Angry 45.9%
Sad 46.3%
Happy 45.5%
Surprised 45.8%

AWS Rekognition

Age 20-38
Gender Male, 52.5%
Surprised 45.1%
Happy 45.1%
Sad 46.2%
Calm 47.7%
Confused 45.1%
Disgusted 45.7%
Angry 50.1%

AWS Rekognition

Age 38-59
Gender Male, 54.4%
Calm 49.6%
Confused 45.3%
Surprised 45.5%
Sad 46.6%
Happy 46.7%
Angry 45.6%
Disgusted 45.8%

AWS Rekognition

Age 38-59
Gender Male, 54.2%
Surprised 45.2%
Calm 52.5%
Happy 45.5%
Sad 45.6%
Confused 45.4%
Angry 45.6%
Disgusted 45.2%

AWS Rekognition

Age 27-44
Gender Male, 54.8%
Angry 45.8%
Disgusted 51.2%
Confused 45.4%
Calm 45.7%
Happy 45.8%
Surprised 45.2%
Sad 45.9%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Confused 49.5%
Calm 49.5%
Sad 50.4%

AWS Rekognition

Age 35-52
Gender Female, 52%
Calm 52.1%
Happy 45.1%
Angry 45.5%
Sad 46.3%
Surprised 45.5%
Confused 45.1%
Disgusted 45.4%

AWS Rekognition

Age 48-68
Gender Male, 54.6%
Calm 47.2%
Sad 49.2%
Disgusted 46.4%
Happy 45.8%
Surprised 45.1%
Angry 45.9%
Confused 45.3%

AWS Rekognition

Age 38-59
Gender Male, 53.2%
Sad 49.9%
Surprised 45.1%
Confused 45.2%
Disgusted 45.2%
Happy 45.2%
Calm 49%
Angry 45.3%

AWS Rekognition

Age 26-43
Gender Male, 53%
Disgusted 46.4%
Angry 45.2%
Sad 45.3%
Surprised 45.4%
Happy 45.1%
Calm 52.3%
Confused 45.3%

AWS Rekognition

Age 45-65
Gender Male, 51.7%
Disgusted 45.3%
Angry 46.6%
Confused 45.2%
Surprised 45.2%
Calm 48.8%
Sad 48.6%
Happy 45.3%

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a group of people standing in front of a building 97.9%
a group of people that are standing in front of a building 96.4%
a group of people sitting and standing in front of a building 96.3%