Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "University of Chicago Settlement": University of Chicago Settlement, Chicago Ill.: Manual Training

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2897.2

Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "University of Chicago Settlement": University of Chicago Settlement, Chicago Ill.: Manual Training

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.1
Person 99.1
Person 99
Person 98.2
Person 97.2
Person 94.3
Building 92.7
Factory 79.3
Military Uniform 68.3
Military 68.3
Officer 68.3
Clothing 65.5
Apparel 65.5
Person 62.8
Person 59.4
Worker 58.9
Pub 58.4

Clarifai
created on 2019-06-05

people 100
group 99.6
adult 99.1
group together 98.1
administration 97
many 97
child 96.3
man 96
woman 95.6
furniture 93.6
room 93.4
sit 93.3
several 93.3
war 93.1
military 91.8
leader 91.1
wear 90.8
five 87.9
four 87.6
recreation 86.7

Imagga
created on 2019-06-05

barbershop 25
shop 25
man 24.2
architecture 22.6
old 22.3
male 19.1
people 19
mercantile establishment 18.3
building 17.5
ancient 16.4
person 15.9
room 15.7
world 15.1
history 14.3
statue 14.3
historic 13.7
city 13.3
place of business 12.2
monument 12.1
religion 11.6
adult 11.3
historical 11.3
black 10.8
classroom 10.5
men 10.3
tourism 9.9
travel 9.9
sculpture 9.6
culture 9.4
vintage 9.2
art 9.1
portrait 9.1
musical instrument 9
family 8.9
kin 8.9
nurse 8.7
scene 8.7
stone 8.4
dark 8.3
traditional 8.3
landmark 8.1
home 8
love 7.9
couple 7.8
sitting 7.7
palace 7.7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

clothing 99.1
person 95.3
man 90.5
old 59.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-25
Gender Male, 99.2%
Disgusted 0.2%
Confused 1.5%
Surprised 0.4%
Calm 83.2%
Happy 0.1%
Angry 8.9%
Sad 5.7%

AWS Rekognition

Age 20-38
Gender Female, 70.4%
Disgusted 2.1%
Calm 30.4%
Surprised 1.8%
Angry 6%
Sad 56.5%
Confused 2.4%
Happy 0.8%

AWS Rekognition

Age 23-38
Gender Female, 53.2%
Surprised 45.2%
Disgusted 45.1%
Confused 45.1%
Sad 53.7%
Calm 45.7%
Happy 45.1%
Angry 45.2%

AWS Rekognition

Age 4-9
Gender Male, 54.8%
Calm 47.8%
Angry 45.8%
Disgusted 45.1%
Sad 50.8%
Surprised 45.2%
Happy 45%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Female, 51.5%
Angry 47.9%
Disgusted 45.1%
Sad 51.7%
Confused 45.1%
Happy 45%
Surprised 45.1%
Calm 45.2%

AWS Rekognition

Age 38-57
Gender Female, 50.5%
Surprised 49.5%
Calm 49.6%
Happy 49.6%
Sad 50.2%
Angry 49.5%
Confused 49.6%
Disgusted 49.5%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a group of people standing in front of a building 88.3%
a group of people standing in front of a store 79.9%
a group of people standing in a room 79.8%