Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Hudson Guild": The Hudson Guild, New York City.: A Club Meeting.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3181.3

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Hudson Guild": The Hudson Guild, New York City.: A Club Meeting.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3181.3

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.2
Person 99.2
Person 99.1
Person 98.6
Person 97.7
Person 95.9
Person 94.6
Person 91.6
Person 89.5
Person 89.5
Person 88.3
Person 88.1
Restaurant 84.4
Person 83.2
Building 79.6
Crowd 74.9
Cafeteria 70.6
Prison 58.9
People 56.6
Factory 56.4
Sitting 55.1

Clarifai
created on 2019-06-06

people 100
group 99.9
many 99
child 98.7
group together 97.9
administration 97.5
adult 96.2
education 96.1
man 95.1
several 94.9
sit 94.2
boy 93.3
teacher 91.8
woman 91.1
war 91
leader 90.5
elementary school 90.1
five 87.4
school 84.6
military 84.3

Imagga
created on 2019-06-06

man 27.5
people 21.2
male 20.6
person 19
newspaper 18.5
product 16.2
old 16
room 15.3
adult 14.4
sky 13.4
creation 12
life 11.8
group 11.3
travel 11.3
senior 11.2
looking 11.2
sitting 11.2
men 11.2
outdoors 10.4
school 10.4
business 10.3
leisure 10
interior 9.7
couple 9.6
home 9.6
daily 9.5
lifestyle 9.4
water 9.3
freight car 9.2
vintage 9.1
human 9
classroom 8.9
structure 8.4
relaxation 8.4
house 8.3
aged 8.1
sea 7.9
face 7.8
building 7.7
book jacket 7.7
elderly 7.7
outdoor 7.6
chair 7.5
teacher 7.2
team 7.2
portrait 7.1
family 7.1
love 7.1
businessman 7.1
jacket 7.1
student 7
architecture 7
indoors 7

Google
created on 2019-06-06

Photograph 95.7
People 93.9
Snapshot 83.9
Room 65.7
Photography 62.4
Family 60.7
History 54.1
Sitting 54.1
Team 52.3

Microsoft
created on 2019-06-06

person 100
group 97
clothing 96.8
sitting 95.4
table 94.4
furniture 94.3
posing 93.3
chair 92.5
people 90.1
old 87.7
man 87.3
family 17.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-57
Gender Female, 51.8%
Calm 46.7%
Sad 47.9%
Angry 48.7%
Surprised 45.4%
Disgusted 45.5%
Confused 45.4%
Happy 45.4%

AWS Rekognition

Age 11-18
Gender Female, 74.4%
Sad 35.2%
Confused 10%
Calm 30.3%
Disgusted 3.1%
Angry 5.6%
Surprised 5.8%
Happy 10.1%

AWS Rekognition

Age 35-52
Gender Male, 51.5%
Angry 45.1%
Disgusted 45%
Surprised 45%
Calm 45.1%
Sad 54.7%
Happy 45%
Confused 45%

AWS Rekognition

Age 45-65
Gender Male, 54.1%
Happy 46.4%
Disgusted 45.3%
Surprised 45.1%
Sad 49.3%
Confused 45.2%
Angry 45.3%
Calm 48.4%

AWS Rekognition

Age 15-25
Gender Female, 50.1%
Sad 49.6%
Happy 45.1%
Surprised 45.1%
Disgusted 45.2%
Confused 45.1%
Calm 46.7%
Angry 48.2%

AWS Rekognition

Age 38-57
Gender Male, 53.4%
Confused 45%
Disgusted 45.1%
Calm 54.6%
Sad 45.2%
Angry 45.1%
Happy 45%
Surprised 45.1%

AWS Rekognition

Age 48-68
Gender Male, 54.8%
Confused 45.2%
Happy 45.5%
Surprised 45.3%
Calm 46.5%
Angry 51.5%
Sad 45.8%
Disgusted 45.3%

AWS Rekognition

Age 23-38
Gender Female, 60.7%
Sad 6%
Happy 2.5%
Surprised 9.5%
Disgusted 2.6%
Confused 7.5%
Calm 67.7%
Angry 4.2%

AWS Rekognition

Age 17-27
Gender Male, 97.7%
Sad 21.4%
Angry 7.3%
Disgusted 2.2%
Surprised 4.3%
Happy 9.4%
Calm 49.8%
Confused 5.7%

AWS Rekognition

Age 6-13
Gender Male, 53.3%
Calm 54%
Surprised 45.4%
Happy 45.1%
Disgusted 45.1%
Angry 45.2%
Sad 45.2%
Confused 45.1%

AWS Rekognition

Age 26-44
Gender Male, 54.8%
Disgusted 45.1%
Happy 45%
Angry 45.1%
Calm 54.5%
Surprised 45.1%
Confused 45.1%
Sad 45.1%

AWS Rekognition

Age 35-52
Gender Female, 53.5%
Confused 45.1%
Sad 53%
Disgusted 45%
Angry 45.1%
Happy 45.1%
Calm 46.6%
Surprised 45%

AWS Rekognition

Age 20-38
Gender Male, 54.5%
Angry 45.1%
Disgusted 45.1%
Calm 54.2%
Surprised 45.1%
Happy 45.1%
Sad 45.3%
Confused 45.1%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Text analysis

Amazon

A
C'lub
A C'lub Meetind
Meetind

Google

A Club Meetmg
Club
A
Meetmg