Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Neighborhood House": Neighborhood House, Chicago, Ill.: A Boys Club.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2882.3

Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Neighborhood House": Neighborhood House, Chicago, Ill.: A Boys Club.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2882.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.1
Person 99.1
Room 99
Classroom 99
Indoors 99
School 99
Person 99
Person 98.9
Person 98.5
Person 98.3
Person 97
Person 95.2
Person 94.6
Audience 92.3
Crowd 92.3
Person 81.1
Person 80
Clock Tower 79.5
Tower 79.5
Building 79.5
Architecture 79.5
Person 75
Accessory 70.7
Accessories 70.7
Tie 70.7
Tie 70.5
Person 68.8
Furniture 62.3
Speech 62
Waiting Room 57.6
Chair 55.7
Person 47.3
Person 43.7

Clarifai
created on 2019-06-05

people 99.9
many 99.6
group 99.2
child 98.2
education 97.9
school 97.3
group together 97.3
elementary school 95.4
adult 94.5
administration 93.8
teacher 93.6
woman 92.4
man 92.2
room 91.7
several 89
war 88.9
classroom 88.3
leader 86.8
wear 85
indoors 84.7

Imagga
created on 2019-06-05

room 88.4
classroom 76.4
interior 37.1
table 26.5
home 25.5
chair 24.4
people 20.6
furniture 20.6
house 20
person 19.1
man 18.1
indoors 17.6
window 17.4
hall 16.6
modern 14.7
design 14.6
business 14.6
adult 14
luxury 13.7
male 13.5
architecture 13.3
service 13
indoor 12.8
restaurant 12.6
work 12.6
decor 12.4
lifestyle 12.3
office 12
glass 11.8
chairs 11.7
wood 11.7
floor 11.1
wall 10.6
women 10.3
3d 10.1
light 10
nurse 9.8
group 9.7
style 9.6
comfortable 9.5
living 9.5
desk 9.4
happy 9.4
student 9.3
dinner 9.3
inside 9.2
teacher 9.1
tables 8.9
hotel 8.6
life 8.4
horizontal 8.4
relaxation 8.4
metal 8
success 8
smiling 8
space 7.8
sofa 7.7
empty 7.7
couch 7.7
men 7.7
apartment 7.7
dining 7.6
blackboard 7.6
kitchen 7.2
shop 7.1
portrait 7.1
center 7.1
day 7.1
businessman 7.1
travel 7

Google
created on 2019-06-05

Photograph 95.8
Social group 93
Snapshot 84.7
Team 72.7
History 72.6
Room 65.7
Family 62.7
Crew 56.9
Vintage clothing 52.1

Microsoft
created on 2019-06-05

clothing 96.7
group 95.5
person 92
smile 88.3
posing 81.7
standing 81.5
old 78
woman 72
human face 69.1
white 64.3
school 59.1
clock 58.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Angry 45.6%
Surprised 45.2%
Confused 45.2%
Sad 51.7%
Disgusted 45.1%
Happy 45.1%
Calm 47.2%

AWS Rekognition

Age 14-25
Gender Male, 54.3%
Sad 48.6%
Confused 45.4%
Calm 49.4%
Disgusted 45.2%
Happy 45.1%
Angry 45.9%
Surprised 45.4%

AWS Rekognition

Age 35-52
Gender Male, 52.5%
Surprised 45.1%
Calm 45.1%
Happy 45%
Sad 53.8%
Confused 45.3%
Angry 45.5%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Male, 53.3%
Disgusted 45.2%
Happy 45.2%
Surprised 45.7%
Angry 46%
Confused 45.4%
Calm 51.1%
Sad 46.5%

AWS Rekognition

Age 35-53
Gender Female, 50.7%
Disgusted 45.2%
Surprised 45.2%
Angry 45.3%
Confused 45.2%
Sad 47.3%
Calm 51.7%
Happy 45.2%

AWS Rekognition

Age 17-27
Gender Male, 51.2%
Sad 51.5%
Disgusted 45.3%
Confused 45.4%
Surprised 45.3%
Calm 47%
Happy 45.2%
Angry 45.4%

AWS Rekognition

Age 6-13
Gender Female, 50.4%
Sad 52.9%
Surprised 45.2%
Disgusted 45.1%
Calm 46%
Happy 45%
Confused 45.2%
Angry 45.6%

AWS Rekognition

Age 45-63
Gender Female, 50.8%
Surprised 45.1%
Confused 45.1%
Sad 52.5%
Disgusted 45.1%
Calm 46.8%
Angry 45.1%
Happy 45.3%

AWS Rekognition

Age 20-38
Gender Female, 54.4%
Confused 45.3%
Happy 45.6%
Angry 45.4%
Sad 51.6%
Calm 46%
Disgusted 45.7%
Surprised 45.3%

AWS Rekognition

Age 14-25
Gender Female, 53.9%
Disgusted 45.3%
Confused 45.6%
Angry 45.7%
Sad 49.3%
Surprised 46.2%
Happy 45.1%
Calm 47.8%

AWS Rekognition

Age 23-38
Gender Male, 54%
Sad 46.5%
Surprised 45.5%
Angry 47.6%
Disgusted 45.8%
Confused 45.3%
Happy 45.3%
Calm 49%

AWS Rekognition

Age 15-25
Gender Male, 53.5%
Surprised 45.2%
Calm 50.4%
Happy 46.5%
Sad 47.3%
Angry 45.3%
Confused 45.2%
Disgusted 45.2%

AWS Rekognition

Age 4-9
Gender Female, 50.6%
Sad 45.8%
Disgusted 45.2%
Calm 53.3%
Confused 45.1%
Angry 45.3%
Surprised 45.2%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Male, 51.4%
Confused 45.2%
Disgusted 45.3%
Calm 46.4%
Angry 45.3%
Happy 45.1%
Surprised 45.1%
Sad 52.6%

AWS Rekognition

Age 15-25
Gender Female, 51.8%
Sad 46.1%
Angry 47.9%
Happy 45.3%
Confused 45.4%
Surprised 45.7%
Disgusted 45.9%
Calm 48.6%

AWS Rekognition

Age 26-43
Gender Male, 52.4%
Confused 45.1%
Disgusted 45.1%
Happy 45.2%
Calm 52.5%
Surprised 45.1%
Sad 46.6%
Angry 45.3%

AWS Rekognition

Age 35-52
Gender Female, 50.6%
Sad 48.8%
Surprised 45.6%
Disgusted 45.3%
Calm 46.7%
Happy 47.9%
Confused 45.4%
Angry 45.4%

AWS Rekognition

Age 15-25
Gender Female, 52.1%
Sad 53.4%
Calm 46.2%
Disgusted 45.1%
Happy 45.1%
Confused 45.1%
Angry 45.2%
Surprised 45.1%

AWS Rekognition

Age 9-14
Gender Female, 50.6%
Disgusted 45.4%
Surprised 47.1%
Angry 45.8%
Confused 45.5%
Sad 47%
Calm 46.7%
Happy 47.4%

AWS Rekognition

Age 20-38
Gender Female, 54.4%
Disgusted 45.2%
Confused 45.2%
Happy 45.1%
Calm 45.7%
Surprised 45.2%
Sad 53.3%
Angry 45.3%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Calm 47.5%
Angry 45.4%
Confused 45.2%
Sad 51.2%
Happy 45.2%
Disgusted 45.2%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.7%
Happy 45.1%
Disgusted 45.2%
Confused 45.3%
Surprised 45.2%
Sad 51.7%
Angry 46.9%
Calm 45.6%

AWS Rekognition

Age 17-27
Gender Female, 52.3%
Calm 46.1%
Sad 53%
Disgusted 45.2%
Happy 45.1%
Surprised 45.1%
Angry 45.3%
Confused 45.2%

AWS Rekognition

Age 15-25
Gender Female, 53.1%
Surprised 46.2%
Disgusted 45.4%
Confused 46.2%
Sad 47.5%
Calm 47.6%
Happy 46.4%
Angry 45.8%

AWS Rekognition

Age 27-44
Gender Male, 52.9%
Calm 45.7%
Surprised 45.5%
Disgusted 45.6%
Confused 45.5%
Sad 46.6%
Happy 50.7%
Angry 45.5%

AWS Rekognition

Age 26-43
Gender Female, 54.3%
Happy 47.4%
Angry 45.5%
Calm 46.9%
Confused 45.4%
Surprised 45.6%
Disgusted 46.7%
Sad 47.5%

AWS Rekognition

Age 10-15
Gender Female, 50.8%
Disgusted 45%
Sad 46.5%
Surprised 45.1%
Calm 52.5%
Happy 45.6%
Confused 45.2%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Female, 52.3%
Disgusted 45.3%
Confused 45.1%
Happy 45.1%
Calm 51.8%
Surprised 45.2%
Sad 47.2%
Angry 45.3%

AWS Rekognition

Age 10-15
Gender Male, 53%
Sad 46.6%
Surprised 45.7%
Confused 45.4%
Disgusted 45.5%
Happy 45.4%
Calm 50.8%
Angry 45.6%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 26
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Clock Tower 79.5%
Tie 70.7%
Chair 55.7%

Categories

Imagga

interior objects 99.6%

Text analysis

Amazon

SJ,a
lroll