Human Generated Data

Title

Social Settlements: United States. Ohio. Cleveland. "Hiram House": Hiram House, Cleveland, Ohio.: Waiting to draw books from the library.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3205.2

Human Generated Data

Title

Social Settlements: United States. Ohio. Cleveland. "Hiram House": Hiram House, Cleveland, Ohio.: Waiting to draw books from the library.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3205.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 99.1
Human 99.1
Person 98.6
Person 97.9
Person 97.6
Person 97.5
Person 97
Person 95.7
Person 95.3
Crowd 88.9
Person 85
Person 84.2
Audience 83
Painting 81.7
Art 81.7
People 79.1
Person 76.6
Person 76.3
Person 72.2
Indoors 71.7
Room 71.7
Clothing 71
Apparel 71
Text 70.6
Person 67.5
Person 65
Hat 57.9
Person 56.6
Pub 55.6
Person 54.4
Person 53

Clarifai
created on 2019-06-06

people 99.9
group 99.5
many 99.4
adult 95.4
woman 95.1
child 95
group together 94.9
man 92.6
several 87.7
administration 87.6
music 87.1
military 85.9
wear 85.5
leader 82.8
crowd 82.4
ceremony 80
recreation 77.3
education 76.4
war 75.5
boy 74.4

Imagga
created on 2019-06-06

room 31.1
classroom 30.8
man 22.8
people 21.7
person 18.9
male 18.4
adult 14.5
old 13.9
men 13.7
military 12.5
vintage 12.5
business 11.5
group 11.3
human 11.2
soldier 10.7
war 10.6
teacher 10.4
respirator 10.3
power 10.1
dirty 9.9
gun 9.7
portrait 9.7
mask 9.6
scene 9.5
hospital 9.4
symbol 9.4
grunge 9.4
uniform 9.3
city 9.1
protection 9.1
danger 9.1
industrial 9.1
sign 9
transportation 9
team 8.9
activity 8.9
army 8.8
art 8.5
travel 8.4
dark 8.3
life 8.2
window 8.2
retro 8.2
iron lung 8
drawing 7.9
world 7.8
education 7.8
ancient 7.8
crowd 7.7
hand 7.6
student 7.5
weapon 7.4
time 7.3
game 7.1
family 7.1
antique 7.1
architecture 7

Google
created on 2019-06-06

Photograph 96.3
People 93.4
Snapshot 84.9
Crowd 69.2
Stock photography 64
Event 62.7
Photography 62.4
History 57.6
Family 52.5
Art 50.2

Microsoft
created on 2019-06-06

clothing 97
person 95.5
human face 91.4
posing 90
group 88.1
man 78.7
smile 71.5
people 69.9
old 66.4
woman 61.7
team 25.8
clothes 17.5
crowd 1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 92.9%
Disgusted 4.3%
Calm 28.4%
Confused 19.6%
Happy 21.2%
Surprised 14.3%
Angry 5.2%
Sad 7%

AWS Rekognition

Age 26-43
Gender Female, 87.5%
Angry 17.6%
Happy 14.5%
Calm 31.6%
Confused 6.3%
Sad 4.9%
Disgusted 16.6%
Surprised 8.6%

AWS Rekognition

Age 14-25
Gender Female, 56.2%
Happy 0.4%
Calm 5.8%
Sad 90.2%
Surprised 0.5%
Angry 1.6%
Confused 0.6%
Disgusted 0.9%

AWS Rekognition

Age 35-52
Gender Female, 52.1%
Angry 45.1%
Surprised 45.1%
Calm 45.2%
Happy 45.2%
Confused 45.1%
Disgusted 45.1%
Sad 54.3%

AWS Rekognition

Age 30-47
Gender Male, 58.7%
Angry 5.2%
Calm 24.2%
Surprised 19.5%
Sad 7.8%
Disgusted 4.9%
Happy 26.3%
Confused 12.1%

AWS Rekognition

Age 27-44
Gender Male, 51%
Angry 49.8%
Confused 45.1%
Calm 45.2%
Surprised 45%
Sad 49.7%
Happy 45%
Disgusted 45.1%

AWS Rekognition

Age 12-22
Gender Female, 52.9%
Happy 45.1%
Angry 47.4%
Calm 45.2%
Sad 51.5%
Surprised 45.1%
Confused 45.2%
Disgusted 45.6%

AWS Rekognition

Age 14-25
Gender Female, 52.1%
Calm 46.8%
Confused 45.4%
Happy 45.3%
Surprised 45.9%
Angry 45.9%
Disgusted 45.6%
Sad 50.2%

AWS Rekognition

Age 6-13
Gender Female, 53.5%
Angry 45.3%
Happy 45.1%
Disgusted 45.1%
Confused 45.2%
Calm 52.2%
Surprised 45.3%
Sad 46.8%

AWS Rekognition

Age 11-18
Gender Female, 51.9%
Calm 53.3%
Surprised 45.1%
Happy 45.1%
Angry 45.2%
Confused 45.2%
Sad 46.1%
Disgusted 45.1%

AWS Rekognition

Age 12-22
Gender Female, 54.8%
Calm 46%
Angry 45.7%
Happy 45.8%
Sad 51.7%
Surprised 45.3%
Confused 45.2%
Disgusted 45.3%

AWS Rekognition

Age 12-22
Gender Female, 52%
Calm 50.6%
Sad 47.2%
Happy 45.6%
Confused 45.3%
Angry 45.2%
Surprised 45.6%
Disgusted 45.4%

AWS Rekognition

Age 20-38
Gender Female, 53.2%
Calm 45.4%
Sad 46.9%
Angry 51.4%
Surprised 45.2%
Disgusted 45.2%
Confused 45.2%
Happy 45.6%

AWS Rekognition

Age 23-38
Gender Female, 54.4%
Calm 50.8%
Confused 45.3%
Happy 45.3%
Surprised 45.7%
Angry 45.6%
Disgusted 45.7%
Sad 46.7%

AWS Rekognition

Age 12-22
Gender Male, 50.1%
Confused 49.5%
Disgusted 49.5%
Angry 49.5%
Calm 49.7%
Sad 50.2%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 52.9%
Sad 54.5%
Surprised 45.1%
Confused 45.1%
Angry 45.1%
Happy 45.1%
Calm 45.1%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Female, 52.2%
Calm 47%
Happy 45.5%
Confused 45.4%
Sad 49.6%
Angry 46.5%
Surprised 45.5%
Disgusted 45.5%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Sad 50.4%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.5%
Disgusted 49.5%
Calm 49.5%

AWS Rekognition

Age 38-57
Gender Female, 52.9%
Angry 45.5%
Disgusted 45.5%
Calm 48%
Surprised 45.6%
Happy 45.3%
Sad 49.4%
Confused 45.7%

AWS Rekognition

Age 19-36
Gender Female, 50.3%
Sad 49.9%
Confused 49.6%
Calm 49.6%
Disgusted 49.6%
Angry 49.6%
Surprised 49.6%
Happy 49.7%

AWS Rekognition

Age 23-38
Gender Female, 53.2%
Confused 45.5%
Sad 45.7%
Disgusted 45.1%
Angry 45.1%
Happy 46.4%
Calm 51.9%
Surprised 45.3%

Microsoft Cognitive Services

Age 41
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 13
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 81.7%

Text analysis

Amazon

the
row
from
kooks
Worting to row kooks from the library
Worting
library
to

Google

Woiting to arow books trom the library
Woiting
to
arow
books
trom
the
library