Human Generated Data

Title

Social Settlements: United States. Kentucky. Hindman. Log Cabin Social Settlement: The Log Cabin Social Settlement: Hindman, Ky.: Boys in primary department of settlement school.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.101.2

Human Generated Data

Title

Social Settlements: United States. Kentucky. Hindman. Log Cabin Social Settlement: The Log Cabin Social Settlement: Hindman, Ky.: Boys in primary department of settlement school.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.101.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.7
Person 99.7
Person 99.5
Person 99.5
Person 99.1
Person 98.7
Person 98.3
Advertisement 98
Poster 98
Person 95.4
Person 95.3
People 93.8
Person 92
Military Uniform 82.7
Military 82.7
Armored 73.3
Army 73.3
Text 66.6
Clothing 64.9
Apparel 64.9
Person 62.7
Troop 55.1

Clarifai
created on 2019-06-05

people 100
group 99.9
print 99.6
adult 98.6
many 98.5
several 98.1
lithograph 97.1
group together 96.8
wear 96.8
man 96.4
illustration 95.9
engraving 95.9
art 94.8
military 93.6
administration 93.4
portrait 92.5
leader 92.2
four 91.4
war 90.1
child 90

Imagga
created on 2019-06-05

book jacket 89.2
jacket 70.4
wrapping 52.7
covering 37.9
sketch 37.1
drawing 33.1
representation 22
comic book 18.9
vintage 18.2
art 17.6
old 17.4
man 15.4
people 12.8
male 12.8
stamp 12.6
mail 12.4
portrait 12.3
ancient 12.1
detail 12.1
postmark 11.8
black 11.4
letter 11
symbol 10.8
retro 10.6
person 10.3
uniform 10.3
church 10.2
power 10.1
aged 9.9
circa 9.9
history 9.8
printed 9.8
postage 9.8
envelope 9.7
antique 9.5
card 9.3
paint 9
daily 8.9
philately 8.9
postal 8.8
soldier 8.8
military 8.7
war 8.7
face 8.5
color 8.3
sport 8.2
closeup 8.1
religion 8.1
game 8
shows 7.9
culture 7.7
mask 7.7
god 7.6
mother 7.6
print media 7.5
dark 7.5
fun 7.5
one 7.5
decoration 7.3
newspaper 7.2
adult 7.1

Google
created on 2019-06-05

People 96.7
Photograph 95.7
Snapshot 83.9
Family 63.5
Photography 62.4
Vintage clothing 58
Illustration 57.7
Child 57.3
Art 50.2

Microsoft
created on 2019-06-05

text 99.8
clothing 98.2
person 97.9
book 94.9
old 91.7
human face 70.7
man 63.6
child 62.4
posing 62.1
group 60
smile 58.2
vintage 46.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-7
Gender Male, 75.7%
Confused 1.5%
Disgusted 1.1%
Sad 86.7%
Surprised 0.9%
Calm 1.6%
Angry 1.8%
Happy 6.2%

AWS Rekognition

Age 20-38
Gender Male, 92.1%
Surprised 0.3%
Happy 0.7%
Sad 93.3%
Angry 1.2%
Disgusted 0.3%
Confused 0.8%
Calm 3.5%

AWS Rekognition

Age 6-13
Gender Female, 59.3%
Calm 98.1%
Confused 0.2%
Happy 0.1%
Angry 0.3%
Sad 0.9%
Surprised 0.1%
Disgusted 0.3%

AWS Rekognition

Age 10-15
Gender Female, 92.8%
Sad 87.4%
Disgusted 0.4%
Angry 7.7%
Confused 0.3%
Calm 3.6%
Surprised 0.2%
Happy 0.4%

AWS Rekognition

Age 26-43
Gender Female, 78.3%
Disgusted 5.6%
Happy 0.9%
Angry 4.1%
Surprised 3.3%
Sad 2.7%
Confused 1.3%
Calm 82.1%

AWS Rekognition

Age 14-25
Gender Male, 52.3%
Disgusted 45.5%
Calm 50.1%
Confused 45.5%
Happy 45.6%
Sad 47.5%
Angry 45.5%
Surprised 45.4%

AWS Rekognition

Age 26-43
Gender Male, 99.9%
Sad 2.8%
Calm 83.8%
Angry 2.8%
Disgusted 1.4%
Surprised 1%
Confused 6.2%
Happy 2%

AWS Rekognition

Age 26-43
Gender Male, 54.1%
Happy 45.1%
Disgusted 45.2%
Surprised 45.2%
Angry 49.2%
Sad 46.8%
Confused 45.3%
Calm 48.2%

AWS Rekognition

Age 35-52
Gender Female, 53.4%
Angry 45.3%
Calm 53.7%
Surprised 45.3%
Disgusted 45.1%
Happy 45.1%
Sad 45.4%
Confused 45.1%

AWS Rekognition

Age 20-38
Gender Female, 51.4%
Surprised 45.2%
Sad 45.9%
Calm 53.2%
Happy 45.1%
Disgusted 45.2%
Confused 45.1%
Angry 45.4%

AWS Rekognition

Age 20-38
Gender Female, 53.7%
Happy 45.1%
Disgusted 45.2%
Calm 48.5%
Sad 50.6%
Confused 45.1%
Surprised 45.1%
Angry 45.4%

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 15
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Poster 98%

Categories

Imagga

paintings art 98.6%

Text analysis

Amazon

in
deport-
primcry
Boys in primcry deport-
ment
settlement
scheol.
ment Of settlement scheol.
Boys
Of
ue

Google

Boys in primary deport ment of settlement school.
Boys
deport
of
settlement
school.
in
primary
ment