Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End Industrial School": South End Industrial School, Roxbury, Mass.: Little Carpenters.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.456.2

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End Industrial School": South End Industrial School, Roxbury, Mass.: Little Carpenters.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.456.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.7
Human 99.7
Person 99.6
Person 99.6
Person 98.5
Person 96.7
Person 95.1
Person 95
Person 94.7
People 94
Person 92.7
Person 88.3
Person 85.7
Accessory 84.5
Tie 84.5
Accessories 84.5
Person 84
Military 80.9
Military Uniform 80.9
Poster 73.1
Advertisement 73.1
Army 72.3
Armored 72.3
Apparel 65.3
Clothing 65.3
Family 64.6
Person 63.8
Soldier 61.7
Troop 56.2
Person 54.8

Clarifai
created on 2019-06-05

people 99.9
child 99.4
group 99.2
many 98.7
group together 96
adult 94.5
several 92.9
wear 92.5
education 91.7
boy 90.6
portrait 90.5
woman 90.4
war 88.7
facial expression 87.2
outfit 87.1
man 86.1
elementary school 85.3
administration 84.5
family 83.1
offspring 81.6

Imagga
created on 2019-06-05

newspaper 51.2
product 40.7
creation 32.1
vintage 24.8
old 22.3
uniform 21
ancient 19.9
art 18.4
military uniform 17.4
daily 15.9
man 14.8
antique 14.1
clothing 14.1
people 13.9
retro 13.9
person 13.7
grunge 13.6
male 13.5
letter 12.8
soldier 12.7
military 12.5
decoration 12
aged 11.8
black 11.4
culture 11.1
postmark 10.8
postage 10.8
postal 10.8
history 10.7
stamp 10.6
sculpture 10.6
mail 10.5
symbol 10.1
envelope 10
war 9.6
paper 9.4
gun 9.1
danger 9.1
portrait 9.1
design 9
weapon 8.9
warrior 8.8
army 8.8
covering 8.6
architecture 8.6
adult 8.5
travel 8.4
color 8.3
protection 8.2
paint 8.1
dirty 8.1
drawing 8.1
camouflage 8
circa 7.9
structure 7.8
museum 7.8
comic book 7.8
wall 7.7
mask 7.7
card 7.6
room 7.6
statue 7.6
memorial 7.5
traditional 7.5
city 7.5
one 7.5
closeup 7.4
detail 7.2
office 7.2
religion 7.2
building 7.2
face 7.1
to 7.1
consumer goods 7.1

Google
created on 2019-06-05

Photograph 96.9
People 95
Snapshot 87.9
Photography 67.8
Vintage clothing 66
Child 61.3
Family 51.8

Microsoft
created on 2019-06-05

clothing 98.9
person 95.5
smile 93.1
human face 92.5
child 89
woman 83.3
group 72.7
house 63.8
old 59.6
posing 58.9
footwear 50.6
picture frame 6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 97.9%
Angry 3.2%
Calm 7.4%
Confused 4.1%
Happy 19.8%
Sad 46.8%
Disgusted 17.5%
Surprised 1.2%

AWS Rekognition

Age 10-15
Gender Female, 74.8%
Confused 0.6%
Happy 0.1%
Surprised 0.2%
Calm 10.3%
Angry 86.5%
Sad 1.9%
Disgusted 0.5%

AWS Rekognition

Age 29-45
Gender Male, 85.7%
Angry 5.3%
Happy 8.6%
Disgusted 4.2%
Confused 4.7%
Calm 30.3%
Surprised 2.4%
Sad 44.5%

AWS Rekognition

Age 9-14
Gender Male, 54.6%
Calm 45.2%
Surprised 45.6%
Happy 52%
Angry 45.4%
Confused 45.9%
Sad 45.5%
Disgusted 45.5%

AWS Rekognition

Age 6-13
Gender Male, 52.2%
Calm 45.4%
Confused 45.4%
Happy 45.2%
Surprised 45.2%
Angry 49.6%
Disgusted 45.4%
Sad 48.9%

AWS Rekognition

Age 29-45
Gender Female, 54.7%
Sad 50.2%
Disgusted 45.8%
Calm 46.6%
Confused 45.4%
Happy 45.5%
Surprised 45.3%
Angry 46.3%

AWS Rekognition

Age 4-9
Gender Female, 51.7%
Sad 50.5%
Angry 45.4%
Happy 45.2%
Disgusted 45.5%
Calm 47.5%
Surprised 45.5%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Calm 45.3%
Happy 45.7%
Sad 52%
Angry 45.6%
Confused 45.4%
Disgusted 45.8%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53.4%
Angry 45.8%
Disgusted 45.5%
Confused 45.2%
Calm 46.2%
Happy 45.4%
Surprised 45.1%
Sad 51.7%

AWS Rekognition

Age 20-38
Gender Male, 51.5%
Surprised 45.2%
Disgusted 45.4%
Sad 48.5%
Calm 45.1%
Happy 45.2%
Confused 45.2%
Angry 50.4%

AWS Rekognition

Age 10-15
Gender Female, 53.1%
Calm 45.6%
Surprised 45.3%
Confused 45.5%
Sad 50.3%
Angry 47.3%
Disgusted 45.7%
Happy 45.4%

AWS Rekognition

Age 10-15
Gender Female, 54%
Happy 53.1%
Calm 45.5%
Sad 46%
Surprised 45.1%
Angry 45.1%
Confused 45.1%
Disgusted 45.1%

AWS Rekognition

Age 10-15
Gender Male, 50.8%
Sad 52.6%
Angry 45.4%
Disgusted 46.1%
Surprised 45.1%
Happy 45.2%
Calm 45.4%
Confused 45.2%

AWS Rekognition

Age 10-15
Gender Male, 53.6%
Angry 46.1%
Surprised 45.1%
Calm 45.4%
Happy 45.6%
Confused 45.4%
Disgusted 45.1%
Sad 52.3%

AWS Rekognition

Age 11-18
Gender Male, 50.5%
Sad 49.2%
Confused 45.3%
Surprised 45.2%
Happy 45.3%
Angry 49.4%
Disgusted 45.4%
Calm 45.2%

AWS Rekognition

Age 9-14
Gender Male, 50.7%
Sad 53.8%
Angry 45.2%
Calm 45.8%
Confused 45.1%
Happy 45%
Disgusted 45%
Surprised 45%

AWS Rekognition

Age 14-23
Gender Male, 52.3%
Happy 45.9%
Angry 45.5%
Calm 49.4%
Sad 47.6%
Surprised 45.2%
Confused 45.4%
Disgusted 45.9%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 84.5%
Poster 73.1%

Categories

Imagga

paintings art 97.5%
people portraits 1.9%

Text analysis

Amazon

Corpenters
Litle Corpenters
Litle

Google

Little Corpenters
Little
Corpenters