Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End Industrial School": The South End Industrial School, Roxbury, Mass.: Summer Outings.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3071.1

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End Industrial School": The South End Industrial School, Roxbury, Mass.: Summer Outings.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3071.1

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.6
Person 99.6
Person 99
Person 98.6
Person 98.6
Person 98.5
Person 98.4
Military Uniform 97.2
Military 97.2
Person 96.9
Person 95
Person 93.8
Armored 90.7
Army 90.7
Person 87.3
Soldier 85.1
People 83.3
Person 77.6
Officer 69.2
Outdoors 65.6
Person 65.2
Nature 64.4
Troop 59.6
Soil 57.3
Person 53.1

Clarifai
created on 2019-06-06

people 99.9
group 99.3
group together 99.2
military 98.8
war 98.5
soldier 98.1
many 98
adult 97.6
administration 95
uniform 94.8
skirmish 94.7
man 92.9
child 92.9
several 92.6
outfit 92.6
wear 92.4
military uniform 91.3
weapon 84.5
boy 83.2
gun 83

Imagga
created on 2019-06-06

military uniform 100
uniform 100
clothing 78.9
consumer goods 52.2
covering 51.9
soldier 27.4
military 27.1
commodity 26.1
man 24.2
stretcher 21.1
war 20.2
male 19.9
gun 18.8
weapon 18.3
danger 18.2
camouflage 18.1
army 17.6
travel 16.9
litter 16.9
private 16
old 16
protection 15.5
engineer 14.8
adult 14.6
extreme 14.4
outdoors 14.2
people 13.9
person 13
conveyance 13
battle 12.7
sport 12.4
adventure 12.3
outdoor 11.5
rock 11.3
sports 11.1
recreation 10.8
mask 10.6
stone 10.1
rifle 10.1
vehicle 9.9
combat 9.8
history 9.8
target 9.7
sky 9.6
desert 9.3
action 9.3
fun 9
equipment 9
activity 9
warfare 8.9
warrior 8.8
boy 8.7
men 8.6
training 8.3
transportation 8.1
mountain 8
sand 7.9
shooting 7.8
helmet 7.8
backpack 7.8
ancient 7.8
summer 7.7
hiking 7.7
culture 7.7
sculpture 7.6
tourism 7.4
car 7.4
vacation 7.4
competition 7.3
black 7.2
to 7.1

Google
created on 2019-06-06

Microsoft
created on 2019-06-06

outdoor 99.2
clothing 99.2
person 98.7
man 97.5
old 94.7
group 93.6
military uniform 84.6
people 77.8
posing 67.9
mountain 62
hiking 56.2
mammal 55.7
clothes 24.2
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-65
Gender Female, 54.2%
Surprised 45.2%
Sad 46.5%
Disgusted 45.1%
Calm 45.3%
Happy 52.5%
Angry 45.1%
Confused 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54%
Sad 45.3%
Disgusted 45.5%
Surprised 45.3%
Happy 45.3%
Confused 45.2%
Calm 53%
Angry 45.4%

AWS Rekognition

Age 16-27
Gender Female, 52.4%
Sad 47.1%
Angry 45.5%
Happy 45.8%
Disgusted 46%
Calm 50%
Surprised 45.3%
Confused 45.3%

AWS Rekognition

Age 35-55
Gender Male, 54.9%
Angry 45.4%
Happy 45.5%
Disgusted 45.4%
Confused 45.3%
Calm 52.1%
Surprised 45.2%
Sad 46.1%

AWS Rekognition

Age 14-25
Gender Male, 50.1%
Confused 45%
Sad 45.2%
Disgusted 46.2%
Angry 45.1%
Happy 45.2%
Calm 53.2%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.2%
Happy 45.1%
Sad 47.1%
Angry 45.2%
Surprised 45%
Calm 52.1%
Confused 45.4%
Disgusted 45.2%

AWS Rekognition

Age 48-68
Gender Male, 52.5%
Disgusted 45.1%
Calm 53.4%
Confused 45.1%
Happy 45.9%
Surprised 45.1%
Angry 45.1%
Sad 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Disgusted 49%
Happy 47.7%
Angry 45.2%
Calm 47.4%
Surprised 45.3%
Confused 45.3%
Sad 45.1%

AWS Rekognition

Age 38-57
Gender Male, 50.4%
Happy 49.6%
Sad 49.7%
Confused 49.6%
Calm 49.9%
Angry 49.6%
Disgusted 49.5%
Surprised 49.6%

AWS Rekognition

Age 57-77
Gender Female, 50.6%
Happy 45.2%
Disgusted 45.2%
Surprised 45.2%
Sad 52%
Confused 45.2%
Angry 45.3%
Calm 46.9%

AWS Rekognition

Age 23-38
Gender Male, 51.4%
Calm 51.9%
Sad 45.9%
Surprised 45.6%
Angry 45.2%
Happy 45.1%
Confused 45.9%
Disgusted 45.4%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 59
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Text analysis

Amazon

SR

Google

SR
SR