Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 106. The Volunteer Fire Company.
Date

c. 1904
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3555.1

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 106. The Volunteer Fire Company.

People

Artist: Unidentified Artist,

Date

c. 1904

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3555.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Military 99.3
Person 99.3
Human 99.3
Military Uniform 99.1
Person 98.7
Person 98.2
Army 98.1
Armored 98.1
Person 98
Person 98
People 97.9
Troop 97.9
Person 96.5
Person 95.2
Person 94.5
Person 93.9
Person 90.8
Person 87.5
Person 86.3
Person 86.1
Person 85.1
Person 82.4
Person 80.6
Soldier 79.3
Person 78.7
Person 77
Person 75.1
Person 73.6
Person 69.8
Officer 67.5
Person 62.1
Person 58.8
Person 47.5

Clarifai
created on 2019-06-05

people 100
many 99.4
group 99.4
child 99.1
group together 99
uniform 97.9
military 97.9
adult 97.3
soldier 97
war 96.7
portrait 96.3
wear 95.2
outfit 93.2
several 93.1
man 92
army 91.7
woman 90.7
retro 90.4
boy 89.4
administration 89.3

Imagga
created on 2019-06-05

kin 60.8
person 25.1
planner 19.5
man 18.8
people 18.4
old 18.1
art 17.7
decoration 14.9
religion 14.3
male 13.6
statue 13.3
grunge 12.8
sculpture 12.7
ancient 12.1
sport 11.6
portrait 11.6
vintage 11.6
antique 11.5
uniform 11.3
adult 11.1
military uniform 11.1
historical 10.3
history 9.8
death 9.6
church 9.2
child 8.9
sepia 8.7
god 8.6
travel 8.4
religious 8.4
black 8.4
outdoor 8.4
figure 8.2
retro 8.2
style 8.1
dirty 8.1
detail 8
design 7.9
clothing 7.9
face 7.8
architecture 7.8
model 7.8
men 7.7
holy 7.7
culture 7.7
athlete 7.6
mother 7.4
grandfather 7.4
drawing 7.2
body 7.2
love 7.1

Google
created on 2019-06-05

People 95.4
Troop 83.9
Team 81.4
Military organization 74.6
Soldier 73.7
Crew 71.8
Infantry 69.7
History 54.1
Military 52.7

Microsoft
created on 2019-06-05

posing 100
group 97.6
person 94.7
clothing 93.4
military uniform 90.2
team 85
man 83.5
old 68.3
smile 53.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Sad 45.9%
Disgusted 45.6%
Happy 45.2%
Surprised 45.2%
Angry 45.4%
Calm 52.3%
Confused 45.4%

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Angry 45.3%
Surprised 45.4%
Sad 45.1%
Disgusted 47.2%
Confused 45.3%
Happy 45.3%
Calm 51.3%

AWS Rekognition

Age 35-52
Gender Female, 51.1%
Sad 45.1%
Happy 45.1%
Angry 45.2%
Calm 52.6%
Surprised 46.4%
Confused 45.1%
Disgusted 45.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Surprised 45.3%
Sad 45.2%
Calm 52.6%
Confused 45.4%
Disgusted 45.8%
Happy 45.1%
Angry 45.6%

AWS Rekognition

Age 20-38
Gender Female, 52.1%
Surprised 45.4%
Confused 45.2%
Angry 46.7%
Happy 45.3%
Disgusted 46.3%
Sad 45.3%
Calm 50.7%

AWS Rekognition

Age 23-38
Gender Male, 53.4%
Surprised 45.2%
Happy 45.2%
Disgusted 45.3%
Calm 52.7%
Sad 45.4%
Angry 45.8%
Confused 45.3%

AWS Rekognition

Age 29-45
Gender Male, 52.3%
Confused 45%
Angry 45%
Disgusted 45.1%
Surprised 45.1%
Sad 45.1%
Calm 54.6%
Happy 45%

AWS Rekognition

Age 26-43
Gender Male, 53.2%
Sad 45.1%
Disgusted 45.6%
Happy 45%
Angry 45.2%
Surprised 45.1%
Calm 54%
Confused 45%

AWS Rekognition

Age 30-47
Gender Male, 54.9%
Confused 45.1%
Calm 54%
Angry 45.2%
Surprised 45.1%
Sad 45.3%
Happy 45.1%
Disgusted 45.3%

AWS Rekognition

Age 35-52
Gender Male, 52.7%
Angry 45.5%
Surprised 45.6%
Happy 45.2%
Disgusted 45.6%
Sad 45.3%
Confused 45.2%
Calm 52.6%

AWS Rekognition

Age 23-38
Gender Male, 54.7%
Calm 53.1%
Confused 45.1%
Disgusted 45.5%
Happy 45.1%
Angry 45.2%
Sad 45.9%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Angry 45.9%
Surprised 45.5%
Sad 45.4%
Disgusted 48.7%
Confused 46%
Happy 45.3%
Calm 48.2%

AWS Rekognition

Age 35-52
Gender Male, 53.7%
Disgusted 50.1%
Happy 45.4%
Confused 45%
Sad 45.1%
Calm 49.1%
Angry 45.2%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Male, 55%
Sad 45.4%
Disgusted 45.3%
Calm 50.6%
Confused 46.2%
Angry 45.7%
Surprised 45.7%
Happy 46%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Sad 45.3%
Disgusted 45.2%
Happy 45.3%
Surprised 45.2%
Angry 45.2%
Calm 53.7%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Disgusted 46.3%
Surprised 47.7%
Happy 45.2%
Calm 49.8%
Angry 45.3%
Confused 45.6%
Sad 45.1%

AWS Rekognition

Age 20-38
Gender Male, 51.9%
Confused 45.1%
Sad 45.1%
Angry 45.4%
Calm 53.8%
Happy 45%
Disgusted 45.4%
Surprised 45.2%

AWS Rekognition

Age 60-80
Gender Male, 55%
Surprised 45%
Sad 45.1%
Happy 45.1%
Confused 45%
Calm 54.5%
Angry 45.1%
Disgusted 45%

AWS Rekognition

Age 35-52
Gender Female, 50.1%
Sad 45.2%
Calm 50.5%
Angry 45.5%
Disgusted 47%
Surprised 46.3%
Confused 45.2%
Happy 45.3%

AWS Rekognition

Age 23-38
Gender Male, 54.1%
Sad 45.1%
Disgusted 45.3%
Happy 45.1%
Surprised 45.1%
Angry 45.1%
Calm 54.2%
Confused 45.1%

AWS Rekognition

Age 20-38
Gender Male, 53.9%
Confused 45.2%
Disgusted 45.1%
Sad 46.3%
Surprised 45.1%
Calm 53.1%
Angry 45.2%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.3%
Sad 45.1%
Calm 51%
Angry 45.2%
Disgusted 48.5%
Surprised 45.1%
Confused 45.2%
Happy 45%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.3%
Person 98.7%
Person 98.2%
Person 98%
Person 98%
Person 96.5%
Person 95.2%
Person 94.5%
Person 93.9%
Person 90.8%
Person 87.5%
Person 86.3%
Person 86.1%
Person 85.1%
Person 82.4%
Person 80.6%
Person 78.7%
Person 77%
Person 75.1%
Person 73.6%
Person 69.8%
Person 62.1%
Person 58.8%
Person 47.5%

Text analysis

Google

A
A