Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 209. Class & Faculty of 1904.
Date

1904
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3563.4

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 209. Class & Faculty of 1904.

People

Artist: Unidentified Artist,

Date

1904

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3563.4

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.7
Person 99.7
Person 99.5
Person 99.3
Person 98.5
Person 98.4
Person 97.5
Military 97.1
Military Uniform 97
People 96.8
Armored 95
Army 95
Troop 94.6
Person 92.5
Person 91.4
Person 88
Person 83.4
Outdoors 82.6
Person 82.1
Soldier 80.9
Nature 78.6
Officer 69.3
Person 63.8
Team 63.2
Crowd 63
Countryside 57.1
Police 55
Person 42.8

Clarifai
created on 2019-06-05

people 99.9
group 98.9
many 98.7
adult 97.6
group together 96.9
administration 93.9
military 93.8
wear 93.2
man 93.1
woman 92.3
child 91.4
soldier 91.1
war 91
leader 90
uniform 89.3
outfit 89.1
education 86.3
several 83.5
boy 80.4
school 76.6

Imagga
created on 2019-06-05

military uniform 81.1
uniform 77.5
clothing 54.2
consumer goods 32.7
covering 28.6
helmet 24.1
military 23.2
soldier 21.5
statue 19.7
man 19.5
people 18.4
male 17.7
person 17.7
protection 17.3
danger 17.3
weapon 17.1
commodity 16.2
gun 15.8
war 15.6
photographer 15.3
army 14.6
sport 14.1
mask 13.7
sculpture 13.5
old 13.2
armor plate 12.7
history 12.5
monument 12.1
ancient 12.1
historic 11.9
camouflage 11.9
travel 11.3
adult 11.2
rifle 10.3
tourism 9.9
men 9.4
architecture 9.4
battle 8.8
art 8.6
historical 8.5
traditional 8.3
city 8.3
planner 8.3
vintage 8.3
industrial 8.2
dirty 8.1
landmark 8.1
activity 8.1
destruction 7.8
warrior 7.8
black 7.8
toxic 7.8
defense 7.8
protective 7.8
portrait 7.8
nuclear 7.8
outdoor 7.6
plate 7.3
color 7.2
building 7.2
to 7.1

Google
created on 2019-06-05

Photograph 96.2
People 95
Social group 90.5
Snapshot 84.7
Photography 62.4
Family 62.1
History 57.6
Vintage clothing 57
Crew 53.8
Team 52.3

Microsoft
created on 2019-06-05

posing 99.3
clothing 97.9
person 97.8
group 94.4
man 78.5
old 77.1
smile 60.9
footwear 50.7
team 45.7
clothes 15.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-47
Gender Male, 51.4%
Sad 46.6%
Calm 46.2%
Surprised 45.3%
Disgusted 47.6%
Angry 47.9%
Happy 46%
Confused 45.3%

AWS Rekognition

Age 38-59
Gender Male, 54.9%
Confused 45.2%
Sad 45.1%
Surprised 45.1%
Disgusted 45.3%
Calm 54%
Happy 45%
Angry 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Happy 45.1%
Surprised 45.1%
Angry 45.3%
Sad 51.1%
Confused 45.3%
Disgusted 45.2%
Calm 47.9%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Sad 45.7%
Surprised 45.5%
Happy 45.4%
Disgusted 46.8%
Angry 46%
Calm 50.4%
Confused 45.2%

AWS Rekognition

Age 35-53
Gender Male, 54.3%
Angry 46.2%
Calm 49.7%
Confused 45.3%
Sad 45.5%
Happy 45.3%
Disgusted 47.8%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53.4%
Confused 45.2%
Sad 45.5%
Calm 52.9%
Happy 45.3%
Angry 45.3%
Surprised 45.4%
Disgusted 45.4%

AWS Rekognition

Age 35-52
Gender Male, 50.3%
Angry 45.2%
Surprised 45.1%
Confused 45.1%
Sad 53.4%
Disgusted 45.1%
Happy 45.9%
Calm 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Happy 46.3%
Angry 47.3%
Sad 47.9%
Calm 47.1%
Confused 45.3%
Disgusted 45.8%
Surprised 45.3%

AWS Rekognition

Age 38-57
Gender Female, 54.7%
Surprised 45.4%
Confused 45.4%
Sad 46.6%
Calm 45.5%
Disgusted 45.6%
Happy 45.3%
Angry 51.4%

AWS Rekognition

Age 20-38
Gender Female, 53.7%
Happy 45.6%
Confused 45.4%
Disgusted 46%
Sad 46.2%
Calm 50.3%
Angry 45.8%
Surprised 45.7%

AWS Rekognition

Age 26-44
Gender Female, 53.6%
Calm 52.8%
Sad 45.5%
Confused 45.3%
Angry 45.3%
Disgusted 45.3%
Happy 45.5%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Male, 51.1%
Happy 45.7%
Angry 45.5%
Surprised 45.5%
Calm 50.8%
Sad 45.9%
Confused 45.4%
Disgusted 46.2%

AWS Rekognition

Age 48-68
Gender Female, 50.5%
Happy 45.4%
Angry 45.6%
Surprised 45.5%
Calm 47.7%
Sad 45.5%
Confused 45.3%
Disgusted 50.1%

AWS Rekognition

Age 20-38
Gender Male, 52.1%
Calm 48.7%
Confused 45.2%
Sad 45.5%
Surprised 45.4%
Happy 45.3%
Disgusted 45.7%
Angry 49.2%

AWS Rekognition

Age 26-43
Gender Male, 52.6%
Calm 52%
Confused 45.3%
Angry 46.3%
Surprised 45.3%
Disgusted 45.4%
Sad 45.6%
Happy 45.1%

AWS Rekognition

Age 45-63
Gender Male, 50%
Surprised 45.5%
Angry 47%
Calm 47.6%
Disgusted 45.9%
Confused 45.3%
Happy 46.3%
Sad 47.4%

AWS Rekognition

Age 26-43
Gender Female, 53.1%
Calm 46.3%
Disgusted 45.2%
Confused 45.1%
Angry 45.4%
Sad 52.3%
Surprised 45.1%
Happy 45.6%

AWS Rekognition

Age 38-57
Gender Female, 50.4%
Sad 54.8%
Surprised 45%
Happy 45%
Angry 45.1%
Confused 45.1%
Disgusted 45%
Calm 45%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Sad 48.2%
Calm 50.7%
Surprised 45.1%
Confused 45.1%
Angry 45.3%
Disgusted 45.2%
Happy 45.4%

AWS Rekognition

Age 20-38
Gender Male, 53.2%
Surprised 45.3%
Confused 45.4%
Happy 45.7%
Angry 45.4%
Calm 52.4%
Sad 45.5%
Disgusted 45.3%

AWS Rekognition

Age 20-38
Gender Male, 51.1%
Calm 52.6%
Disgusted 45.7%
Confused 45.2%
Angry 45.7%
Sad 45.3%
Happy 45.2%
Surprised 45.3%

AWS Rekognition

Age 23-38
Gender Female, 51.2%
Disgusted 46.6%
Surprised 45.4%
Calm 51.6%
Angry 45.7%
Happy 45.1%
Sad 45.2%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Sad 52.9%
Happy 45.1%
Angry 45.2%
Calm 46.5%
Disgusted 45.1%
Confused 45.1%
Surprised 45.1%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

paintings art 48.6%
interior objects 36.7%
streetview architecture 9.8%
beaches seaside 3.4%