Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 109. The Girls Club.

Date

c. 1904

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3555.4

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 109. The Girls Club.

People

Artist: Unidentified Artist,

Date

c. 1904

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3555.4

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.3
Person 99.3
Person 99.1
Person 98.8
Person 98.8
Person 98.7
Person 97.7
Person 97.4
Person 97.2
Person 96.9
Person 96.7
Person 95.2
Person 94.8
School 93.3
Person 88.1
People 86.1
Indoors 84.4
Classroom 84.4
Room 84.4
Person 84.1
Person 83
Person 79.5
Person 78.3
Person 75.9
Person 75.3
Person 67.9
Clothing 61.4
Apparel 61.4
Crowd 59
Audience 59
Boy 58.5
Person 47.7

Clarifai
created on 2019-06-05

people 100
many 99.8
group 99.7
child 98.3
group together 98.3
school 98.1
crowd 98
woman 97.5
adult 97.2
education 96.8
man 96
leader 94
portrait 93.3
boy 90.3
music 90
administration 87.6
choir 85.2
teacher 84.9
victory 82.5
uniform 79.1

Imagga
created on 2019-06-05

kin 69.7
people 31.8
man 22.3
group 21.7
person 20.8
male 20
adult 18.9
men 17.2
classroom 17.1
portrait 16.2
fashion 15.8
business 15.8
silhouette 15.7
room 15.6
black 15.2
family 13.3
women 12.6
urban 12.2
happy 11.9
window 11.6
businessman 11.5
girls 10.9
child 10.4
sexy 10.4
team 9.8
pretty 9.8
human 9.7
life 9.7
couple 9.6
scene 9.5
friends 9.4
model 9.3
sport 9.2
leisure 9.1
dress 9
fun 9
clothing 8.8
interior 8.8
boy 8.7
happiness 8.6
face 8.5
mother 8.5
attractive 8.4
city 8.3
indoor 8.2
style 8.1
art 8
holiday 7.9
play 7.7
run 7.7
crowd 7.7
old 7.7
youth 7.7
two 7.6
design 7.3
new 7.3
pose 7.2
smiling 7.2
suit 7.2
active 7.2
celebration 7.2
travel 7

Google
created on 2019-06-05

Social group 97.3
People 95.9
Photograph 94.8
Team 70.5
Crowd 66.3
Event 62.7
Vintage clothing 62.5
Family 62
Class 60.4
History 60.4
Crew 60.2

Microsoft
created on 2019-06-05

posing 99.9
clothing 97.9
group 96.3
person 94
smile 91.3
human face 87.2
woman 79.3
old 77.4
man 73.4
team 57
dressed 51.3
clothes 27.3
concert band 10.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 52.2%
Angry 45.6%
Sad 46.7%
Disgusted 45.1%
Happy 45.4%
Confused 45.2%
Calm 51.9%
Surprised 45.1%

AWS Rekognition

Age 20-38
Gender Female, 51.7%
Disgusted 45%
Sad 45.1%
Calm 45%
Surprised 45%
Angry 54.8%
Happy 45%
Confused 45%

AWS Rekognition

Age 26-43
Gender Male, 53.6%
Surprised 45.3%
Confused 45.1%
Happy 48%
Calm 50.3%
Disgusted 45.1%
Sad 46.1%
Angry 45.2%

AWS Rekognition

Age 27-44
Gender Female, 53.8%
Confused 45.2%
Surprised 45.1%
Angry 45.2%
Calm 51%
Sad 48.1%
Happy 45.2%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Confused 45.2%
Surprised 45.5%
Sad 45.3%
Calm 45.1%
Happy 52.4%
Angry 46.2%
Disgusted 45.3%

AWS Rekognition

Age 15-25
Gender Male, 51.4%
Angry 45.5%
Disgusted 46%
Sad 45.4%
Happy 45.4%
Confused 45.1%
Surprised 45.2%
Calm 52.4%

AWS Rekognition

Age 19-36
Gender Female, 55%
Happy 45.2%
Disgusted 45.1%
Surprised 45%
Angry 45.1%
Sad 54.3%
Confused 45.1%
Calm 45.2%

AWS Rekognition

Age 20-38
Gender Female, 52.8%
Disgusted 45.1%
Surprised 45.2%
Happy 45.1%
Calm 49.6%
Angry 45.4%
Confused 45.3%
Sad 49.4%

AWS Rekognition

Age 26-43
Gender Female, 50%
Surprised 45.7%
Disgusted 46.2%
Sad 48.4%
Calm 47%
Happy 45.6%
Confused 45.6%
Angry 46.4%

AWS Rekognition

Age 26-43
Gender Female, 54.7%
Sad 46.9%
Disgusted 47.5%
Angry 45.7%
Surprised 45.4%
Calm 48%
Confused 45.2%
Happy 46.1%

AWS Rekognition

Age 35-52
Gender Female, 53.6%
Calm 47.6%
Angry 46.6%
Happy 45.3%
Surprised 45.5%
Confused 45.4%
Disgusted 47.2%
Sad 47.5%

AWS Rekognition

Age 30-47
Gender Female, 54.9%
Surprised 45.1%
Happy 51.2%
Calm 47.8%
Sad 45.3%
Disgusted 45.3%
Confused 45.2%
Angry 45.1%

AWS Rekognition

Age 23-38
Gender Female, 54.8%
Happy 46.6%
Disgusted 45.4%
Surprised 45.4%
Angry 45.6%
Sad 46%
Confused 45.4%
Calm 50.5%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Disgusted 45.2%
Sad 45.4%
Calm 45.2%
Surprised 45.1%
Angry 54.2%
Happy 45.1%
Confused 45%

AWS Rekognition

Age 27-44
Gender Female, 54.2%
Angry 45.4%
Sad 46.5%
Happy 45.4%
Disgusted 45.1%
Calm 52.2%
Surprised 45.2%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Confused 45.1%
Disgusted 45%
Sad 46.6%
Surprised 45%
Calm 52.9%
Angry 45.2%
Happy 45.2%

AWS Rekognition

Age 26-43
Gender Female, 52.4%
Calm 47.1%
Angry 45.4%
Sad 48.5%
Confused 45.1%
Surprised 45.2%
Happy 47.3%
Disgusted 46.4%

AWS Rekognition

Age 15-25
Gender Female, 51%
Disgusted 45%
Happy 45.1%
Confused 45%
Sad 54.6%
Calm 45.1%
Angry 45.1%
Surprised 45%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Calm 45.9%
Surprised 45.2%
Disgusted 45.3%
Angry 46.6%
Happy 45.2%
Sad 51.6%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 51.3%
Confused 45.2%
Disgusted 45.5%
Sad 47.4%
Surprised 45.2%
Calm 47.2%
Angry 49.4%
Happy 45.1%

AWS Rekognition

Age 29-45
Gender Female, 52.6%
Disgusted 45.2%
Happy 45.2%
Surprised 45.2%
Calm 46.3%
Angry 45.3%
Confused 45.2%
Sad 52.7%

AWS Rekognition

Age 23-38
Gender Female, 54.7%
Calm 45.1%
Angry 45.7%
Happy 46.3%
Confused 45.1%
Surprised 45.2%
Disgusted 47.7%
Sad 50%

AWS Rekognition

Age 15-25
Gender Female, 53.4%
Angry 52.2%
Sad 45.9%
Calm 45.4%
Surprised 45.2%
Confused 45.1%
Disgusted 46%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Female, 53.2%
Confused 45.1%
Surprised 45.1%
Angry 48.4%
Calm 45.4%
Sad 49%
Happy 45.2%
Disgusted 46.8%

AWS Rekognition

Age 14-25
Gender Female, 54.5%
Surprised 45.1%
Sad 52.9%
Happy 45.3%
Confused 45.1%
Calm 45.9%
Angry 45.6%
Disgusted 45.1%

AWS Rekognition

Age 23-38
Gender Female, 54.2%
Sad 54.4%
Disgusted 45.2%
Confused 45%
Happy 45.1%
Calm 45.1%
Surprised 45.1%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Female, 53.6%
Calm 46.7%
Sad 52.3%
Surprised 45.1%
Disgusted 45.2%
Happy 45.1%
Angry 45.6%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Male, 53.8%
Surprised 45.2%
Happy 45.1%
Disgusted 45.8%
Calm 45.9%
Sad 50.2%
Angry 47.4%
Confused 45.4%

AWS Rekognition

Age 29-45
Gender Female, 54.6%
Happy 45.2%
Angry 46.4%
Calm 46.6%
Confused 45.1%
Disgusted 45.1%
Surprised 45.1%
Sad 51.4%

AWS Rekognition

Age 16-27
Gender Female, 53.6%
Confused 45.2%
Surprised 45.1%
Angry 46%
Calm 45.3%
Sad 47.5%
Happy 45.3%
Disgusted 50.8%

AWS Rekognition

Age 27-44
Gender Female, 54.8%
Calm 47.1%
Angry 46.2%
Sad 49.3%
Happy 45.8%
Confused 45.5%
Surprised 45.2%
Disgusted 45.9%

AWS Rekognition

Age 20-38
Gender Female, 54.2%
Calm 45.2%
Disgusted 45.1%
Sad 51.3%
Happy 45.1%
Confused 45.1%
Surprised 45%
Angry 48.3%

AWS Rekognition

Age 30-47
Gender Male, 52.8%
Confused 45.2%
Calm 46.2%
Angry 50.6%
Surprised 45.2%
Sad 47.3%
Happy 45.1%
Disgusted 45.4%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Happy 45.2%
Disgusted 48.5%
Confused 45.1%
Surprised 45.1%
Sad 49.8%
Angry 45.9%
Calm 45.4%

AWS Rekognition

Age 26-43
Gender Female, 54.1%
Disgusted 45.5%
Happy 51.4%
Calm 45.4%
Angry 45.3%
Surprised 45.4%
Confused 45.2%
Sad 46.8%

AWS Rekognition

Age 30-47
Gender Male, 53.4%
Angry 45.9%
Sad 46.6%
Surprised 45.4%
Confused 45.3%
Disgusted 45.3%
Calm 48.6%
Happy 47.8%

AWS Rekognition

Age 26-43
Gender Female, 51.3%
Surprised 45.4%
Sad 47.5%
Happy 47.7%
Confused 45.3%
Calm 45.9%
Angry 45.6%
Disgusted 47.7%

AWS Rekognition

Age 26-43
Gender Female, 51%
Confused 45.2%
Calm 45.1%
Angry 47.9%
Surprised 45.2%
Sad 46.8%
Happy 48.5%
Disgusted 46.2%

AWS Rekognition

Age 26-43
Gender Female, 52.4%
Confused 45%
Sad 54.5%
Angry 45.1%
Calm 45.2%
Happy 45%
Disgusted 45%
Surprised 45%

AWS Rekognition

Age 35-52
Gender Female, 54.9%
Confused 45%
Surprised 45.1%
Sad 45.2%
Calm 45.1%
Happy 54%
Angry 45.1%
Disgusted 45.5%

AWS Rekognition

Age 20-38
Gender Female, 52.9%
Confused 45%
Surprised 45.1%
Sad 53.7%
Calm 45.2%
Happy 45.2%
Angry 45.4%
Disgusted 45.3%

AWS Rekognition

Age 26-43
Gender Female, 54.3%
Calm 46.7%
Surprised 45%
Disgusted 45%
Angry 45.3%
Happy 45.2%
Sad 52.7%
Confused 45.1%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Happy 45.6%
Disgusted 48.8%
Calm 47%
Sad 46.5%
Confused 45.2%
Surprised 45.3%
Angry 46.6%

AWS Rekognition

Age 26-43
Gender Female, 55%
Calm 45%
Confused 45%
Happy 45.1%
Angry 45.1%
Sad 54.7%
Surprised 45%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Female, 54.8%
Sad 51.6%
Disgusted 45.1%
Calm 47.4%
Confused 45.1%
Angry 45.3%
Surprised 45.1%
Happy 45.4%

AWS Rekognition

Age 15-25
Gender Male, 50.8%
Sad 51.4%
Disgusted 45.4%
Calm 45.5%
Confused 45.3%
Angry 45.8%
Surprised 45.2%
Happy 46.3%

AWS Rekognition

Age 27-44
Gender Female, 52.8%
Angry 46.5%
Disgusted 45.4%
Sad 49.1%
Happy 45.2%
Confused 45.2%
Surprised 45.3%
Calm 48.4%

AWS Rekognition

Age 26-43
Gender Male, 50.9%
Sad 46.5%
Disgusted 46.3%
Happy 46.8%
Angry 45.7%
Surprised 45.7%
Calm 48.6%
Confused 45.4%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Surprised 45.1%
Sad 53.3%
Calm 45.1%
Confused 45.1%
Disgusted 45.3%
Happy 45.1%
Angry 46.2%

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Text analysis

Amazon

A