Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 110. A Russian Tea Party.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3.1

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 110. A Russian Tea Party.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 98.1
Person 98.1
Person 98
Person 97.7
Person 97.1
People 94.5
Person 93.6
Person 93.2
Person 92.6
Person 88.7
Person 88
Person 87.5
Person 87.3
Nature 86
Person 85.7
Outdoors 79
Person 78.4
Painting 76.9
Art 76.9
Person 65.8
Person 64.9
Person 64.2
Person 59.4
Family 58.7
Tree 57.4
Plant 57.4
Audience 57.2
Crowd 57.2
Person 46.2

Clarifai
created on 2019-06-05

people 100
many 99.9
group 99.7
child 98.6
group together 97.2
adult 94.9
crowd 94.4
woman 89.3
administration 89.2
man 85.3
boy 85
leader 84.3
several 82.3
military 79.2
recreation 75.1
wear 75.1
sit 74.7
war 74.2
enjoyment 70.7
education 69.6

Imagga
created on 2019-06-05

kin 35.1
cemetery 29.3
man 22.8
people 21.2
old 18.8
grunge 18.7
male 17.1
grandfather 13.6
vintage 13.2
person 13.2
child 12.6
antique 12.1
aged 11.8
field 11.7
tree 11.7
father 11.3
happy 11.3
love 11
happiness 11
adult 10.8
park 10.7
family 10.7
together 10.5
couple 10.4
outdoors 10.4
forest 10.4
sky 10.2
dirty 9.9
landscape 9.7
style 9.6
boy 9.6
ancient 9.5
parent 9.5
grain 9.2
outdoor 9.2
texture 9
dad 9
fun 9
mother 8.9
graphic 8.8
lifestyle 8.7
day 8.6
play 8.6
men 8.6
two 8.5
portrait 8.4
retro 8.2
grass 7.9
art 7.8
world 7.8
aging 7.7
old fashioned 7.6
sport 7.6
silhouette 7.4
game 7.3
smile 7.1
trees 7.1
summer 7.1
autumn 7

Google
created on 2019-06-05

People 96.5
Photograph 96.1
Snapshot 86.4
Child 80.1
Family 71.4
Vintage clothing 70.8
Adaptation 67
Photography 62.4

Microsoft
created on 2019-06-05

person 98.1
grass 96.3
clothing 95.2
human face 92.4
outdoor 92.2
group 87.2
posing 83.4
child 74.9
old 69.2
woman 60.2
man 59.6
people 56.4
team 35.9
crowd 2.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 54.6%
Happy 46%
Angry 45.5%
Calm 51.2%
Confused 45.4%
Disgusted 45.8%
Surprised 45.4%
Sad 45.6%

AWS Rekognition

Age 17-27
Gender Female, 54.6%
Confused 45.1%
Calm 46.1%
Angry 45.2%
Surprised 45.1%
Sad 51.4%
Happy 46.6%
Disgusted 45.4%

AWS Rekognition

Age 27-44
Gender Male, 53.9%
Disgusted 45.4%
Sad 45.2%
Calm 53.5%
Confused 45.3%
Happy 45.1%
Surprised 45.2%
Angry 45.3%

AWS Rekognition

Age 23-38
Gender Female, 50%
Sad 45.4%
Happy 45.5%
Angry 45.2%
Calm 52.8%
Surprised 45.3%
Confused 45.2%
Disgusted 45.7%

AWS Rekognition

Age 35-52
Gender Female, 51.5%
Calm 45.8%
Angry 45.3%
Sad 49%
Happy 48.2%
Confused 45.2%
Surprised 45.1%
Disgusted 46.4%

AWS Rekognition

Age 29-45
Gender Female, 52.9%
Calm 45.1%
Disgusted 45%
Happy 45.1%
Surprised 45%
Sad 54.5%
Angry 45.1%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Female, 53.7%
Surprised 45.2%
Sad 52%
Calm 45.6%
Happy 46.8%
Disgusted 45.1%
Confused 45.1%
Angry 45.2%

AWS Rekognition

Age 35-52
Gender Female, 50%
Confused 45.2%
Angry 45.2%
Disgusted 45.3%
Surprised 45.5%
Sad 45.8%
Calm 49.4%
Happy 48.7%

AWS Rekognition

Age 49-69
Gender Male, 54.6%
Surprised 45.2%
Sad 46.3%
Happy 45.3%
Confused 45.3%
Calm 51.5%
Angry 46.1%
Disgusted 45.4%

AWS Rekognition

Age 26-43
Gender Female, 53.7%
Confused 45.1%
Surprised 45.1%
Sad 54.1%
Calm 45.4%
Happy 45.2%
Angry 45.1%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Female, 53.4%
Angry 45%
Surprised 45%
Sad 45%
Disgusted 45%
Confused 45%
Happy 54.9%
Calm 45%

AWS Rekognition

Age 26-43
Gender Female, 52%
Confused 45.4%
Sad 46.3%
Angry 45.6%
Calm 48.9%
Happy 48.3%
Disgusted 45.2%
Surprised 45.3%

AWS Rekognition

Age 17-27
Gender Female, 52.8%
Happy 54.8%
Sad 45%
Disgusted 45%
Angry 45%
Surprised 45%
Calm 45.1%
Confused 45%

AWS Rekognition

Age 10-15
Gender Female, 54.9%
Angry 45.2%
Disgusted 45.2%
Sad 46.1%
Surprised 45.2%
Happy 52.1%
Calm 45.8%
Confused 45.2%

AWS Rekognition

Age 30-47
Gender Male, 52.8%
Disgusted 45.2%
Happy 45.1%
Confused 45.2%
Sad 46.2%
Calm 48.5%
Angry 49.6%
Surprised 45.2%

AWS Rekognition

Age 19-36
Gender Female, 51.5%
Confused 45.6%
Sad 50.5%
Happy 45.3%
Surprised 45.3%
Disgusted 46.7%
Calm 45.2%
Angry 46.3%

AWS Rekognition

Age 26-43
Gender Male, 52.6%
Disgusted 45.5%
Sad 47.4%
Calm 50.7%
Surprised 45.3%
Angry 45.5%
Happy 45.3%
Confused 45.3%

AWS Rekognition

Age 20-38
Gender Female, 54.6%
Sad 54.3%
Disgusted 45.1%
Angry 45.1%
Surprised 45%
Calm 45.1%
Confused 45.1%
Happy 45.4%

AWS Rekognition

Age 20-38
Gender Female, 52.6%
Disgusted 46%
Confused 45.3%
Surprised 45.8%
Calm 45.8%
Happy 45.8%
Angry 46.6%
Sad 49.7%

AWS Rekognition

Age 23-38
Gender Male, 53.4%
Calm 52.2%
Confused 45.2%
Happy 45.2%
Angry 45.3%
Sad 45.3%
Surprised 45.2%
Disgusted 46.6%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Sad 51.4%
Calm 45.7%
Angry 45.6%
Disgusted 45.9%
Surprised 45.4%
Confused 45.6%
Happy 45.4%

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Angry 45.3%
Sad 53.7%
Surprised 45.1%
Confused 45.1%
Disgusted 45.1%
Calm 45.7%
Happy 45.1%

AWS Rekognition

Age 48-68
Gender Male, 52.8%
Confused 45.2%
Disgusted 45.8%
Sad 47.3%
Surprised 45.4%
Calm 50.7%
Angry 45.5%
Happy 45.2%

AWS Rekognition

Age 38-59
Gender Male, 51.9%
Calm 53.7%
Angry 45.2%
Happy 45.3%
Surprised 45.2%
Confused 45.1%
Disgusted 45.3%
Sad 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Angry 45.2%
Sad 51.8%
Surprised 45.1%
Happy 47.4%
Calm 45.4%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 17-27
Gender Female, 53%
Calm 48.2%
Confused 45.2%
Disgusted 45.2%
Happy 48%
Angry 45.3%
Sad 48%
Surprised 45.2%

AWS Rekognition

Age 23-38
Gender Female, 53.8%
Surprised 46.1%
Sad 47.2%
Calm 45.4%
Confused 45.8%
Disgusted 46.8%
Happy 47%
Angry 46.7%

AWS Rekognition

Age 26-43
Gender Female, 53.7%
Surprised 46.1%
Happy 46.5%
Calm 45.9%
Sad 48.7%
Disgusted 45.9%
Confused 46.1%
Angry 45.9%

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Painting 76.9%

Text analysis

Google

14til
14til