Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 207. Class of 1902.

Date

1902

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3563.2

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 207. Class of 1902.

People

Artist: Unidentified Artist,

Date

1902

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3563.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 98
Human 98
Person 97.9
Person 97.6
Person 97.5
Person 95.9
Person 94.9
Person 94.8
Person 91.5
Person 90.5
Person 89.5
Person 87.3
Clothing 81.2
Apparel 81.2
Tie 80.2
Accessory 80.2
Accessories 80.2
Tie 78.7
Suit 74
Coat 74
Overcoat 74
People 70.4
Person 70
Person 63.3
Room 61.1
Indoors 61.1
School 57.3
Classroom 55.3

Clarifai
created on 2019-06-05

people 100
group 99.6
group together 99.5
many 99.4
adult 97.8
woman 96.5
man 96.2
portrait 95.3
wear 93.6
leader 91.7
music 91.5
child 90.4
administration 89
several 89
outfit 86.5
retro 83
five 81.1
partnership 78.6
musician 77.7
uniform 76.3

Imagga
created on 2019-06-05

kin 53.7
people 28.4
man 26.9
person 23.8
world 19.3
male 19.1
adult 18.8
couple 18.3
portrait 18.1
group 17.7
old 16.7
happiness 15.7
happy 15.6
family 15.1
businessman 15
business 14.6
bride 13.6
women 13.4
men 12.9
smiling 11.6
fun 11.2
groom 10.9
dress 10.8
art 10.8
team 10.7
wedding 10.1
black 9.6
boy 9.5
ancient 9.5
two 9.3
joy 9.2
silhouette 9.1
vintage 9.1
fashion 9
mother 9
home 8.8
nurse 8.7
love 8.7
bouquet 8.6
smile 8.5
negative 8.4
teacher 8.3
color 8.3
camera 8.3
child 8.2
retro 8.2
aged 8.1
professional 8.1
decoration 8
body 8
interior 8
work 7.8
statue 7.7
crowd 7.7
room 7.6
film 7.6
clothing 7.5
friends 7.5
human 7.5
friendship 7.5
businesswoman 7.3
holiday 7.2
face 7.1
together 7

Google
created on 2019-06-05

Photograph 96.6
Social group 94.8
People 94.1
Snapshot 86.2
Standing 79.6
Team 67.7
Family 63.2
Photography 62.4
Crew 61.7
Vintage clothing 50.7

Microsoft
created on 2019-06-05

posing 99.9
person 99.9
clothing 98.6
wall 96.5
standing 96
smile 95.3
group 92.5
man 92.5
human face 85.6
old 76.7
black 67.4
clothes 15.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-55
Gender Male, 53.2%
Surprised 45.2%
Confused 45.2%
Sad 50.4%
Calm 48.1%
Disgusted 45.5%
Happy 45.1%
Angry 45.5%

AWS Rekognition

Age 26-43
Gender Female, 53.4%
Sad 54.5%
Disgusted 45%
Surprised 45%
Happy 45%
Confused 45%
Angry 45.2%
Calm 45.1%

AWS Rekognition

Age 26-44
Gender Male, 53.7%
Happy 45.2%
Angry 45.3%
Sad 46%
Calm 53.2%
Confused 45.1%
Disgusted 45.1%
Surprised 45.1%

AWS Rekognition

Age 15-25
Gender Male, 51.3%
Confused 45.2%
Happy 45.1%
Sad 49.5%
Surprised 45.2%
Angry 45.5%
Disgusted 45.2%
Calm 49.4%

AWS Rekognition

Age 15-25
Gender Male, 53.4%
Sad 45.1%
Surprised 45%
Angry 45.1%
Disgusted 45%
Confused 45%
Happy 45%
Calm 54.7%

AWS Rekognition

Age 17-27
Gender Male, 54.2%
Calm 45.6%
Angry 45.2%
Surprised 45.1%
Confused 45.4%
Disgusted 45.2%
Happy 51.9%
Sad 46.6%

AWS Rekognition

Age 26-43
Gender Male, 51.2%
Calm 47.5%
Sad 51.4%
Disgusted 45.2%
Happy 45.3%
Surprised 45.2%
Angry 45.3%
Confused 45.2%

AWS Rekognition

Age 20-38
Gender Male, 54.7%
Sad 45.4%
Calm 54.3%
Surprised 45.1%
Confused 45.1%
Angry 45.1%
Disgusted 45.1%
Happy 45.1%

AWS Rekognition

Age 15-25
Gender Female, 51.9%
Confused 45.1%
Happy 45.1%
Sad 46.1%
Surprised 45.2%
Angry 45.2%
Disgusted 45.1%
Calm 53.2%

AWS Rekognition

Age 20-38
Gender Male, 52%
Sad 54.3%
Surprised 45%
Happy 45%
Angry 45.2%
Confused 45.1%
Disgusted 45.1%
Calm 45.2%

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Angry 45.3%
Surprised 45.4%
Confused 45.2%
Sad 46.2%
Disgusted 45.2%
Happy 45.3%
Calm 52.4%

AWS Rekognition

Age 26-44
Gender Male, 52.3%
Disgusted 45.1%
Confused 45.1%
Angry 45.3%
Calm 45.6%
Surprised 45.1%
Happy 45.1%
Sad 53.7%

AWS Rekognition

Age 29-45
Gender Female, 50.8%
Sad 52.2%
Disgusted 45.2%
Confused 45.1%
Happy 45.3%
Calm 46.8%
Surprised 45.1%
Angry 45.2%

AWS Rekognition

Age 20-38
Gender Male, 50.9%
Calm 45.6%
Surprised 45.1%
Angry 46.4%
Sad 51.9%
Confused 45.6%
Disgusted 45.3%
Happy 45.1%

AWS Rekognition

Age 15-25
Gender Female, 51.5%
Happy 45.4%
Disgusted 45.4%
Sad 47.5%
Confused 45.4%
Angry 45.9%
Surprised 45.3%
Calm 50.1%

AWS Rekognition

Age 26-43
Gender Male, 53%
Disgusted 45.8%
Surprised 45.4%
Sad 46%
Calm 51.5%
Angry 45.5%
Happy 45.4%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Sad 45.6%
Surprised 45.2%
Disgusted 45.3%
Calm 53.2%
Happy 45.1%
Confused 45.3%
Angry 45.3%

AWS Rekognition

Age 15-25
Gender Male, 51.9%
Calm 54.4%
Angry 45.1%
Surprised 45%
Confused 45.1%
Disgusted 45.1%
Happy 45.2%
Sad 45.2%

AWS Rekognition

Age 12-22
Gender Male, 54.4%
Surprised 45.3%
Happy 45.2%
Angry 45.3%
Calm 52.8%
Confused 45.3%
Sad 46%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Calm 54.8%
Disgusted 45%
Confused 45%
Angry 45%
Sad 45.1%
Surprised 45%
Happy 45%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 17
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%
Tie 80.2%
Suit 74%

Categories

Imagga

paintings art 97.2%
interior objects 2.4%