Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 111. Old Maids' Convention.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3.2

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 111. Old Maids' Convention.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.3
Family 99.3
People 99.3
Person 99.2
Person 99
Person 97.8
Apparel 95.2
Hat 95.2
Clothing 95.2
Person 93.6
Person 90.6
Tie 82.1
Accessories 82.1
Accessory 82.1

Clarifai
created on 2019-06-05

people 100
group 99.8
child 99.3
many 99.2
group together 98.7
adult 98.4
wear 98.2
several 97.3
woman 96.4
veil 95.5
offspring 94.7
leader 94.5
administration 94.5
outfit 93.2
recreation 92.9
lid 92.7
five 91.7
man 88.6
boy 88.5
military 86.6

Imagga
created on 2019-06-05

kin 100
people 30.7
love 25.2
couple 24.4
happy 23.8
adult 23.4
portrait 23.3
sexy 23.3
fashion 22.6
attractive 22.4
happiness 20.4
person 20.3
man 19.5
dress 19
male 17.8
lady 17
two 16.9
women 16.6
bride 15.3
smile 14.9
together 14.9
model 14.8
pretty 14.7
smiling 14.5
body 14.4
family 14.2
face 14.2
married 13.4
sibling 13
girls 12.8
hair 12.7
old 12.5
marriage 12.3
passion 12.2
brunette 12.2
men 12
wedding 11.9
lifestyle 11.6
mother 11.4
cheerful 11.4
groom 11.2
husband 11.2
style 11.1
elegance 10.9
dark 10.8
child 10.8
loving 10.5
bouquet 10.4
black 10.2
traditional 10
outdoor 9.9
holding 9.9
celebration 9.6
flowers 9.6
hands 9.5
flower 9.2
romance 8.9
romantic 8.9
posing 8.9
home 8.8
bridal 8.7
art 8.6
cute 8.6
world 8.6
wife 8.5
expression 8.5
females 8.5
skin 8.5
summer 8.3
joy 8.3
human 8.2
makeup 8.2
outdoors 8.2
healthy 8.2
sensual 8.2
gorgeous 8.1
decoration 8.1
lovely 8
holiday 7.9
look 7.9
sepia 7.8
party 7.7
casual 7.6
erotic 7.6
relationship 7.5
fun 7.5
vintage 7.4
pose 7.2
day 7.1

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

person 99.9
clothing 98.6
outdoor 98.5
posing 95.5
smile 94.3
human face 92
woman 89
group 76.9
old 74.5
vintage clothing 55.9
photograph 54.7
clothes 15.6
crowd 2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-18
Gender Female, 99.3%
Sad 61.6%
Disgusted 3.4%
Happy 1.9%
Angry 21.3%
Surprised 1.8%
Calm 8.2%
Confused 1.8%

AWS Rekognition

Age 20-38
Gender Female, 98%
Surprised 2.9%
Angry 50.4%
Disgusted 7.5%
Happy 7.7%
Calm 12.4%
Sad 15.4%
Confused 3.7%

AWS Rekognition

Age 12-22
Gender Female, 97.9%
Surprised 0.5%
Happy 98.4%
Calm 0.2%
Sad 0.2%
Disgusted 0.2%
Confused 0.3%
Angry 0.2%

AWS Rekognition

Age 23-38
Gender Female, 72.3%
Calm 91.7%
Happy 1.3%
Angry 2.1%
Disgusted 1.7%
Surprised 1.5%
Confused 0.5%
Sad 1.1%

AWS Rekognition

Age 26-44
Gender Female, 79.8%
Disgusted 0.9%
Confused 2%
Surprised 4.3%
Calm 81.9%
Happy 2.6%
Angry 1.9%
Sad 6.5%

AWS Rekognition

Age 20-38
Gender Male, 60.5%
Angry 2.5%
Sad 2.8%
Disgusted 2.9%
Happy 1.5%
Confused 2.7%
Calm 83.4%
Surprised 4.2%

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 17
Gender Female

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 41
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Hat 95.2%
Tie 82.1%

Categories

Imagga

people portraits 99.1%