Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsh Fund.: 16. A Family Group of Fully Americanized Russian Immigrants.
Date

c. 1901
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.136.3

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsh Fund.: 16. A Family Group of Fully Americanized Russian Immigrants.

People

Artist: Unidentified Artist,

Date

c. 1901

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.136.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 98.9
Person 98.9
People 98.6
Person 98.2
Person 98.1
Footwear 98.1
Clothing 98.1
Shoe 98.1
Apparel 98.1
Person 97.6
Family 96.8
Person 96.7
Person 95.9
Person 95.2
Person 89.4
Person 84.2
Flooring 77.1
Porch 56.5
Person 54.7

Clarifai
created on 2019-06-05

people 100
group 99.9
adult 99.6
leader 97.9
many 97.5
man 97.3
wear 96.5
woman 96.3
group together 96
administration 95.4
several 94.4
portrait 93
sit 93
seat 92.1
furniture 89.2
music 88.8
five 86.9
facial expression 86.3
child 85
war 82.8

Imagga
created on 2019-06-05

kin 26.1
person 20.1
sculpture 17.7
adult 17.5
man 16.8
people 16.7
statue 16.6
dress 14.5
male 14.3
portrait 14.2
architecture 14.1
monument 13.1
teacher 13.1
attractive 12.6
room 12.3
art 12.1
old 11.8
sitting 11.2
women 11.1
love 11
happiness 11
fashion 10.6
human 10.5
couple 10.5
one 10.4
black 10.2
educator 9.9
building 9.8
lady 9.7
antique 9.6
ancient 9.5
historical 9.4
model 9.3
face 9.2
historic 9.2
travel 9.2
holding 9.1
history 8.9
family 8.9
marble 8.8
sexy 8.8
bride 8.6
culture 8.5
pretty 8.4
elegance 8.4
city 8.3
vintage 8.3
tourism 8.2
detail 8
romantic 8
body 8
home 8
lifestyle 7.9
hair 7.9
two 7.6
world 7.6
stone 7.6
relaxation 7.5
house 7.5
happy 7.5
famous 7.4
alone 7.3
sensuality 7.3
parent 7.2
professional 7.2
dancer 7.1
stringed instrument 7

Google
created on 2019-06-05

People 95.5
Family 68.3
Art 62.5
Vintage clothing 62.5
Visual arts 59.3
History 54.1
Sitting 54.1

Microsoft
created on 2019-06-05

clothing 94.9
person 89
group 85.2
human face 78.6
old 71.4
man 66.6
posing 64.6
smile 52

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-57
Gender Male, 53.8%
Angry 45.7%
Sad 49.3%
Disgusted 45.6%
Happy 45.7%
Confused 45.7%
Calm 46.9%
Surprised 46.1%

AWS Rekognition

Age 17-27
Gender Female, 54.3%
Calm 50.9%
Disgusted 45.1%
Happy 45.2%
Surprised 45.1%
Sad 48.1%
Angry 45.3%
Confused 45.3%

AWS Rekognition

Age 6-13
Gender Female, 51.9%
Confused 45.2%
Calm 45.3%
Angry 50.8%
Surprised 45.1%
Sad 48.4%
Happy 45.1%
Disgusted 45.2%

AWS Rekognition

Age 29-45
Gender Male, 98.5%
Calm 3.5%
Disgusted 53.9%
Sad 8.2%
Happy 10.8%
Confused 5.1%
Surprised 4.8%
Angry 13.8%

AWS Rekognition

Age 27-44
Gender Male, 54.8%
Angry 46.9%
Calm 49.8%
Surprised 45.2%
Disgusted 45.1%
Happy 45.1%
Sad 47%
Confused 45.8%

AWS Rekognition

Age 35-52
Gender Female, 50.6%
Sad 46.4%
Disgusted 45.1%
Surprised 45.1%
Happy 45.1%
Confused 45.1%
Calm 52.6%
Angry 45.6%

AWS Rekognition

Age 27-44
Gender Female, 54.4%
Surprised 45.5%
Sad 46.6%
Angry 46.6%
Happy 46.3%
Confused 45.3%
Disgusted 45.4%
Calm 49.2%

AWS Rekognition

Age 10-15
Gender Female, 52.1%
Calm 49.4%
Angry 45.6%
Sad 48.1%
Happy 45.6%
Confused 45.3%
Surprised 45.5%
Disgusted 45.4%

AWS Rekognition

Age 30-47
Gender Male, 54.8%
Sad 45.7%
Disgusted 45.2%
Happy 45.5%
Angry 45.9%
Surprised 45.6%
Calm 51.5%
Confused 45.7%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Shoe 98.1%