Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 220. The H.A.S. Success Club.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3564.3

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 220. The H.A.S. Success Club.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3564.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.7
Person 99.7
Person 99.6
Person 99.4
Person 98.9
Person 98.4
Person 98.3
Person 97.5
Person 95
Person 93.9
Person 93.6
Person 91.5
People 91.3
Person 90.3
Person 82.8
Crowd 79
Furniture 77.8
Chair 77.8
Audience 75.7
Footwear 75.6
Shoe 75.6
Clothing 75.6
Apparel 75.6
Person 73.4
Indoors 67.4
Room 67.1
Shoe 65.1
Military 57.4
Military Uniform 55.6
Person 50.4

Clarifai
created on 2019-06-05

people 100
many 99.8
group 99.6
group together 98.6
adult 98.2
administration 97.7
leader 97.1
military 97.1
man 96.3
wear 96.1
uniform 92.7
crowd 92.1
child 91.9
outfit 91.6
war 90.1
military uniform 89.8
woman 89
soldier 86.5
education 84.8
several 81.7

Imagga
created on 2019-06-05

kin 62.4
people 29.6
man 24.2
child 21.8
beach 20.2
male 19.9
silhouette 19
family 18.7
person 17.7
sand 16.8
sport 16.2
outdoor 15.3
lifestyle 15.2
summer 14.8
happy 14.4
adult 14.4
walking 14.2
boy 13.9
mother 13.6
couple 13.1
water 12.7
active 12.7
black 12.6
sunset 12.6
sea 12.5
walk 12.4
vacation 12.3
sky 12.1
youth 11.9
statue 11.7
world 11.3
travel 11.3
play 11.2
outdoors 11.2
men 11.2
love 11
happiness 11
parent 10.6
together 10.5
fun 10.5
ocean 10
wind instrument 9.9
life 9.9
kid 9.7
group 9.7
run 9.6
women 9.5
portrait 9.1
coast 9
recreation 9
father 9
musical instrument 8.8
running 8.6
two 8.5
relax 8.4
old 8.4
city 8.3
leisure 8.3
exercise 8.2
sunlight 8
holiday 7.9
day 7.8
brass 7.7
sculpture 7.6
athlete 7.5
joy 7.5
friends 7.5
friendship 7.5
vintage 7.4
action 7.4
art 7.4
street 7.4
girls 7.3
grass 7.1

Google
created on 2019-06-05

People 96.3
Photograph 95
Social group 93
Snapshot 82.5
Family 70.5
Team 59.4
Vintage clothing 57
History 54.1

Microsoft
created on 2019-06-05

person 99.5
clothing 99.2
outdoor 98.8
posing 97.2
group 95.5
man 94.2
footwear 73.7
smile 71.4
old 70.4
human face 55.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Sad 54.6%
Confused 45.2%
Calm 45.1%
Disgusted 45%
Happy 45%
Angry 45.1%
Surprised 45%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Sad 52.7%
Disgusted 45.2%
Surprised 45.1%
Angry 45.8%
Happy 45.1%
Calm 46.1%
Confused 45.1%

AWS Rekognition

Age 15-25
Gender Male, 54.6%
Disgusted 45.1%
Happy 45%
Surprised 45.1%
Angry 45.6%
Confused 45.1%
Calm 46.3%
Sad 52.7%

AWS Rekognition

Age 20-38
Gender Male, 54.7%
Happy 45.3%
Calm 53.9%
Sad 45.5%
Angry 45.1%
Confused 45.1%
Surprised 45.1%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.1%
Surprised 45.1%
Confused 45.1%
Sad 53.6%
Disgusted 45.1%
Calm 45.4%
Angry 45.5%
Happy 45.1%

AWS Rekognition

Age 23-38
Gender Male, 54.6%
Calm 53.8%
Sad 45.5%
Disgusted 45.1%
Happy 45.2%
Surprised 45.1%
Angry 45.1%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Sad 48.1%
Disgusted 45.1%
Confused 45.1%
Happy 45.1%
Calm 50.5%
Surprised 45.1%
Angry 46.1%

AWS Rekognition

Age 26-43
Gender Male, 53.3%
Surprised 45.1%
Happy 45.1%
Sad 47%
Angry 45.6%
Disgusted 45.2%
Calm 51.9%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50%
Sad 45.6%
Angry 45.6%
Calm 53.4%
Happy 45.1%
Disgusted 45.1%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 17-27
Gender Male, 54.5%
Angry 46.3%
Sad 51.8%
Disgusted 45.1%
Calm 46.4%
Happy 45.1%
Confused 45.3%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Disgusted 45%
Confused 45.2%
Surprised 45.1%
Calm 52.2%
Happy 45%
Angry 45.9%
Sad 46.6%

AWS Rekognition

Age 15-25
Gender Female, 53.7%
Disgusted 45.1%
Surprised 45.1%
Sad 53.8%
Calm 45.6%
Angry 45.3%
Happy 45%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.2%
Sad 45.9%
Confused 45.1%
Happy 45.2%
Surprised 45.1%
Disgusted 45.2%
Angry 45.9%
Calm 52.6%

AWS Rekognition

Age 26-43
Gender Male, 53%
Sad 48.5%
Calm 47.9%
Happy 45.2%
Disgusted 45.2%
Surprised 45.2%
Confused 45.1%
Angry 48%

AWS Rekognition

Age 26-43
Gender Male, 52.3%
Sad 54.7%
Angry 45.2%
Calm 45%
Happy 45%
Disgusted 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Confused 45.1%
Calm 53.6%
Angry 45.1%
Sad 45.1%
Happy 45.4%
Disgusted 45.4%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Female, 51.6%
Disgusted 45%
Sad 54.4%
Surprised 45%
Calm 45.3%
Happy 45%
Confused 45.1%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.1%
Surprised 45.1%
Calm 51.7%
Happy 45.1%
Sad 47.8%
Confused 45.1%
Angry 45.2%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Female, 52.7%
Surprised 45.2%
Confused 45.1%
Happy 45.2%
Angry 45.2%
Calm 46.2%
Sad 52.9%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Male, 54.5%
Disgusted 45.2%
Happy 45.2%
Surprised 45.1%
Angry 45.3%
Confused 45.1%
Calm 52.7%
Sad 46.4%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Angry 46.1%
Surprised 45.1%
Confused 45.4%
Sad 51.6%
Disgusted 45.4%
Happy 45.2%
Calm 46.3%

AWS Rekognition

Age 16-27
Gender Male, 53.3%
Confused 45.1%
Sad 51%
Calm 48.4%
Happy 45%
Angry 45.3%
Surprised 45.1%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Male, 52.5%
Sad 49.4%
Disgusted 45.3%
Confused 45.2%
Happy 45.3%
Calm 48.4%
Surprised 45.3%
Angry 46%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Surprised 45.2%
Disgusted 45.2%
Calm 46%
Sad 52.3%
Confused 45.1%
Angry 46%
Happy 45.1%

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 75.6%