Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: New York detained; men and women waiting for friends.

Date

c. 1903

People

Artist: J. H. Adams, American active 1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2392.1

Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: New York detained; men and women waiting for friends.

People

Artist: J. H. Adams, American active 1900s

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2392.1

Machine Generated Data

Tags

Amazon
created on 2019-04-01

Human 99
Person 99
Person 98.9
Person 98.4
Person 98.3
Person 98
Person 97.5
Audience 96.7
Crowd 96.7
Person 96.3
Person 96
Person 95.5
Person 95
Person 94.4
Painting 88.8
Art 88.8
Person 88.5
Person 88.3
Person 85.9
Person 80.5
Person 78.9
Indoors 76
People 75.5
Room 75.4
Person 70.6
Person 68.1
Person 66.4
Person 63.6
Sitting 60.3

Clarifai
created on 2018-04-18

people 100
group 99.8
many 99.7
adult 98.7
woman 96.3
group together 95.7
leader 95.3
administration 93.5
wear 93.4
man 93.2
music 90.5
several 89.5
furniture 88.5
military 87.9
sit 87.8
crowd 87.3
recreation 86.3
vehicle 83.9
chair 81.5
outfit 80.5

Imagga
created on 2018-04-18

celebration 18.3
interior 16.8
decoration 16.1
glass 15.3
metropolitan 13.6
light 13.4
party 12.9
luxury 12.8
elegant 12.8
man 12.8
table 12.2
old 11.8
religion 11.6
crown 11.6
chair 11.6
carousel 11.5
night 11.5
window 11.4
art 11.4
people 11.1
vintage 10.9
city 10.8
chandelier 10.8
antique 10.5
home 10.4
holiday 10
dress 9.9
male 9.9
romantic 9.8
person 9.7
portrait 9.7
room 9.7
musical instrument 9.7
restaurant 9.5
menorah 9.4
architecture 9.4
dark 9.2
design 9
romance 8.9
style 8.9
love 8.7
building 8.7
men 8.6
house 8.5
ride 8.5
church 8.3
traditional 8.3
tradition 8.3
fashion 8.3
wedding 8.3
couple 7.8
life 7.8
flowers 7.8
color 7.8
pretty 7.7
winter 7.7
god 7.6
stringed instrument 7.6
two 7.6
marriage 7.6
candelabrum 7.6
place 7.4
event 7.4
retro 7.4
girls 7.3
lifestyle 7.2
history 7.1
women 7.1
crown jewels 7.1
travel 7

Google
created on 2018-04-18

Microsoft
created on 2018-04-18

person 99.6
outdoor 87.6
old 83.6
group 83.2
people 81.2
white 66.2
clothes 24.6
crowd 1.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 53.3%
Surprised 45.3%
Happy 45.2%
Calm 46.9%
Angry 45.8%
Confused 45.2%
Sad 45.2%
Disgusted 51.2%

AWS Rekognition

Age 26-43
Gender Female, 79.9%
Disgusted 2.5%
Calm 52.5%
Sad 8.3%
Confused 13.9%
Happy 13.7%
Surprised 4.5%
Angry 4.6%

AWS Rekognition

Age 26-43
Gender Female, 80.8%
Confused 14.8%
Happy 2.3%
Calm 41.8%
Sad 18.6%
Angry 14%
Disgusted 3.8%
Surprised 4.8%

AWS Rekognition

Age 11-18
Gender Female, 98.3%
Sad 39%
Calm 45.7%
Happy 1.1%
Disgusted 1.7%
Surprised 1.2%
Confused 2.8%
Angry 8.5%

AWS Rekognition

Age 9-14
Gender Male, 94.9%
Confused 3.2%
Surprised 0.6%
Sad 15.9%
Calm 5.9%
Disgusted 0.6%
Angry 73.1%
Happy 0.6%

AWS Rekognition

Age 26-43
Gender Male, 63.8%
Angry 6.6%
Disgusted 4.7%
Sad 6.7%
Calm 36.3%
Happy 19.8%
Confused 14.3%
Surprised 11.6%

AWS Rekognition

Age 35-52
Gender Male, 99.5%
Confused 5.5%
Angry 27.4%
Sad 4.8%
Calm 19.8%
Happy 4.8%
Surprised 1.7%
Disgusted 36%

AWS Rekognition

Age 35-52
Gender Female, 50.9%
Sad 45.9%
Confused 45.2%
Calm 52.4%
Disgusted 45.9%
Angry 45.2%
Happy 45.1%
Surprised 45.3%

AWS Rekognition

Age 11-18
Gender Female, 54.5%
Happy 45.1%
Confused 45.1%
Surprised 45.1%
Calm 45.4%
Disgusted 45.2%
Angry 45.2%
Sad 53.9%

AWS Rekognition

Age 26-43
Gender Male, 59.6%
Happy 0.7%
Sad 21.1%
Surprised 11.5%
Disgusted 2%
Angry 9.7%
Calm 34.3%
Confused 20.8%

AWS Rekognition

Age 35-52
Gender Male, 54.3%
Sad 45.5%
Happy 47.5%
Disgusted 45.4%
Confused 45.5%
Calm 48.5%
Surprised 46.2%
Angry 46.4%

AWS Rekognition

Age 19-36
Gender Male, 54%
Confused 45.6%
Angry 45.3%
Sad 45.6%
Calm 53%
Happy 45.1%
Surprised 45.2%
Disgusted 45.2%

AWS Rekognition

Age 19-36
Gender Male, 92.7%
Calm 50%
Confused 11.5%
Sad 24.4%
Disgusted 1.9%
Happy 0.8%
Angry 6.4%
Surprised 5%

AWS Rekognition

Age 12-22
Gender Female, 98.9%
Confused 3.3%
Disgusted 3.5%
Happy 1.2%
Sad 49.4%
Angry 5.8%
Calm 34.8%
Surprised 2%

AWS Rekognition

Age 35-52
Gender Male, 54.5%
Surprised 45.1%
Calm 49.1%
Disgusted 45.6%
Confused 45.4%
Sad 49.3%
Angry 45.4%
Happy 45.2%

AWS Rekognition

Age 30-47
Gender Male, 53.3%
Confused 45.5%
Angry 47.5%
Sad 47.5%
Calm 45.7%
Happy 45.2%
Surprised 45.3%
Disgusted 48.4%

AWS Rekognition

Age 26-44
Gender Male, 53.6%
Calm 49.4%
Happy 45.7%
Sad 46.3%
Angry 46.1%
Surprised 45.3%
Disgusted 47%
Confused 45.3%

AWS Rekognition

Age 29-45
Gender Female, 53.3%
Confused 45.1%
Surprised 45.1%
Sad 52.2%
Calm 45.2%
Disgusted 46.8%
Angry 45.4%
Happy 45.1%

AWS Rekognition

Age 14-25
Gender Female, 98.5%
Confused 4.1%
Sad 79.2%
Surprised 0.8%
Disgusted 3.3%
Calm 4.7%
Angry 3.1%
Happy 4.7%

AWS Rekognition

Age 38-59
Gender Male, 52.1%
Confused 45.4%
Sad 46.9%
Surprised 45.7%
Happy 46.1%
Disgusted 46.5%
Angry 46.3%
Calm 48.1%

AWS Rekognition

Age 38-59
Gender Male, 88.3%
Confused 5.8%
Sad 31.9%
Surprised 3.3%
Disgusted 4.9%
Happy 21.5%
Calm 25.6%
Angry 7.1%

AWS Rekognition

Age 35-52
Gender Female, 53.1%
Disgusted 48.3%
Calm 47.4%
Happy 45.3%
Surprised 45.3%
Confused 45.4%
Angry 47.5%
Sad 45.9%

AWS Rekognition

Age 26-43
Gender Male, 51.9%
Surprised 45.3%
Confused 45.4%
Happy 45.2%
Angry 45.5%
Calm 49.4%
Disgusted 45.1%
Sad 49%

AWS Rekognition

Age 26-43
Gender Male, 84.8%
Angry 2.7%
Disgusted 2%
Happy 1.6%
Sad 11.2%
Surprised 0.9%
Confused 2.5%
Calm 79.2%

AWS Rekognition

Age 27-44
Gender Female, 50.4%
Surprised 45.1%
Calm 45.2%
Sad 53.3%
Disgusted 45.9%
Angry 45.3%
Happy 45.1%
Confused 45.1%

AWS Rekognition

Age 35-55
Gender Female, 51.8%
Confused 45.1%
Angry 45.2%
Sad 45.7%
Calm 53.3%
Happy 45.1%
Surprised 45.1%
Disgusted 45.5%

AWS Rekognition

Age 26-43
Gender Male, 52.3%
Angry 45.3%
Disgusted 45.5%
Confused 45.3%
Surprised 45.3%
Calm 52.3%
Sad 45.5%
Happy 45.8%

AWS Rekognition

Age 26-43
Gender Male, 88.1%
Confused 1.7%
Disgusted 14.9%
Happy 0.6%
Sad 42%
Angry 19.2%
Calm 20.6%
Surprised 0.8%

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Happy 8.1%
Disgusted 1%
Confused 5.1%
Sad 3.2%
Surprised 1.3%
Angry 2.7%
Calm 78.6%

AWS Rekognition

Age 26-43
Gender Female, 53.6%
Angry 45.6%
Disgusted 45.6%
Confused 46.3%
Surprised 45.3%
Calm 48.4%
Sad 48.5%
Happy 45.3%

AWS Rekognition

Age 20-38
Gender Female, 54.3%
Confused 45.4%
Happy 46%
Surprised 45.2%
Sad 45.6%
Angry 45.5%
Calm 52.2%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Female, 72.5%
Angry 3.6%
Happy 4%
Calm 28.3%
Disgusted 2%
Confused 2.4%
Sad 58.2%
Surprised 1.5%

AWS Rekognition

Age 20-38
Gender Male, 54.2%
Angry 46.8%
Disgusted 48.8%
Confused 45.5%
Surprised 45.3%
Calm 47%
Sad 46.2%
Happy 45.3%

AWS Rekognition

Age 16-27
Gender Female, 52.7%
Confused 45.5%
Surprised 46%
Calm 49.8%
Sad 45.3%
Angry 46.3%
Happy 45.7%
Disgusted 46.5%

AWS Rekognition

Age 14-23
Gender Male, 51.4%
Angry 47.7%
Sad 46.7%
Calm 45.8%
Happy 46.6%
Surprised 45.8%
Disgusted 46.5%
Confused 45.9%

AWS Rekognition

Age 26-43
Gender Male, 94.8%
Disgusted 35.8%
Angry 6.6%
Sad 26.8%
Calm 15.9%
Happy 9.5%
Surprised 2.4%
Confused 3.1%

AWS Rekognition

Age 20-38
Gender Female, 52.9%
Confused 45.2%
Sad 49.9%
Surprised 45.4%
Disgusted 45.7%
Happy 45.7%
Calm 45.6%
Angry 47.5%

AWS Rekognition

Age 20-38
Gender Male, 54.2%
Confused 46.3%
Sad 47.4%
Disgusted 45.6%
Angry 45.8%
Surprised 45.9%
Happy 45.9%
Calm 48.1%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Angry 46.4%
Surprised 45.5%
Confused 46.1%
Sad 47.6%
Calm 48.6%
Disgusted 45.4%
Happy 45.5%

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 57
Gender Female

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 12
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Painting 88.8%

Categories

Imagga

people portraits 97.5%
events parties 2.5%