Human Generated Data

Title

Untitled (Horse Dance, Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2338
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2338

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.1
Human 99.1
Person 99.1
Person 99
Person 96.9
Person 96.6
Person 96.5
Person 94.4
Crowd 91.9
Apparel 91.2
Clothing 91.2
Hat 90
Festival 84.4
Face 83.6
Person 81
Skin 73.8
Person 73.1
People 66.8
Costume 65.1
Person 56.3

Clarifai
created on 2018-03-23

people 99.9
group 98.2
adult 98.1
wear 97.7
many 97.3
outfit 95.6
group together 94.7
administration 93.8
man 91.9
woman 91.7
veil 90.4
leader 90.1
military 89.8
portrait 86.6
music 85.9
uniform 85.8
costume 84.7
war 83.8
actor 80.5
one 79.5

Imagga
created on 2018-03-23

comedian 95.9
mask 95.6
performer 77.7
entertainer 58.5
disguise 55.7
covering 53.6
person 42.5
attire 33.6
face 28.4
costume 27.6
portrait 22.7
clothing 22.3
man 20.8
black 19.2
male 19.2
carnival 18.5
people 17.3
crazy 16.6
horror 14.6
lady 13.8
eyes 13.8
adult 13.6
head 13.4
dress 12.7
fantasy 12.6
attractive 12.6
celebration 12
masquerade 11.8
evil 11.7
dark 11.7
sexy 11.2
expression 11.1
art 11.1
danger 10.9
model 10.9
venetian 10.8
happy 10.7
death 10.6
fashion 10.6
festival 10.5
body 10.4
consumer goods 10.3
party 10.3
emotion 10.1
entertainment 10.1
makeup 10.1
studio 9.9
hand 9.9
human 9.7
scary 9.7
mystery 9.6
decoration 9.4
holiday 9.3
make 9.1
fun 9
spooky 8.8
mysterious 8.7
fear 8.7
colorful 8.6
color 8.3
traditional 8.3
protection 8.2
hair 7.9
theater 7.8
emotional 7.8
pretty 7.7
culture 7.7
mascot 7.4
face mask 7.4
hat 7.3
suit 7.2
looking 7.2
smile 7.1
happiness 7.1

Google
created on 2018-03-23

black 95.3
black and white 93.1
monochrome photography 85.1
photography 82.2
snapshot 81.8
crowd 74.1
monochrome 71.6
human 68.3
headgear 66.8
girl 65.6
event 56.7
fun 55.9
gang 53.5

Microsoft
created on 2018-03-23

person 99.6
outdoor 91.8
group 76.3
people 74.7
white 70.6
old 51.1
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 79.2%
Surprised 0.7%
Disgusted 7%
Calm 12.3%
Confused 1.5%
Angry 1.7%
Happy 2.3%
Sad 74.5%

AWS Rekognition

Age 23-38
Gender Female, 53.2%
Calm 46.1%
Disgusted 45.1%
Sad 53%
Angry 45.2%
Confused 45.1%
Surprised 45.2%
Happy 45.3%

AWS Rekognition

Age 35-52
Gender Female, 52.9%
Sad 45.2%
Surprised 45.3%
Calm 51.5%
Happy 45.5%
Angry 45.3%
Disgusted 47.1%
Confused 45.1%

AWS Rekognition

Age 14-23
Gender Male, 53.6%
Disgusted 1.1%
Angry 0.4%
Calm 96.5%
Sad 0.6%
Happy 0.4%
Confused 0.2%
Surprised 0.8%

AWS Rekognition

Age 4-9
Gender Male, 91.4%
Disgusted 1%
Confused 9.4%
Angry 2.5%
Surprised 2.8%
Calm 18.5%
Happy 2.1%
Sad 63.6%

AWS Rekognition

Age 38-57
Gender Female, 51.2%
Angry 45.8%
Confused 45.3%
Disgusted 45.6%
Surprised 45.5%
Sad 48.9%
Calm 48.4%
Happy 45.5%

AWS Rekognition

Age 20-38
Gender Female, 98.7%
Happy 1.8%
Confused 2.5%
Sad 74.7%
Angry 1.6%
Calm 13.7%
Disgusted 4.4%
Surprised 1.2%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Happy 45.2%
Confused 45.1%
Angry 45.1%
Disgusted 45.1%
Sad 47.5%
Calm 52%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 51.8%
Happy 45.6%
Disgusted 46%
Calm 51.7%
Surprised 45.6%
Sad 45.5%
Confused 45.2%
Angry 45.3%

AWS Rekognition

Age 26-43
Gender Female, 51.8%
Confused 45.3%
Angry 45.6%
Surprised 45.4%
Calm 46.9%
Happy 49.2%
Disgusted 45.4%
Sad 47.2%

AWS Rekognition

Age 35-52
Gender Female, 54.7%
Confused 45.2%
Surprised 45.4%
Calm 45.6%
Happy 45.6%
Angry 45.5%
Sad 52.1%
Disgusted 45.6%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Sad 45.2%
Confused 45.1%
Happy 45.5%
Disgusted 45%
Angry 45.1%
Surprised 45.2%
Calm 53.9%

AWS Rekognition

Age 35-52
Gender Female, 53.5%
Calm 48.1%
Confused 45.4%
Surprised 45.9%
Disgusted 47.1%
Happy 45.4%
Angry 45.9%
Sad 47.2%

AWS Rekognition

Age 35-52
Gender Male, 89%
Calm 26.9%
Surprised 1.6%
Angry 5.5%
Sad 59.5%
Disgusted 1%
Confused 4.1%
Happy 1.2%

AWS Rekognition

Age 20-38
Gender Female, 94.3%
Disgusted 0.9%
Confused 0.7%
Angry 1.2%
Surprised 82.8%
Calm 11.4%
Happy 2.1%
Sad 0.9%

AWS Rekognition

Age 23-38
Gender Female, 50.2%
Disgusted 45%
Angry 45.1%
Calm 51.8%
Sad 45.5%
Happy 47.3%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 53.2%
Angry 45.3%
Sad 50.3%
Calm 49.1%
Confused 45.1%
Surprised 45.1%
Happy 45.1%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Female, 88.1%
Surprised 3.4%
Disgusted 32.3%
Confused 1.2%
Sad 2.1%
Angry 4.6%
Happy 1.7%
Calm 54.8%

AWS Rekognition

Age 20-38
Gender Female, 53.8%
Happy 46%
Surprised 45.5%
Disgusted 45.1%
Confused 45.2%
Angry 45.3%
Calm 46.9%
Sad 51%

AWS Rekognition

Age 6-13
Gender Male, 51.4%
Confused 45.1%
Sad 45.5%
Calm 52.1%
Happy 46.8%
Surprised 45.2%
Angry 45.1%
Disgusted 45.2%

AWS Rekognition

Age 6-13
Gender Female, 50.6%
Disgusted 45.3%
Confused 45.3%
Angry 45.2%
Surprised 45.2%
Happy 45.1%
Sad 52.1%
Calm 46.8%

AWS Rekognition

Age 26-43
Gender Female, 54.3%
Confused 45.6%
Angry 45.4%
Surprised 45.5%
Calm 50.2%
Happy 46.9%
Disgusted 45.2%
Sad 46.2%

AWS Rekognition

Age 20-38
Gender Female, 53.9%
Sad 47.7%
Calm 48%
Confused 45.3%
Disgusted 47.2%
Surprised 45.5%
Happy 45.9%
Angry 45.4%

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Hat 90%

Categories

Imagga

paintings art 56.2%
people portraits 41.7%
nature landscape 1.1%
pets animals 0.8%