Human Generated Data

Title

Sixteen Men Carrying a Giant Hogshead

Date

19th century

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, The Edwin Binney, 3rd Collection of Turkish Art at the Harvard Art Museums, 1985.256

Human Generated Data

Title

Sixteen Men Carrying a Giant Hogshead

Date

19th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, The Edwin Binney, 3rd Collection of Turkish Art at the Harvard Art Museums, 1985.256

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Clothing 99.7
Apparel 99.7
Human 99.7
Person 99.7
Person 99.6
Person 98.9
Person 98.7
Person 98.6
Person 95.8
Person 94.2
Person 90.3
Person 88.3
Helmet 87.9
Hardhat 87.2
Painting 79.1
Art 79.1
Person 77.2
Person 75.4
Transportation 73.5
Train 73.5
Vehicle 73.5
Person 72.1
Hat 65.5
People 65.2
Building 64.5
Worker 61.9
Pants 61.6
Costume 60.6
Person 47.9
Person 46.3

Clarifai
created on 2020-04-24

people 99.9
group 99.2
man 98.5
adult 98.4
group together 98.2
woman 98.1
music 97.2
religion 92.2
many 92.2
girl 90.7
child 90.1
drum 89.9
boy 89.5
street 89.4
city 88.7
castle 86.2
wear 85.6
several 85
recreation 84.7
veil 84.5

Imagga
created on 2020-04-24

dancer 66.4
performer 56.2
entertainer 40.3
percussion instrument 32.7
person 27.9
musical instrument 25.5
marimba 25
people 17.3
drum 15.5
adult 14.9
teacher 14.7
old 14.6
man 14.1
interior 13.3
costume 12.8
winery 12.4
educator 12.1
traditional 11.6
night 11.5
male 11.3
indoor 10.9
lifestyle 10.8
color 10.6
hall 10.4
home 10.4
building 10.3
professional 10.3
sport 10.1
scene 9.5
culture 9.4
decoration 8.8
body 8.8
indoors 8.8
happy 8.8
play 8.6
festival 8.6
holiday 8.6
travel 8.4
floor 8.4
dark 8.3
city 8.3
musician 8.1
dance 8
light 8
celebration 8
architecture 7.8
portrait 7.8
sitting 7.7
men 7.7
elegant 7.7
motion 7.7
world 7.6
training 7.4
active 7.3
lady 7.3
hat 7.3
barrel 7.3
exercise 7.3
group 7.2
fitness 7.2
art 7.2
colorful 7.2
women 7.1
wooden 7

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

floor 99.1
person 93.8
clothing 93.5
crowd 0.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-57
Gender Male, 97.3%
Fear 6.6%
Calm 58.7%
Surprised 1.4%
Sad 21.5%
Confused 4%
Disgusted 1.9%
Happy 0.6%
Angry 5.2%

AWS Rekognition

Age 30-46
Gender Male, 96%
Angry 3.4%
Disgusted 0.6%
Surprised 24.9%
Fear 1.8%
Calm 36.6%
Happy 0.5%
Sad 16.8%
Confused 15.4%

AWS Rekognition

Age 33-49
Gender Male, 95.2%
Angry 0.7%
Sad 7.9%
Happy 0.4%
Fear 0.2%
Confused 2.1%
Surprised 0.9%
Disgusted 0.7%
Calm 87%

AWS Rekognition

Age 39-57
Gender Male, 98.4%
Angry 1.7%
Sad 56.6%
Fear 0.4%
Surprised 0.7%
Happy 0.1%
Confused 3.3%
Calm 36.8%
Disgusted 0.5%

AWS Rekognition

Age 32-48
Gender Male, 95.3%
Angry 6.9%
Fear 0.1%
Disgusted 0.2%
Happy 0.1%
Calm 88.6%
Sad 2.4%
Surprised 1.1%
Confused 0.6%

AWS Rekognition

Age 38-56
Gender Male, 95.5%
Fear 0.2%
Surprised 8%
Calm 36.1%
Confused 37.4%
Disgusted 0.7%
Happy 1.5%
Sad 14.3%
Angry 1.7%

AWS Rekognition

Age 34-50
Gender Male, 92.7%
Surprised 15.1%
Confused 3.7%
Sad 9.8%
Disgusted 0.9%
Happy 2.1%
Angry 4%
Calm 62.4%
Fear 2%

AWS Rekognition

Age 32-48
Gender Male, 97.1%
Calm 47%
Disgusted 1.2%
Happy 0.3%
Surprised 2.5%
Sad 34.6%
Confused 9.9%
Fear 0.8%
Angry 3.7%

AWS Rekognition

Age 32-48
Gender Male, 95.4%
Happy 2%
Disgusted 1%
Calm 29.5%
Angry 4.2%
Fear 1.2%
Surprised 12.9%
Sad 35.4%
Confused 14%

AWS Rekognition

Age 36-52
Gender Male, 95.8%
Calm 2.9%
Surprised 1.4%
Angry 1.3%
Happy 0.6%
Sad 86.2%
Disgusted 0.6%
Fear 2.8%
Confused 4.2%

AWS Rekognition

Age 39-57
Gender Male, 99.2%
Angry 10%
Disgusted 2.7%
Sad 1%
Calm 64%
Confused 1.6%
Happy 1%
Fear 0.5%
Surprised 19.2%

AWS Rekognition

Age 33-49
Gender Male, 97.5%
Calm 42.1%
Confused 10.9%
Angry 8.7%
Happy 1.2%
Fear 1.9%
Disgusted 3.9%
Surprised 28.8%
Sad 2.5%

AWS Rekognition

Age 25-39
Gender Male, 91.6%
Fear 4.5%
Sad 77%
Surprised 5.5%
Disgusted 0.5%
Calm 6.6%
Happy 0.4%
Angry 1.4%
Confused 4%

AWS Rekognition

Age 23-35
Gender Male, 98.6%
Disgusted 1%
Calm 55.1%
Surprised 7.6%
Angry 2.7%
Happy 2.6%
Sad 24.8%
Confused 3.5%
Fear 2.7%

AWS Rekognition

Age 26-40
Gender Male, 75.3%
Angry 29.5%
Calm 40.6%
Happy 4.9%
Confused 3.1%
Surprised 8.1%
Fear 2.5%
Sad 9.1%
Disgusted 2.2%

AWS Rekognition

Age 32-48
Gender Male, 90.1%
Confused 2.2%
Fear 0.5%
Disgusted 0.3%
Sad 89.7%
Calm 1.4%
Happy 4.2%
Surprised 0.7%
Angry 0.9%

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 61
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Painting 79.1%
Train 73.5%

Categories

Imagga

events parties 97.6%
interior objects 1.2%

Text analysis

Amazon

VE