Human Generated Data

Title

Untitled (Tiger Balm Garden, Hong Kong)

Date

March 3, 1960-March 13, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2305

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Tiger Balm Garden, Hong Kong)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 3, 1960-March 13, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2305

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.8
Human 99.8
Person 99.8
Person 99.7
Person 99.3
Person 99.3
Person 98.9
Face 97.4
Accessories 93.1
Sunglasses 93.1
Accessory 93.1
People 92.4
Apparel 85.9
Clothing 85.9
Hair 73
Person 71.5
Person 68.5
Beard 67.3
Crowd 66
Photography 64
Portrait 64
Photo 64
Female 63.3
Family 59.8
Musician 55.1
Musical Instrument 55.1
Person 47

Clarifai
created on 2018-03-23

people 99.8
group 99.5
adult 97.8
group together 97.5
many 97
woman 96.1
administration 95.4
man 94.9
several 94.1
leader 93.8
wear 92.7
music 90.3
child 90
war 87.6
five 86.4
military 85.3
facial expression 84.3
musician 84.2
outfit 81.3
recreation 80.8

Imagga
created on 2018-03-23

man 37.6
people 33.5
male 31.6
couple 27.9
person 27.6
happy 25.7
adult 24
home 22.3
women 20.6
together 18.4
sitting 18
happiness 18
smiling 17.4
lifestyle 17.3
men 17.2
attractive 16.8
smile 16.4
family 16
indoors 15.8
indoor 15.5
cheerful 15.4
life 14.9
holding 14.9
hairdresser 14.8
salon 14.5
two 14.4
love 14.2
senior 14.1
business 14
standing 13.9
room 13.9
shop 13.9
portrait 13.6
mother 12.7
husband 12.5
professional 12.5
enjoying 12.3
table 12.1
mature 12.1
interior 11.5
wife 11.4
meeting 11.3
pretty 11.2
teacher 10.4
togetherness 10.4
barbershop 10.4
drink 10
restaurant 10
kitchen 9.8
handsome 9.8
classroom 9.7
businessman 9.7
boy 9.6
businesspeople 9.5
child 9.3
face 9.2
20s 9.2
businesswoman 9.1
group 8.9
medical 8.8
looking 8.8
parent 8.8
father 8.7
work 8.6
friends 8.5
relationship 8.4
black 8.4
modern 8.4
student 8.4
color 8.3
mercantile establishment 8.3
fashion 8.3
confident 8.2
cup 8.1
waiter 7.9
middle aged 7.8
affectionate 7.7
expression 7.7
loving 7.6
casual 7.6
hand 7.6
joy 7.5
enjoyment 7.5
office 7.5
leisure 7.5
coffee 7.4
care 7.4
patient 7.4
food 7.2
success 7.2
dress 7.2
holiday 7.2
domestic 7.1

Google
created on 2018-03-23

photograph 95.3
social group 95.1
black and white 86.3
crowd 84.2
snapshot 81.8
monochrome photography 68.6
monochrome 61.4
event 60.9
family 59.6
child 57.2
fun 57.1
girl 52
style 50.7

Microsoft
created on 2018-03-23

person 100
outdoor 87.2
group 62.5
people 59.9
dressed 33.7
clothes 15.3
crowd 7.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 91.8%
Happy 7.2%
Calm 41.7%
Surprised 8%
Angry 17.1%
Confused 9.6%
Disgusted 10.1%
Sad 6.3%

AWS Rekognition

Age 23-38
Gender Male, 77.1%
Happy 96.2%
Calm 0.2%
Surprised 0.6%
Angry 0.7%
Confused 0.4%
Disgusted 1.1%
Sad 0.8%

AWS Rekognition

Age 26-43
Gender Female, 52.7%
Disgusted 0.1%
Confused 0%
Angry 0.1%
Surprised 0.1%
Happy 99.7%
Sad 0%
Calm 0%

AWS Rekognition

Age 38-59
Gender Female, 54.6%
Sad 45.3%
Angry 45.5%
Disgusted 45.2%
Surprised 45.4%
Calm 49%
Happy 49.5%
Confused 45.2%

AWS Rekognition

Age 45-66
Gender Male, 54.9%
Calm 51.9%
Sad 46%
Confused 45.7%
Happy 45.2%
Disgusted 45.2%
Angry 45.7%
Surprised 45.2%

AWS Rekognition

Age 10-15
Gender Male, 83.4%
Happy 32.5%
Confused 15.1%
Sad 25.8%
Angry 8.7%
Calm 6.1%
Disgusted 5.1%
Surprised 6.7%

Microsoft Cognitive Services

Age 60
Gender Male

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Sunglasses 93.1%

Categories

Imagga

people portraits 98.5%
events parties 1.4%