Human Generated Data

Title

Untitled (Tiger Balm Garden, Hong Kong)

Date

March 3, 1960-March 13, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5420

Human Generated Data

Title

Untitled (Tiger Balm Garden, Hong Kong)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 3, 1960-March 13, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5420

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Plant 100
Potted Plant 100
People 100
Face 99.8
Head 99.8
Photography 99.8
Portrait 99.8
Beard 99.7
Person 99.3
Person 99.1
Person 98.9
Adult 98.9
Bride 98.9
Female 98.9
Wedding 98.9
Woman 98.9
Person 98.7
Adult 98.7
Male 98.7
Man 98.7
Person 98.5
Clothing 98.2
Hat 98.2
Person 98
Adult 98
Male 98
Man 98
Garden 94.7
Nature 94.7
Outdoors 94.7
Shirt 91.4
Gardening 83.8
Person 77.3
Person 76.1
Flower 74
Flower Arrangement 57.9
Baseball Cap 57.5
Cap 57.5
Musical Instrument 55.9
Flower Bouquet 55.2
Blouse 55.1

Clarifai
created on 2018-05-10

people 99.8
group 99.2
group together 95.8
child 95.7
adult 95.1
woman 94.9
man 94.3
administration 93.5
many 92
boy 88.1
war 86.4
several 85.7
leader 84.5
wear 83.7
music 80
five 79.9
education 79.3
family 78.5
military 78.3
police 76.6

Imagga
created on 2023-10-06

shop 33.7
people 30.7
man 29.6
classroom 26.3
male 25.8
room 24.9
mercantile establishment 22.6
adult 21.7
smiling 21.7
person 21.5
barbershop 21.4
child 20.1
sitting 19.7
family 18.7
boy 18.2
home 17.5
happy 17.5
couple 17.4
business 17
day 16.5
table 16.4
children 16.4
together 15.8
place of business 15.1
businessman 15
hospital 15
father 14.5
30s 14.4
women 14.2
meeting 14.1
color 13.9
men 13.7
bakery 13.5
adults 13.2
indoors 13.2
mature 13
lifestyle 13
education 13
restaurant 12.9
businesswoman 12.7
40s 12.6
team 12.5
businesspeople 12.3
cheerful 12.2
smile 12.1
dad 12.1
group 12.1
indoor 11.9
holding 11.6
mother 11.5
teacher 11.3
clothes 11.2
casual clothing 10.8
colleagues 10.7
looking 10.4
school 10.3
two 10.2
kid 9.7
class 9.6
professional 9.6
talking 9.5
office 9.3
food 9.2
student 9
discussion 8.8
chair 8.7
work 8.7
daytime 8.7
happiness 8.6
teamwork 8.3
camera 8.3
clothing 8.3
parent 8.3
20s 8.2
cafeteria 8.2
new 8.1
to 8
interior 8
working 7.9
life 7.9
building 7.8
days 7.8
portrait 7.8
daughter 7.8
corporate 7.7
four 7.7
casual 7.6
eating 7.6
females 7.6
desk 7.6
togetherness 7.5
friends 7.5
enjoyment 7.5
establishment 7.5
senior 7.5
worker 7.3
confident 7.3
black 7.2
kitchen 7.2
patient 7.1
medical 7.1
dinner 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.8
people 67
group 61.7
crowd 1.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-57
Gender Male, 99.3%
Calm 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.3%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 36-44
Gender Female, 100%
Happy 95.6%
Surprised 6.4%
Fear 6%
Sad 2.3%
Calm 2.2%
Angry 0.6%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 6-14
Gender Female, 85.5%
Happy 78.5%
Fear 17%
Surprised 6.5%
Sad 2.3%
Calm 0.9%
Disgusted 0.8%
Confused 0.8%
Angry 0.3%

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 98.6%
Surprised 6.4%
Fear 6.1%
Sad 2.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Calm 0.1%

AWS Rekognition

Age 42-50
Gender Male, 99.8%
Calm 74.7%
Surprised 6.8%
Fear 6.2%
Confused 5.9%
Angry 5.7%
Happy 4.5%
Sad 4%
Disgusted 2.8%

AWS Rekognition

Age 12-20
Gender Male, 56.3%
Happy 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Confused 0%
Disgusted 0%
Calm 0%

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Adult 98.9%
Bride 98.9%
Female 98.9%
Woman 98.9%
Male 98.7%
Man 98.7%

Categories