Human Generated Data

Title

Star's Daughter (Seventh of eleven): Monika enjoys shopping for groceries at a small Italian store near her apartment in a Manhattan hotel. She loves to cook.

Date

1964-65

People

Artist: Gordon W. Gahan, American 1945 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.16

Human Generated Data

Title

Star's Daughter (Seventh of eleven): Monika enjoys shopping for groceries at a small Italian store near her apartment in a Manhattan hotel. She loves to cook.

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1964-65

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-22

Human 98.6
Person 98.6
Person 98.4
Clothing 98.3
Apparel 98.3
Person 96.6
Accessory 92.6
Tie 92.6
Accessories 92.6
Face 69.8
Shop 65.7
Shelf 64
Food 62.7
Plant 59.3
Overcoat 58.5
Coat 58.5
Hat 56.4
Bazaar 55.4
Market 55.4

Clarifai
created on 2019-03-22

people 99.9
two 98.9
group 98.8
adult 98.5
group together 97.8
street 97.4
monochrome 97.2
man 97.2
woman 96.3
three 95.2
commerce 95.1
four 94.9
several 94.4
merchant 93.1
market 91.8
child 90.8
many 89.7
portrait 88.7
wear 87
administration 85.8

Imagga
created on 2019-03-22

person 28.9
man 28.9
people 28.4
adult 27.2
seller 24.7
portrait 23.9
fashion 23.4
black 20.7
male 19.2
attractive 18.9
sitting 17.2
sexy 16.9
stall 16.6
couple 16.5
pretty 16.1
face 14.9
model 14.8
smiling 13
expression 12.8
dress 12.6
happy 12.5
smile 12.1
human 12
elegant 12
shop 12
hair 11.9
elegance 11.7
lifestyle 11.6
posing 11.5
suit 11.5
lady 11.4
old 11.1
room 11
sensual 10.9
looking 10.4
sensuality 10
style 9.6
vertical 9.6
kin 9.4
dark 9.2
clothing 9.2
indoor 9.1
holding 9.1
one 9
interior 8.8
indoors 8.8
home 8.8
brunette 8.7
women 8.7
standing 8.7
love 8.7
two 8.5
passion 8.5
20s 8.2
guy 8
market 8
cute 7.9
vintage 7.7
relationship 7.5
traditional 7.5
lips 7.4
food 7.3
make 7.3
stylish 7.2
together 7
look 7

Google
created on 2019-03-22

Microsoft
created on 2019-03-22

person 96.8
outdoor 88.2
booth 65.7
store 62.2
marketplace 57.8
shop 13.4
black and white 4.8
monochrome 3
street 2.9
people 1.3
retro 1.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-53
Gender Male, 96.2%
Angry 3.7%
Calm 30.8%
Disgusted 1.4%
Confused 2.7%
Sad 58.5%
Happy 1.2%
Surprised 1.7%

AWS Rekognition

Age 26-43
Gender Female, 94.8%
Sad 48%
Disgusted 13.2%
Angry 10.6%
Calm 9.3%
Happy 3.8%
Confused 9.9%
Surprised 5.2%

AWS Rekognition

Age 26-43
Gender Female, 52.3%
Happy 46%
Surprised 45.9%
Calm 47.8%
Angry 46.4%
Confused 45.3%
Sad 46.6%
Disgusted 46.9%

AWS Rekognition

Age 49-69
Gender Female, 52.3%
Happy 47.9%
Sad 48.3%
Disgusted 46.1%
Angry 45.6%
Calm 46.1%
Surprised 45.7%
Confused 45.3%

Microsoft Cognitive Services

Age 64
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Tie 92.6%

Captions

Microsoft

a man and a woman standing in front of a store 74.7%
a group of people standing in front of a store 74.6%
a person standing in front of a store 74.5%

Text analysis

Amazon

ALE
ALE 6
6
TAID