Human Generated Data

Title

Anne Marie Penzkover with Niece, Hayward, WI

Date

2002

People

Artist: Andrea Modica, American born 1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sidney and Shirley Singer, 2013.178.7

Copyright

© Andrea Modica

Human Generated Data

Title

Anne Marie Penzkover with Niece, Hayward, WI

People

Artist: Andrea Modica, American born 1961

Date

2002

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Apparel 100
Clothing 100
Person 99.4
Human 99.4
Fashion 96.3
Cloak 95.7
Person 85.4
Poncho 59
Long Sleeve 58.8
Sleeve 58.8
Coat 57.2
Overcoat 57.2

Clarifai
created on 2018-02-09

people 100
portrait 99.7
adult 99
monochrome 98.5
woman 98.2
wedding 97.6
wear 96.8
child 96.1
group 95.6
dress 95.5
two 94.4
girl 93.5
man 93.4
one 92.9
retro 92.6
actress 91.6
vintage 90.6
art 89.1
facial expression 87.2
street 86.3

Imagga
created on 2018-02-09

robe 77.2
garment 58.9
clothing 44.9
covering 32.7
black 30.9
person 26
business 24.9
man 24.9
people 24
male 22.7
adult 21.4
businessman 18.5
suit 16.2
executive 15.8
professional 15.4
cloak 15.1
smile 15
work 14.9
lady 14.6
silhouette 14.1
attractive 14
corporate 13.7
model 13.2
happy 13.2
standing 13
smiling 13
success 12.9
dress 12.6
face 12.1
office 12
holding 11.6
job 11.5
fashion 11.3
clothes 11.2
field 10.9
outdoor 10.7
worker 10.7
posing 10.7
career 10.4
portrait 10.4
confident 10
looking 9.6
manager 9.3
businesswoman 9.1
gorgeous 9.1
sunset 9
women 8.7
happiness 8.6
men 8.6
casual 8.5
laptop 8.3
human 8.2
friendly 8.2
religion 8.1
computer 8.1
sexy 8
working 8
hair 7.9
brunette 7.8
eyes 7.7
pretty 7.7
old 7.7
sky 7.7
costume 7.6
studio 7.6
hand 7.6
smart 7.5
park 7.4
20s 7.3
pose 7.2
lifestyle 7.2
grass 7.1

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

grass 98.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-65
Gender Female, 99.8%
Sad 18.9%
Surprised 7.4%
Disgusted 14.4%
Confused 10.4%
Calm 16.6%
Happy 3.1%
Angry 29.3%

AWS Rekognition

Age 9-14
Gender Female, 99.2%
Surprised 3.1%
Angry 2.3%
Disgusted 2.5%
Confused 0.7%
Happy 1.3%
Calm 72.5%
Sad 17.5%

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Overcoat 57.2%

Captions

Microsoft

a person standing in a field 88.4%
a person standing in the grass 88.3%
a person is standing in the grass 85.8%