Human Generated Data

Title

Janine Pease Pretty-on-Top with Granddaughter, Lodge Grass, MO

Date

2002

People

Artist: Andrea Modica, American born 1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sidney and Shirley Singer, 2013.178.6

Copyright

© Andrea Modica

Human Generated Data

Title

Janine Pease Pretty-on-Top with Granddaughter, Lodge Grass, MO

People

Artist: Andrea Modica, American born 1961

Date

2002

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 97.1
Human 97.1
Plant 78.1
Person 77.5
Face 77.1
Food 72
Meal 72
Clothing 71.1
Apparel 71.1
Pants 71.1
Basket 69.6
Outdoors 68.3
Female 67.8
Vegetation 67.7
People 62.8
Portrait 62.7
Photography 62.7
Photo 62.7
Chair 62.4
Furniture 62.4
Grass 60.2
Tree 59.9
Nature 59.3
Land 59.3
Child 59.1
Kid 59.1
Baby 56.6
Girl 55.2

Clarifai
created on 2018-02-09

people 99.8
adult 99
one 97.3
portrait 96.7
man 95.9
wear 93.8
woman 92.5
sit 91.8
vintage 91.7
retro 91.2
sitting 90.9
two 89.8
outfit 89.2
chair 85.5
furniture 85.2
art 84.2
seat 83.6
child 83.3
facial expression 83
guitar 82.1

Imagga
created on 2018-02-09

vehicle 49.4
tricycle 38.9
conveyance 35.6
athlete 34.5
runner 33.6
sport 33.5
skateboard 28.1
person 26.8
jump 24.9
active 24.3
board 22.5
jumping 22.2
unicycle 21
man 20.8
outdoors 20.4
fun 20.2
people 20.1
adult 20
action 18.5
male 18.4
silhouette 18.2
exercise 18.1
fitness 18.1
contestant 18
outdoor 17.6
happy 17.5
recreation 17
sky 15.9
lifestyle 15.9
bike 15.6
bicycle 15.5
ball 15.5
player 15
leisure 14.9
competition 14.6
goal 14.4
activity 14.3
cyclist 13.8
outside 13.7
grass 13.4
health 13.2
smiling 13
athletic 12.4
boy 12.1
skate 12
freedom 11.9
field 11.7
summer 11.6
sports 11.1
soccer 10.6
football 10.6
play 10.3
motion 10.3
youth 10.2
happiness 10.2
energy 10.1
joy 10
smile 10
sunset 9.9
cycle 9.8
kick 9.8
old 9.7
black 9.7
exercising 9.6
child 9.6
training 9.2
attractive 9.1
team 9
success 8.8
high 8.7
men 8.6
enjoying 8.5
fly 8.4
fit 8.3
one 8.2
teenager 8.2
sun 8
body 8
cool 8
kid 8
biking 7.9
foot 7.6
clouds 7.6
flying 7.6
healthy 7.6
fashion 7.5
art 7.4
alone 7.3
game 7.1

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

outdoor 98.3
sport 83.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 99.6%
Sad 1.2%
Calm 91.1%
Confused 1.7%
Disgusted 1.5%
Surprised 0.7%
Happy 3.2%
Angry 0.6%

Microsoft Cognitive Services

Age 67
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%

Captions

Microsoft

a vintage photo of a man jumping in the air 63.2%
a man jumping in the air 63.1%
a vintage photo of a man flying through the air 47.5%