Human Generated Data

Title

Untitled (Judith Shahn, Washington Square Park, New York City)
Date

1933
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5599

Human Generated Data

Title

Untitled (Judith Shahn, Washington Square Park, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1933

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5599

Machine Generated Data

Tags

Amazon
created on 2019-11-11

Apparel 99.6
Clothing 99.6
Human 98.8
Person 98.8
Face 82.1
Outdoors 72.1
Hat 65.6
Nature 61.7
Cap 60
Sun Hat 57.1
Mammal 56.4
Animal 56.4
Bonnet 56.1

Clarifai
created on 2019-11-11

people 99.8
child 99.1
one 98.8
portrait 97.4
adult 95.6
winter 95.3
wear 94
war 92.9
military 92.7
lid 92.6
veil 90
monochrome 88.3
vehicle 87.9
two 86.6
boy 86.3
coat 85.1
girl 84.7
outerwear 82.9
transportation system 82.9
administration 82.5

Imagga
created on 2019-11-11

hat 69.4
cowboy hat 63
headdress 38.7
clothing 29.9
child 27.2
person 23.3
male 22.8
people 21.7
outdoors 21.6
man 20.8
happy 20.7
portrait 18.8
smile 17.8
boy 17.4
kid 16.8
face 16.3
smiling 15.9
covering 15.3
consumer goods 15
family 13.3
outside 12.8
hair 12.7
old 12.5
childhood 12.5
park 12.3
adult 12.3
senior 12.2
happiness 11.7
summer 11.6
little 11.5
cute 11.5
cheerful 11.4
sky 10.8
outdoor 10.7
eyes 10.3
expression 10.2
youth 10.2
two 10.2
model 10.1
children 10
vacation 9.8
fun 9.7
together 9.6
casual 9.3
teen 9.2
alone 9.1
teenager 9.1
cowboy 9
trees 8.9
looking 8.8
autumn 8.8
look 8.8
grass 8.7
lifestyle 8.7
day 8.6
sitting 8.6
mother 8.5
hand 8.4
joy 8.3
leisure 8.3
fashion 8.3
lady 8.1
life 8
love 7.9
couple 7.8
pretty 7.7
attractive 7.7
daughter 7.6
instrument 7.4
emotion 7.4
blond 7.2
active 7.2
building 7.1
work 7.1
country 7

Google
created on 2019-11-11

Photograph 96.9
Snapshot 87.6
Photography 72.5
Headgear 67.5
Stock photography 62.1
Smile 54

Microsoft
created on 2019-11-11

toddler 95.9
human face 95.6
person 94.2
clothing 91.2
outdoor 88.7
hat 88.4
text 79.3
little 78.6
playground 76.1
boy 72.4
fashion accessory 66.3
baby 61.1
smile 59.8
sun hat 51.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 3-9
Gender Female, 58.6%
Disgusted 0%
Sad 0%
Confused 0%
Calm 0%
Fear 0%
Angry 0%
Happy 100%
Surprised 0%

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Hat 65.6%

Categories

Imagga

paintings art 64.8%
streetview architecture 23.9%
interior objects 7.6%
food drinks 1.7%