Human Generated Data

Title

Untitled (Judith Shahn, Washington Square Park, New York City)
Date

1933
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5597

Human Generated Data

Title

Untitled (Judith Shahn, Washington Square Park, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1933

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5597

Machine Generated Data

Tags

Amazon
created on 2019-11-11

Clothing 100
Apparel 100
Hat 99.9
Person 95.5
Human 95.5
Cap 84.7
Beanie 83.7
Bonnet 56.3

Clarifai
created on 2019-11-11

people 99.9
portrait 99.7
one 98.3
lid 98
adult 95.5
man 93.8
child 93.2
veil 92.4
cap 90.1
wear 87.9
street 85.1
woman 81.5
administration 81.3
retro 79.2
sepia 78.4
coat 77.6
monochrome 76.5
outerwear 76.1
winter 75.7
boy 73.4

Imagga
created on 2019-11-11

bonnet 100
hat 100
headdress 77.4
clothing 60.7
portrait 39.5
face 36.2
person 34.5
attractive 32.2
covering 29.5
cute 28.7
child 27.5
eyes 26.7
consumer goods 26.1
people 25.7
smile 24.2
youth 22.1
pretty 21.7
fashion 21.1
man 20.8
adult 20.7
expression 20.5
male 20.3
model 20.2
happy 20.1
winter 18.7
cold 18.1
kid 16.8
hair 16.6
casual 16.1
handsome 16
boy 15.7
smiling 15.2
outside 14.5
cap 14.5
sexy 14.5
lifestyle 13.7
close 13.7
childhood 13.4
teen 12.9
girls 12.8
outdoors 12.7
blond 12.6
little 12.4
look 12.3
one 11.9
teenager 11.9
children 11.8
joy 11.7
closeup 11.5
looking 11.2
ski mask 11
happiness 11
pose 10.9
braid 10.7
cheerful 10.6
serious 10.5
jacket 10.4
women 10.3
skin 10.2
season 10.1
head 10.1
gorgeous 10
studio 9.9
old 9.8
human 9.7
wearing 9.5
outdoor 9.2
nice 9.2
fun 9
face mask 8.8
brunette 8.7
love 8.7
mask 8.6
clothes 8.4
hand 8.4
lips 8.3
guy 8.3
warm 8.3
lady 8.1
hands 7.8
black 7.8
coat 7.7
toddler 7.6
kids 7.5
one person 7.5
emotion 7.4
weather 7.2
posing 7.1
scarf 7

Google
created on 2019-11-11

Photograph 96.5
Clothing 91.9
Snapshot 85.9
Knit cap 81.5
Headgear 78.8
Hat 78.4
Bonnet 77.9
Portrait 73.9
Smile 69.4
Child 69.3
Photography 67.8
Cap 64.8
Vintage clothing 57
Black-and-white 56.4
Fashion accessory 54.6
Beanie 54.5
Knitting 54.2

Microsoft
created on 2019-11-11

person 99.5
fashion accessory 98.7
human face 97.6
clothing 92.5
sun hat 91.9
indoor 88.5
hat 85
text 83.4
headgear 82.4
bonnet 78.5
headdress 78
smile 77
fedora 73.1
black and white 68.3
portrait 64.1
cap 63
beanie 61.6
knit cap 60
monochrome 57.8
cowboy hat 55.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 95.5%
Angry 0%
Fear 0%
Disgusted 0%
Calm 0%
Sad 0%
Confused 0%
Happy 100%
Surprised 0%

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.9%
Person 95.5%

Categories

Imagga

paintings art 63.1%
people portraits 33.2%
streetview architecture 2.7%

Captions

Microsoft
created on 2019-11-11

a person wearing a hat 94.5%
a person wearing a black hat 92.3%
a person wearing a hat 92.2%