Human Generated Data

Title

Untitled (Case Plantation, Pulaski County, Arkansas)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1139
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Case Plantation, Pulaski County, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.3
Human 99.3
Face 91.2
Apparel 87.7
Clothing 87.7
Sleeve 84.7
Sitting 74.8
Portrait 68.7
Photography 68.7
Photo 68.7
Skin 66.2
Long Sleeve 57.9
Finger 56.6
Man 55.5

Clarifai
created on 2018-03-23

people 100
portrait 99.6
one 99.5
adult 99.4
writer 95.6
man 95.6
leader 94.5
woman 94.2
administration 94.2
two 93.9
wear 93.2
music 88.1
facial expression 86.4
furniture 86.4
sit 84.4
actress 82.7
musician 82.2
chair 81.1
actor 79.7
profile 77.4

Imagga
created on 2018-03-23

person 51.5
adolescent 45.7
adult 42.2
juvenile 37.3
portrait 32.4
people 30.1
man 29.6
male 28.6
attractive 25.9
clothing 24.5
garment 21.3
happy 20.1
love 19.7
suit 19.3
lifestyle 18.8
black 18.1
smiling 18.1
sitting 18
lady 17.9
model 17.1
pretty 16.8
face 16.3
looking 16
hair 15.9
fashion 15.8
couple 15.7
smile 15.7
couch 15.5
sofa 15.3
casual 15.3
bathrobe 15
expression 14.5
home 14.4
business 14
human 13.5
sexy 12.9
robe 12.8
women 12.7
grandma 12.5
indoors 12.3
office 12.1
one 12
happiness 11.8
modern 11.2
work 11
room 10.9
husband 10.9
handsome 10.7
wife 10.4
hands 10.4
relationship 10.3
youth 10.2
lips 10.2
guy 10.1
alone 10.1
indoor 10
confident 10
working 9.7
boyfriend 9.6
look 9.6
girlfriend 9.6
mother 9.5
color 9.5
men 9.5
hand 9.1
relaxing 9.1
computer 9
job 8.8
professional 8.8
loving 8.6
serious 8.6
ethnic 8.6
executive 8.5
living 8.5
one person 8.5
relaxed 8.5
covering 8.4
sweater 8.4
joy 8.4
holding 8.3
sensual 8.2
sensuality 8.2
style 8.2
pose 8.2
laptop 8
posing 8
businessman 7.9
scholar 7.9
seated 7.8
thoughtful 7.8
corporate 7.7
elegant 7.7
elegance 7.6
senior 7.5
mature 7.4
20s 7.3
book 7.3
businesswoman 7.3
blond 7.2
life 7.2
skin 7.1

Google
created on 2018-03-23

photograph 95.9
black 95.1
person 95
black and white 89.9
photography 82.3
snapshot 81.8
monochrome photography 80.5
portrait 80
girl 78.6
sitting 78.4
monochrome 63.2
vintage clothing 61.6
portrait photography 56

Microsoft
created on 2018-03-23

person 98.9

Face analysis

Amazon

Google

AWS Rekognition

Age 20-38
Gender Male, 62.1%
Happy 2%
Confused 12.9%
Calm 27.6%
Sad 9.9%
Angry 39.3%
Disgusted 4.2%
Surprised 4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a person sitting on a white background 67%
a person sitting on a white surface 58.1%
a person sitting in a chair 58%