Human Generated Data

Title

Untitled (Ozarks, Arkansas)
Date

October 1936
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1095
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1095

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.1
Human 99.1
Chair 97.6
Furniture 97.6
Sitting 91.2
Apparel 84.3
Clothing 84.3
Finger 81.2
Sleeve 79.8
Face 65.7
Portrait 62.9
Photography 62.9
Photo 62.9
Female 55.5

Clarifai
created on 2018-03-23

people 99.9
one 99.8
adult 99.3
portrait 99.2
man 97.4
sit 96.1
administration 95
wear 94.8
leader 94.6
writer 93.9
furniture 91.3
two 86
woman 84.6
sitting 82.9
outerwear 82.6
facial expression 82.4
position 82.1
musician 81.7
seat 81.6
chair 81.5

Imagga
created on 2018-03-23

scholar 62
person 54.1
intellectual 48.7
man 41.8
male 40.7
adult 34.3
sitting 32.6
people 24
lifestyle 23.9
laptop 23.3
handsome 23.2
casual 22.9
attractive 22.4
happy 21.9
home 19.9
business 18.8
smiling 18.8
businessman 18.5
20s 18.3
computer 17.8
indoors 17.6
looking 16
portrait 15.5
working 15
outdoors 14.9
couple 14.8
seated 14.6
color 14.5
job 14.2
day 14.1
happiness 14.1
smile 13.5
couch 13.5
horizontal 13.4
men 12.9
alone 12.8
face 12.8
indoor 12.8
professional 12.8
adolescent 12.7
work 12.6
technology 12.6
juvenile 12.6
leisure 12.5
room 12.1
guy 12
book 11.9
sofa 11.5
furniture 11.4
reading 11.4
cheerful 11.4
education 11.3
pretty 11.2
bench 11.1
domestic 11
businesswoman 10.9
chair 10.6
30s 10.6
clothing 10.5
one 10.5
talking 10.5
office 10.4
relaxed 10.3
building 10.3
corporate 10.3
love 10.3
communication 10.1
joy 10
student 9.9
father 9.7
interior 9.7
black 9.7
dad 9.7
vertical 9.6
living 9.5
sit 9.5
model 9.3
suit 9.1
confident 9.1
relaxing 9.1
fashion 9
park bench 8.8
25 30 years 8.8
notebook 8.8
together 8.8
child 8.7
serious 8.6
enjoying 8.5
relax 8.4
relaxation 8.4
executive 8.3
seat 8.3
holding 8.3
park 8.2
boy 8.2
school 8.1
40s 7.8
colleagues 7.8
1 7.7
comfort 7.7
outside 7.7
worker 7.7
expression 7.7
apartment 7.7
only 7.6
parent 7.6
house 7.5
newspaper 7.4
single 7.4
emotion 7.4
stylish 7.2
cute 7.2
family 7.1

Google
created on 2018-03-23

photograph 96
person 95.9
black and white 91.3
sitting 90.8
monochrome photography 84.5
photography 83.4
snapshot 81.8
portrait 81.2
standing 74.3
human 68.9
vintage clothing 68.3
monochrome 67.7
girl 67.1
portrait photography 60
gentleman 55.4
human behavior 52.9

Microsoft
created on 2018-03-23

person 97.3
sitting 95.7
old 48.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 99.1%
Angry 4.9%
Surprised 48.4%
Happy 7.5%
Sad 15.1%
Calm 6.4%
Disgusted 3.9%
Confused 13.9%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Possible
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Categories

Imagga

people portraits 82.6%
paintings art 17.2%
food drinks 0.2%

Captions

Microsoft
created on 2018-03-23

a person sitting on a bench 80.7%
a person sitting on a bench 80.6%
a person sitting on a bench 80.5%