Human Generated Data

Title

Maynardville, Tennessee
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3087

Human Generated Data

Title

Maynardville, Tennessee

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 99.7
Apparel 99.7
Person 99.4
Human 99.4
Hat 99.2
Person 99
Person 96.8
Hat 95.9
Hat 85
Face 80.8
Sun Hat 71.7
People 65.2
Helmet 61.5
Coat 58.4
Overcoat 57.2
Cap 56.4
Hardhat 56.4

Imagga
created on 2021-12-15

hat 76.7
cowboy hat 47.1
man 47
male 46.1
person 42.1
clothing 37.3
people 31.2
senior 30
headdress 28.4
adult 27.2
portrait 27.2
outdoors 26.1
military uniform 25.1
happy 24.4
uniform 24
grandfather 22.4
smiling 21
consumer goods 19.5
covering 19.5
cowboy 19.3
men 18.9
farmer 18.3
couple 18.3
smile 17.8
two 17.8
face 17.8
old 17.4
mature 16.7
hand 16.7
elderly 16.3
outside 15.4
handsome 14.3
happiness 14.1
shirt 14
western 13.6
love 13.4
work 13.3
together 13.1
old-timer 13.1
outdoor 13
scholar 12.8
field 12.5
boy 12.2
looking 12
child 11.7
family 11.6
wearing 11.4
guy 11.3
worker 11.1
casual 11
model 10.9
lifestyle 10.8
job 10.6
one 10.5
relationship 10.3
hair 10.3
intellectual 10.2
black 10.2
farm 9.8
cheerful 9.8
older 9.7
look 9.6
standing 9.6
holding 9.1
park 9.1
aged 9
beard 9
country 8.8
retired 8.7
retirement 8.6
engineer 8.6
serious 8.6
horse 8.5
industry 8.5
attractive 8.4
alone 8.2
active 8.1
rural 7.9
grass 7.9
affectionate 7.7
helmet 7.7
expression 7.7
age 7.6
head 7.6
human 7.5
style 7.4
vacation 7.4
countryside 7.3
romance 7.1
posing 7.1
kid 7.1
summer 7.1
autumn 7

Google
created on 2021-12-15

Cap 90.3
Hat 89.9
Gesture 85.3
Military person 84.7
Sun hat 83.3
Military uniform 81.6
Collar 81.2
Adaptation 79.3
Soldier 78.6
Fedora 75
Snapshot 74.3
Plant 74
Monochrome photography 73.3
Vintage clothing 70.4
Monochrome 70.1
Uniform 67.7
Crew 65.1
Non-commissioned officer 64.9
History 64.6
Military officer 64.5

Microsoft
created on 2021-12-15

hat 99.4
person 99
clothing 98.7
fashion accessory 96.6
text 96.4
outdoor 95
cowboy hat 93.8
old 93.6
man 91.6
human face 90.2
fedora 90.2
sun hat 86.6
posing 42.9
vintage 35.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-55
Gender Male, 94.3%
Calm 95.4%
Angry 2%
Sad 0.9%
Surprised 0.8%
Confused 0.6%
Disgusted 0.2%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 26-40
Gender Male, 97.2%
Calm 98%
Surprised 1.6%
Angry 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 21-33
Gender Male, 90.3%
Sad 92.3%
Calm 6.7%
Fear 0.4%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%
Surprised 0%
Happy 0%

AWS Rekognition

Age 22-34
Gender Male, 93%
Calm 93.7%
Surprised 4.9%
Fear 0.4%
Sad 0.3%
Happy 0.2%
Disgusted 0.2%
Confused 0.2%
Angry 0.2%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Hat 99.2%

Captions

Microsoft

a vintage photo of a person 96.9%
a vintage photo of a group of people posing for the camera 94.8%
a vintage photo of a man and woman posing for a picture 90.7%