Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1670
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1670

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Photography 100
Face 100
Head 100
Portrait 100
Clothing 99.9
Coat 99.9
Person 99.3
Shirt 98.4
Person 88.7
Jacket 85.7
Outdoors 84.8
Person 84.4
Nature 80.1
Firearm 68.6
Weapon 68.6
People 68.2
Happy 67.9
Smile 67.9
Snow 64.5
Pants 63.9
Body Part 57.7
Hand 57.7
Accessories 57.2
Railway 56.5
Transportation 56.5
Vest 55.8
Gun 55.8
Rifle 55.8

Clarifai
created on 2018-05-11

people 100
adult 99.2
two 98.8
man 98.5
group 98.2
three 97.5
portrait 96.9
wear 96.8
group together 95.8
four 95
child 94.7
military 93.8
woman 92.6
outerwear 91.6
offspring 89.6
facial expression 88.7
war 88.4
administration 88.3
vehicle 88.1
five 87.9

Imagga
created on 2023-10-06

child 47.5
person 30.4
people 29.6
sibling 29.4
portrait 25.9
man 24.3
male 22.6
juvenile 22.2
adult 20.7
outdoors 20.2
happy 20
mother 19.1
parent 18.3
brother 18.2
love 18.1
family 16.9
outdoor 16.1
smiling 15.9
snow 15.9
boy 15.8
together 15.8
fun 15.7
park 15.6
lifestyle 14.5
walking 14.2
dad 14
couple 13.9
kin 13.8
winter 13.6
smile 13.5
father 13.5
hair 13.5
old 13.2
black 12.6
day 12.6
face 12.1
cold 12.1
city 11.6
kid 11.5
fashion 11.3
one 11.2
men 11.2
outside 11.1
youth 11.1
happiness 11
cute 10.8
life 10.7
human 10.5
walk 10.5
pretty 9.8
autumn 9.7
women 9.5
season 9.4
holding 9.1
cheerful 8.9
world 8.9
looking 8.8
forest 8.7
holiday 8.6
model 8.6
beach 8.4
sand 8.3
son 8.3
vintage 8.3
healthy 8.2
landscape 8.2
childhood 8.1
little 7.9
grass 7.9
urban 7.9
scene 7.8
sepia 7.8
attractive 7.7
joy 7.5
vacation 7.4
tourist 7.2
daughter 7.1
summer 7.1

Google
created on 2018-05-11

photograph 95.9
black and white 90.8
monochrome photography 83
photography 82
snapshot 81.8
standing 79.4
vintage clothing 69.7
monochrome 67
winter 53.4
stock photography 51.5

Microsoft
created on 2018-05-11

outdoor 98.2
person 95
old 71.9
black 68.9
posing 65.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Female, 99.9%
Calm 98.2%
Surprised 6.3%
Fear 5.9%
Sad 2.7%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 29-39
Gender Female, 99.8%
Happy 76.2%
Calm 10.8%
Surprised 7.7%
Fear 6.5%
Sad 3.1%
Disgusted 2.3%
Confused 2%
Angry 1.8%

Microsoft Cognitive Services

Age 12
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Jacket 85.7%

Categories

Imagga

paintings art 51.3%
people portraits 45.8%
nature landscape 1.3%

Captions

Microsoft
created on 2018-05-11

a black and white photo of a man 87%
a man posing for a photo 86.9%
an old photo of a man 86.8%