Human Generated Data

Title

Untitled (Mulhall children, Ozarks, Arkansas)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2816
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Mulhall children, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2816

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
Clothing 100
Pants 100
Person 99.5
Boy 99.5
Child 99.5
Male 99.5
Person 99
Child 99
Female 99
Girl 99
Jeans 97.9
Plant 97.3
Vegetation 97.3
Tree 88.3
Land 84.3
Nature 84.3
Outdoors 84.3
Woodland 84.3
Shorts 84
Grass 79
Soil 76.8
Coat 68.2
Jacket 57.7
Vest 57.5
Yard 56.6
Grove 56.5
Field 56
Blonde 55.6
Hair 55.6
Body Part 55.4
Finger 55.4
Hand 55.4

Clarifai
created on 2018-05-10

people 99.9
child 99.8
portrait 97.7
one 96.6
two 95.7
adult 94.7
boy 89.4
monochrome 87.8
wear 86.6
offspring 86.2
son 86.2
facial expression 86.2
sibling 86.1
baby 85.7
sit 84.6
actress 82.1
woman 77.6
girl 70.2
enjoyment 68.9
war 68.2

Imagga
created on 2023-10-06

child 59.5
outdoors 32.2
happiness 30.6
happy 28.8
park 28.8
family 28.5
summer 28.3
people 27.9
grass 26.9
portrait 26.6
mother 26.2
parent 25.9
smiling 25.3
childhood 25.1
adult 24.7
fun 23.2
lifestyle 22.4
outdoor 22.2
kid 22.2
children 21
love 20.5
blond 20.5
daughter 19.8
cute 18.7
girls 18.2
person 17.7
smile 17.1
cheerful 17.1
joy 16.7
leisure 16.6
hair 15.9
day 15.7
face 15.6
sibling 15.5
outside 15.4
playing 14.6
two 14.4
laughing 14.2
together 14
boy 13.9
meadow 13.5
kids 13.2
autumn 13.2
women 12.7
field 12.6
man 12.1
kin 11.9
pretty 11.9
countryside 11.9
male 11.9
little 11.5
toddler 11.5
one 11.2
youth 11.1
world 11.1
model 10.9
fashion 10.6
attractive 10.5
clothing 10.4
play 10.3
spring 10.2
relaxation 10.1
active 9.9
son 9.8
looking 9.6
brother 9.6
forest 9.6
females 9.5
playful 9.5
father 9.4
tree 9.3
innocent 9.2
hand 9.1
dad 9
activity 9
healthy 8.8
laugh 8.6
togetherness 8.5
relax 8.4
garden 8.4
human 8.3
teenager 8.2
vacation 8.2
life 8.1
rural 7.9
couple 7.8
full length 7.8
mom 7.8
lifestyles 7.6
enjoying 7.6
sit 7.6
enjoy 7.5
adorable 7.4
joyful 7.4
freedom 7.3
sexy 7.2
dress 7.2
colorful 7.2
holiday 7.2
juvenile 7.1
country 7
leaves 7

Google
created on 2018-05-10

photograph 96
black and white 93.5
monochrome photography 88.1
photography 82.1
snapshot 81.8
child 80.1
standing 77.8
tree 75.4
girl 70.8
monochrome 67
grass 60.2
vintage clothing 57.6
portrait photography 56.7
human behavior 52.9
family 51.9
toddler 50.6

Microsoft
created on 2018-05-10

outdoor 100
tree 98.9
person 97.2
little 91
girl 88.3
young 81.8
field 78.4
white 66.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-12
Gender Male, 98.3%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 1.1%
Disgusted 0.2%
Confused 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 1-7
Gender Male, 99.2%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 2.8%
Confused 1%
Angry 0.5%
Disgusted 0.3%
Happy 0.1%

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Boy 99.5%
Child 99.5%
Male 99.5%
Female 99%
Girl 99%
Coat 68.2%

Categories

Imagga

nature landscape 69.1%
pets animals 20.8%
people portraits 7.6%
paintings art 2.1%