Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1135
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1135

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
People 100
Clothing 99.9
Pants 99.9
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
Person 98.6
Male 98.6
Boy 98.6
Child 98.6
Person 97.9
Child 97.9
Female 97.9
Girl 97.9
Coat 94.8
Jacket 94.8
Wood 93.9
Person 92.4
Baby 92.4
Hat 82.9
Architecture 78
Building 78
Housing 78
Shorts 73
Outdoors 72.4
Nature 66.5
House 65
Vest 61
Cabin 57.7
Jeans 57.1
Slum 56.4
Log Cabin 56
Firearm 55.6
Gun 55.6
Rifle 55.6
Weapon 55.6
Slate 55.5
Shirt 55.3
Archaeology 55.3
Shelter 55.3

Clarifai
created on 2018-05-11

people 100
group 99.8
child 99.6
adult 97.4
portrait 96.9
group together 96.9
wear 95.8
three 95.3
man 94.9
offspring 94.6
four 94.4
sibling 94.3
son 93.9
boy 93.8
five 93.7
several 93.6
administration 91.5
military 90.7
two 90.6
family 90.5

Imagga
created on 2023-10-06

kin 59.2
statue 21.7
man 20.8
world 19.2
people 19
sculpture 18.1
person 17.2
travel 16.9
male 15
sky 14.7
old 14.6
outdoor 13.7
beach 13.5
monument 13.1
adult 13
tourism 12.4
summer 12.2
architecture 11.7
history 11.6
marble 11.6
mother 11.3
outdoors 11.2
portrait 11
lifestyle 10.8
sibling 10.8
water 10.7
art 10.5
sport 10.5
clothing 10.3
stone 10.1
parent 10.1
active 10
city 10
grandfather 9.9
park 9.9
vacation 9.8
family 9.8
lady 9.7
couple 9.6
ancient 9.5
love 9.5
child 9.4
landmark 9
body 8.8
happy 8.8
women 8.7
boy 8.7
military 8.7
happiness 8.6
holiday 8.6
culture 8.5
historical 8.5
famous 8.4
dress 8.1
sunset 8.1
smiling 8
building 7.9
grass 7.9
sand 7.8
sea 7.8
casual 7.6
ocean 7.5
vintage 7.4
aged 7.2
sexy 7.2
religion 7.2
to 7.1

Google
created on 2018-05-11

people 96.9
photograph 95.7
black and white 92.5
standing 92
monochrome photography 85.8
family 73.6
monochrome 72.7
vintage clothing 71.6
history 62.3
stock photography 55.5

Microsoft
created on 2018-05-11

outdoor 99
person 99
posing 98.8
old 83.1
standing 77.4
group 61.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 97.3%
Surprised 6.4%
Fear 6%
Sad 2.3%
Confused 0.6%
Happy 0.5%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 36-44
Gender Female, 99.5%
Confused 48.9%
Sad 47.4%
Calm 14.6%
Surprised 6.6%
Fear 6.4%
Disgusted 5.9%
Happy 1.4%
Angry 1.1%

AWS Rekognition

Age 6-12
Gender Female, 99.9%
Sad 100%
Calm 11.6%
Fear 6.5%
Surprised 6.4%
Angry 1.1%
Confused 0.4%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 6-12
Gender Male, 78.4%
Sad 100%
Surprised 6.4%
Fear 6%
Calm 5.3%
Angry 2.6%
Confused 1.1%
Disgusted 0.6%
Happy 0.1%

AWS Rekognition

Age 0-3
Gender Male, 98.4%
Calm 96.6%
Fear 6.4%
Surprised 6.3%
Sad 2.4%
Angry 0.4%
Confused 0.4%
Happy 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Adult 99.3%
Male 99.3%
Man 99.3%
Boy 98.6%
Child 98.6%
Female 97.9%
Girl 97.9%
Jacket 94.8%
Baby 92.4%

Categories

Imagga

paintings art 99.1%

Text analysis

Amazon

9