Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2812
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2812

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
Person 99.4
Adult 99.4
Female 99.4
Woman 99.4
Slum 98.9
People 79.4
Outdoors 66.6
Person 62.4
Garden 56.5
Nature 56.5
Soil 56.3
Yard 55.1
Backyard 55

Clarifai
created on 2018-05-10

people 100
adult 99
child 98.9
two 97.7
portrait 97.7
facial expression 95.3
offspring 94.5
man 93.7
wear 93.7
sit 92.6
interaction 90.3
sibling 90.3
group 90.2
family 90.2
woman 89.6
son 88.4
three 85.7
boy 83.4
actress 79.4
monochrome 78

Imagga
created on 2023-10-06

child 57.7
happy 42
parent 41.4
outdoors 39.7
senior 39.4
family 38.3
dad 37.9
park 37.1
together 36.8
father 36.3
people 35.2
male 35.1
man 33.6
smiling 33.3
couple 32.3
portrait 30.4
kin 30
love 29.2
lifestyle 28.2
person 28.1
mother 26.8
mature 26
grandfather 25.9
grandma 24.6
happiness 23.5
adult 23.3
laughing 20.8
smile 20.7
fun 20.2
active 19.8
joy 19.2
relaxing 19.1
childhood 18.8
summer 18.7
son 18.6
garden 18.5
outdoor 18.4
countryside 18.3
enjoying 18
60s 17.6
boy 17.4
outside 17.1
wife 17.1
kid 16.8
grass 16.6
retirement 16.3
loving 16.2
togetherness 16.1
relaxed 16
day 15.7
juvenile 15.4
elderly 15.3
husband 15.3
daughter 15.2
healthy 15.1
children 14.6
retired 14.6
affectionate 14.5
two 14.4
horizontal 14.2
vacation 13.9
camera 13.9
sitting 13.7
playing 13.7
affection 13.5
old 13.2
cheerful 13
seniors 12.8
grandmother 12.7
women 12.7
two people 12.6
leisure 12.5
little 12.4
home 12
sixties 11.8
50s 11.8
romantic 11.6
walk 11.4
walking 11.4
relationship 11.2
girls 10.9
granddaughter 10.9
having fun 10.8
embracing 10.7
face 10.7
married 10.6
toddler 10.5
blond 10.3
fit 10.1
beach 10.1
cute 10.1
holiday 10
grandparent 9.9
romance 9.8
vertical 9.6
generation 9.6
men 9.5
casual 9.3
sibling 9.1
copy space 9
grandchild 8.9
fifties 8.9
sun 8.9
older 8.7
hug 8.7
youth 8.5
females 8.5
kids 8.5
pretty 8.4
field 8.4
exercise 8.2
aged 8.2
pensioner 8
autumn 7.9
three quarter length 7.9
mum 7.8
embrace 7.8
hugging 7.8
half length 7.8
sunny 7.8
friendship 7.5
holding 7.4
meadow 7.2
recreation 7.2
hair 7.1
spring 7.1
attractive 7

Google
created on 2018-05-10

people 96.5
photograph 96.3
person 93.5
black and white 92.7
monochrome photography 87.9
standing 84.3
child 82.8
snapshot 81.8
photography 81.4
sitting 80.2
family 76.3
monochrome 70.7
smile 68.6
human 68.3
girl 60.4
vintage clothing 60
stock photography 57
portrait photography 56.5
father 52
tree 51.9

Microsoft
created on 2018-05-10

outdoor 99.9
person 99.5
grass 95.6
black 88.9
white 75
old 65.5
posing 62.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Female, 99.8%
Sad 100%
Surprised 6.3%
Fear 5.9%
Confused 1%
Calm 0.3%
Happy 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 1-7
Gender Male, 99.2%
Surprised 99.7%
Fear 5.9%
Sad 2.1%
Calm 0.1%
Angry 0%
Happy 0%
Disgusted 0%
Confused 0%

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Adult 99.4%
Female 99.4%
Woman 99.4%

Categories

Imagga

people portraits 96.6%
paintings art 2.7%

Captions

Microsoft
created on 2018-05-10

a black and white photo of a boy 89.3%
a black and white photo of a girl 89.2%
a vintage photo of a boy 89.1%