Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)
Date

October 1935, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3603

Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3603

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
Person 99.4
Adult 99.4
Female 99.4
Woman 99.4
Backyard 99
Nature 99
Outdoors 99
Yard 99
People 90.5
Soil 90.5
Happy 86.4
Smile 86.4
Grass 68.4
Plant 68.4
Blouse 57.9
Clothing 57.9
Tree 57.1
Lady 56.7
Garden 56.4
Slum 55.6
Dress 55.5
Field 55.2
Body Part 55.1
Finger 55.1
Hand 55.1

Clarifai
created on 2018-05-10

people 99.9
two 99.2
adult 98
child 97.6
man 96.7
facial expression 96.2
portrait 94.7
woman 94.2
offspring 93.8
group 93.3
family 90.8
three 89.7
wear 89.5
affection 89.4
sibling 88.4
boy 87.7
sit 84.8
son 81.4
home 79.5
group together 79

Imagga
created on 2023-10-06

dad 58.7
father 57.8
parent 55.3
family 47.2
child 44.6
grandma 43
happy 42.6
together 40.3
park 37.1
man 35.6
outdoors 35.1
senior 34.7
love 34
smiling 33.3
kin 32.5
people 32.4
male 31.7
portrait 31.1
couple 30.5
mother 28.5
lifestyle 26.8
boy 26.1
happiness 25.9
son 24.1
smile 23.5
grandfather 22.4
togetherness 20.8
summer 20.6
fun 20.2
adult 20.1
childhood 19.7
daughter 19.5
laughing 18.9
mature 18.6
husband 18.1
active 18
two 17.8
joy 17.6
grass 17.4
countryside 17.4
children 17.3
retirement 17.3
elderly 17.2
outside 17.1
wife 17.1
healthy 17
kid 16.8
affection 16.4
retired 15.5
cheerful 15.5
outdoor 15.3
enjoying 15.2
playing 14.6
loving 14.3
garden 14.3
little 14.1
day 14.1
old 13.9
affectionate 13.6
person 13.5
leisure 13.3
relationship 13.1
having fun 12.8
seniors 12.8
relaxing 12.7
married 12.5
vacation 12.3
relaxed 12.2
face 12.1
camera 12
girls 11.9
60s 11.7
embracing 11.7
hug 11.6
toddler 11.5
sitting 11.2
spring 11
walk 10.5
cute 10.1
blond 10
sibling 9.9
granddaughter 9.9
romantic 9.8
home 9.6
baby 9.5
women 9.5
friendship 9.4
adorable 9.2
horizontal 9.2
field 9.2
care 9.1
grandchild 8.9
grandparent 8.9
sixties 8.8
50s 8.8
grandmother 8.8
mum 8.8
autumn 8.8
vertical 8.7
30s 8.7
generation 8.6
men 8.6
walking 8.5
youth 8.5
playful 8.5
kids 8.5
casual 8.5
hold 8.3
fit 8.3
meadow 8.1
romance 8
life 7.9
hugging 7.8
thirties 7.8
two people 7.8
older 7.8
mom 7.8
bench 7.6
relaxation 7.5
joyful 7.4
exercise 7.3
sun 7.2
aged 7.2
copy space 7.2
recreation 7.2
handsome 7.1
pretty 7

Google
created on 2018-05-10

people 96.8
photograph 96.4
person 93.7
black and white 93.7
monochrome photography 90.3
child 88.2
sitting 87.3
standing 85.4
photography 83.1
emotion 81.8
snapshot 81.8
smile 77.5
family 76.2
vintage clothing 75.5
monochrome 72.5
interaction 71.3
human 70.2
tree 68.8
girl 68
fun 61.9

Microsoft
created on 2018-05-10

outdoor 99.8
person 99.3
old 79.5
white 61.4
posing 58.1
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 41-49
Gender Female, 99.1%
Sad 100%
Surprised 6.3%
Fear 5.9%
Confused 2.2%
Calm 2.1%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 1-7
Gender Male, 95.1%
Surprised 99.7%
Fear 5.9%
Sad 2.1%
Calm 0.1%
Angry 0%
Happy 0%
Confused 0%
Disgusted 0%

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Adult 99.4%
Female 99.4%
Woman 99.4%

Categories

Imagga

people portraits 88.5%
nature landscape 8.8%
paintings art 1.1%
pets animals 1.1%