Human Generated Data

Title

Untitled (rehabilitation client, Arkansas)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2788
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (rehabilitation client, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2788

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 96.9
Person 94.7
Child 94.7
Female 94.7
Girl 94.7
Person 94.4
Baby 94.4
Face 81.5
Head 81.5
Hugging 78.8
Photography 69.6
Portrait 69.6
Clothing 60.8
Knitwear 60.8
Sweater 60.8
Blouse 55.9
Smoke Pipe 55.4

Clarifai
created on 2018-05-10

people 100
two 99.6
adult 99.2
portrait 98.7
man 97.7
child 96.9
woman 96.5
family 95.5
three 93.8
group 93.7
facial expression 93.3
offspring 92
wear 89.8
sibling 89.5
son 89
affection 88.1
sit 86.3
music 86.2
one 82.2
musician 81.4

Imagga
created on 2023-10-06

mother 64.4
child 62.4
parent 57.2
family 56.1
male 45.4
father 42.4
happy 42
love 40.3
home 39.9
man 37
couple 34
people 33.5
together 32.4
smiling 31.8
happiness 30.6
dad 29.5
daughter 28.3
husband 27.7
lifestyle 26.8
son 26.6
loving 24.8
indoors 24.6
brother 24.1
adult 23.9
togetherness 23.6
portrait 23.3
person 23
kid 22.2
boy 21.7
senior 21.6
children 21
fun 21
casual 20.3
affectionate 20.3
cute 20.1
baby 19.6
smile 19.3
grandfather 19
wife 19
sibling 18.7
sitting 18
mature 17.7
30s 17.3
kids 17
little 16.8
living room 16.6
hug 16.5
cheerful 16.3
joy 15.9
juvenile 15.7
couch 15.5
mid adult 15.4
affection 14.5
enjoying 14.2
face 14.2
laughing 14.2
old 13.9
playing 13.7
relaxing 13.6
holding 13.2
kin 13.1
parenthood 12.7
elderly 12.5
sofa 12.4
living 12.3
grandma 12
domestic 12
outdoors 11.9
indoor 11.9
day 11.8
embracing 11.7
two people 11.7
care 11.5
married 11.5
relaxed 11.3
relationship 11.2
room 11.1
adorable 11.1
women 11.1
horizontal 10.9
generations 10.9
childhood 10.8
hugging 10.7
retired 10.7
boys 10.7
interior 10.6
attractive 10.5
clothing 10.3
men 10.3
black 10.2
two 10.2
camera 10.2
girls 10
cuddle 9.9
parents 9.8
bonding 9.8
thirties 9.7
color 9.5
friends 9.4
enjoyment 9.4
friendship 9.4
leisure 9.1
park 9.1
aged 9.1
cuddling 8.9
good mood 8.8
grandmother 8.8
mum 8.8
looking 8.8
offspring 8.7
mom 8.7
play 8.6
pair 8.5
house 8.4
joyful 8.3
life 8.1
blond 8.1
group 8.1
handsome 8
pensioner 8
grandchild 7.9
4 7.8
their 7.8
60s 7.8
half length 7.8
40s 7.8
middle aged 7.8
comfort 7.7
diversity 7.7
retirement 7.7
four 7.7
three 7.4
romantic 7.1

Google
created on 2018-05-10

people 97.5
photograph 96.3
person 94.8
black and white 90.3
child 87.9
smile 85.4
sitting 82.8
standing 82.7
snapshot 81.8
monochrome photography 80.9
family 79.9
photography 78.7
human 71.4
girl 67.6
mother 65.8
monochrome 62.1
father 61.8
human behavior 60.5
portrait 59.9
portrait photography 54

Microsoft
created on 2018-05-10

person 96.4
window 88.2
black 79.5
white 79.1
old 64.4
posing 60.2
vintage 28.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-45
Gender Female, 89.5%
Calm 98.3%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 0.6%
Confused 0.2%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 4-10
Gender Female, 99.1%
Sad 100%
Calm 10.4%
Surprised 9.8%
Fear 6.1%
Disgusted 0.7%
Angry 0.6%
Confused 0.5%
Happy 0.5%

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.7%
Child 94.7%
Female 94.7%
Girl 94.7%
Baby 94.4%
Sweater 60.8%
Smoke Pipe 55.4%

Categories

Imagga

people portraits 98.6%
paintings art 1.3%

Captions

Microsoft
created on 2018-05-10

a black and white photo of a girl 90.8%
a black and white photo of a person 90.7%
a vintage photo of a girl 90.6%