Human Generated Data

Title

Untitled (Red House, West Virginia)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1192

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Red House, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1192

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
People 98.7
Person 98.5
Boy 98.5
Child 98.5
Male 98.5
Person 97.3
Boy 97.3
Child 97.3
Male 97.3
Person 96.8
Baby 96.8
Person 96.3
Baby 96.3
Person 95.9
Child 95.9
Female 95.9
Girl 95.9
Person 93.5
Baby 93.5
Person 90.8
Person 86.4
Body Part 85.9
Finger 85.9
Hand 85.9
Accessories 69.9
Bag 69.9
Handbag 69.9
Clothing 61.5
Hat 61.5
Shorts 57.9
Computer 57
Electronics 57
Bench 55.4
Furniture 55.4
Coat 55.2

Clarifai
created on 2018-05-11

people 99.9
group 99.5
group together 96.6
adult 96.4
many 96.4
child 95.9
facial expression 95.2
several 93.9
woman 93.7
man 93.6
portrait 92.2
furniture 91.8
wear 90.6
actress 89.5
administration 89.5
two 86.3
outfit 86
boy 85.7
music 85.6
four 84.6

Imagga
created on 2023-10-06

happy 34.5
child 29.8
kin 29.6
people 29.6
adult 28
male 25.1
smiling 24.6
person 23.5
family 23.1
man 22.8
together 22.8
smile 22.1
home 21.5
sitting 21.5
portrait 21.3
mother 21.3
casual 20.3
couch 19.3
couple 19.2
happiness 18
attractive 17.5
cute 17.2
fun 17.2
lifestyle 16.6
boy 16.5
20s 16.5
daughter 16
outdoors 15.7
cheerful 15.4
two 14.4
love 14.2
kid 14.2
girls 13.7
children 13.7
adults 13.2
father 13.2
camera 12.9
outside 12.8
parent 12.7
brother 12.5
sibling 12.1
indoors 11.4
fashion 11.3
friends 11.3
house 10.9
30s 10.6
pretty 10.5
group 10.5
sofa 10.5
females 10.4
togetherness 10.4
room 10.4
son 10.3
indoor 10
playing 10
teenager 10
relaxing 10
dress 9.9
park 9.9
human 9.7
lady 9.7
full length 9.7
women 9.5
pair 9.4
day 9.4
relaxed 9.4
youth 9.4
bench 9.4
face 9.2
teen 9.2
interior 8.8
jeans 8.6
expression 8.5
laughing 8.5
adorable 8.3
one 8.2
clothing 8.2
childhood 8.1
handsome 8
to 8
husband 7.9
sister 7.8
chair 7.8
play 7.8
culture 7.7
old 7.7
loving 7.6
blond 7.6
wife 7.6
sit 7.6
healthy 7.6
horizontal 7.5
kids 7.5
relaxation 7.5
friendship 7.5
device 7.2
looking 7.2
hair 7.1

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 99.8
people 55.8
posing 35.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Female, 98.9%
Happy 59%
Calm 38.2%
Surprised 6.5%
Fear 6.2%
Sad 2.2%
Confused 0.7%
Disgusted 0.4%
Angry 0.1%

AWS Rekognition

Age 6-14
Gender Female, 99.8%
Confused 75%
Angry 13.3%
Calm 7.5%
Surprised 6.4%
Fear 6%
Sad 3.1%
Disgusted 0.6%
Happy 0.3%

AWS Rekognition

Age 21-29
Gender Female, 97.2%
Sad 99.9%
Confused 15.6%
Calm 10.8%
Surprised 6.3%
Fear 6%
Disgusted 0.3%
Angry 0.2%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Female, 99.7%
Fear 97.9%
Surprised 6.5%
Sad 2.3%
Calm 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 18-26
Gender Female, 99.9%
Calm 46.3%
Disgusted 27.7%
Sad 12.5%
Surprised 7.1%
Fear 6.4%
Happy 5.2%
Angry 2.9%
Confused 1.8%

AWS Rekognition

Age 16-24
Gender Male, 72.7%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Disgusted 0%
Confused 0%
Happy 0%

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Boy 98.5%
Child 98.5%
Male 98.5%
Baby 96.8%
Female 95.9%
Girl 95.9%
Handbag 69.9%

Text analysis

Amazon

SON
ERS