Human Generated Data

Title

Untitled (Red House, West Virginia)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1193
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Red House, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1193

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Blouse 99.8
Clothing 99.8
People 99.7
Person 99.1
Person 99.1
Child 99.1
Female 99.1
Girl 99.1
Person 99.1
Child 99.1
Boy 99.1
Male 99.1
Face 99
Head 99
Photography 99
Portrait 99
Person 98.7
Female 98.7
Female 98.7
Adult 98.7
Adult 98.7
Bride 98.7
Wedding 98.7
Woman 98.7
Person 98.6
Person 98.2
Female 98.2
Adult 98.2
Woman 98.2
Dress 97.6
Person 97.2
Person 88.5
Child 88.5
Female 88.5
Girl 88.5
Formal Wear 74.4
Reading 62.5
Shirt 57.7
Accessories 57.6
Bag 57.6
Handbag 57.6
Fashion 57
Skirt 56.8
Architecture 56.7
Building 56.7
School 56.7
Suit 55.5
Classroom 55.1
Indoors 55.1
Room 55.1

Clarifai
created on 2018-05-11

people 99.9
group 99.8
child 98.3
group together 98.3
adult 97.4
woman 97.1
man 96
several 95.6
four 95.3
family 95.3
five 94.9
facial expression 94.8
offspring 94.4
portrait 94.1
many 93.3
administration 93
leader 90.8
son 90.7
sibling 90.3
actress 89.6

Imagga
created on 2023-10-05

kin 95.9
family 46.3
happy 43.9
male 42.2
mother 41.7
man 37
couple 36.6
together 34.2
father 34.1
smiling 34
people 32.9
daughter 32.6
home 30.3
child 28.1
senior 26.2
happiness 25.9
portrait 25.2
smile 24.9
love 24.5
mature 22.3
person 20.8
adult 19.5
children 19.1
son 19
sitting 18.9
lifestyle 18.8
husband 18.3
group 17.7
parent 17.6
elderly 16.3
fun 15.7
boy 15.6
men 15.5
married 15.3
sofa 15.3
wife 15.2
outdoors 14.9
dad 14.6
affectionate 14.5
casual 14.4
two 14.4
grandfather 14.2
cheerful 13.8
parents 13.7
women 13.4
indoors 13.2
grandmother 12.7
joy 12.5
kid 12.4
park 12.4
laughing 12.3
living room 11.7
room 11.6
30s 11.5
brother 11.5
togetherness 11.3
relaxed 11.3
day 11
sibling 11
relaxing 10.9
sister 10.7
nurse 10.6
bride 10.6
loving 10.5
enjoying 10.4
grandma 10.1
attractive 9.8
couch 9.7
affection 9.7
kids 9.4
relationship 9.4
camera 9.2
wedding 9.2
playing 9.1
old 9.1
new 8.9
gray hair 8.9
50s 8.8
casual clothing 8.8
looking camera 8.7
retirement 8.6
marriage 8.6
friends 8.5
leisure 8.3
teen 8.3
childhood 8.1
handsome 8
baby 8
granddaughter 7.9
holiday 7.9
thirties 7.8
retired 7.8
teenage 7.7
four 7.7
youth 7.7
groom 7.6
human 7.5
friendship 7.5
help 7.5
holding 7.4
care 7.4
teenager 7.3
dress 7.2
looking 7.2
cute 7.2
summer 7.1
little 7.1

Google
created on 2018-05-11

people 98.1
photograph 96.1
standing 92.9
person 92.6
black and white 86.6
family 85
snapshot 81.8
vintage clothing 80.3
child 79.5
monochrome photography 73.9
smile 68.4
monochrome 64.8
girl 61.1

Microsoft
created on 2018-05-11

person 99.9
posing 94.7
outdoor 90.6
group 81.9
standing 76.6
people 76.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Female, 98.3%
Happy 95.5%
Surprised 6.3%
Fear 5.9%
Sad 3.7%
Confused 0.1%
Calm 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 30-40
Gender Female, 99.8%
Happy 98.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.4%
Calm 0.3%
Angry 0.3%
Disgusted 0.1%

AWS Rekognition

Age 9-17
Gender Female, 85.1%
Sad 100%
Angry 7.4%
Surprised 6.3%
Fear 6%
Calm 0.6%
Disgusted 0.3%
Happy 0.2%
Confused 0.2%

AWS Rekognition

Age 13-21
Gender Female, 99.9%
Happy 97.6%
Surprised 6.3%
Fear 6%
Sad 2.2%
Disgusted 0.7%
Confused 0.6%
Angry 0.4%
Calm 0%

AWS Rekognition

Age 11-19
Gender Female, 100%
Happy 96%
Surprised 6.5%
Fear 5.9%
Sad 2.4%
Calm 1.2%
Confused 0.9%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 98.3%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Disgusted 0.4%
Calm 0.3%
Confused 0.3%
Angry 0.1%

AWS Rekognition

Age 18-26
Gender Female, 100%
Confused 81.4%
Sad 10.1%
Surprised 6.5%
Fear 6%
Calm 5.5%
Angry 0.5%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Female, 94.6%
Happy 92.6%
Surprised 6.5%
Fear 6%
Calm 3.1%
Sad 2.5%
Angry 1.1%
Confused 0.9%
Disgusted 0.3%

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 13
Gender Female

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 14
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Child
Female
Girl
Boy
Male
Adult
Bride
Woman
Person 99.1%
Person 99.1%
Person 99.1%
Person 98.7%
Person 98.6%
Person 98.2%
Person 97.2%
Person 88.5%
Child 99.1%
Child 99.1%
Child 88.5%
Female 99.1%
Female 98.7%
Female 98.7%
Female 98.2%
Female 88.5%
Girl 99.1%
Girl 88.5%
Boy 99.1%
Male 99.1%
Adult 98.7%
Adult 98.7%
Adult 98.2%
Bride 98.7%
Woman 98.7%
Woman 98.2%

Categories

Imagga

people portraits 91.7%
paintings art 7.9%