Human Generated Data

Title

Untitled (Red House, West Virginia)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1181
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Red House, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1181

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 99.8
Hat 99.8
Adult 99
Male 99
Man 99
Person 99
Adult 98.6
Male 98.6
Man 98.6
Person 98.6
Person 98.3
Adult 98.1
Male 98.1
Man 98.1
Person 98.1
Person 97.6
Adult 97.5
Male 97.5
Man 97.5
Person 97.5
Person 97
Baby 97
Furniture 96.4
Person 96.3
Person 94.3
Face 93.6
Head 93.6
Person 91.1
Bed 86.1
Bunk Bed 86.1
Photography 85.1
Portrait 85.1
Person 66.6
People 60.3
Formal Wear 56.4
Suit 56.4
Body Part 56.1
Finger 56.1
Hand 56.1
Cap 56
Coat 56
Bench 55.5

Clarifai
created on 2018-05-11

people 99.9
group 99.6
group together 98.5
many 97.3
adult 96.4
man 95.3
several 95.1
woman 93.7
child 92.1
administration 90.7
leader 90.5
facial expression 89.8
portrait 89.5
wear 87.7
five 85.5
outfit 82
four 81.7
music 81
sit 81
boy 78.5

Imagga
created on 2023-10-05

man 24.8
people 21.2
male 19.9
person 16.6
old 13.9
adult 13.8
home 12.8
sitting 12
house 10.9
happy 10.6
room 10.4
shop 10.1
religion 9.9
travel 9.8
fashion 9.8
clothing 9.7
couple 9.6
men 9.4
building 9.2
city 9.1
device 9.1
portrait 9.1
dress 9
history 8.9
family 8.9
worker 8.8
spectator 8.7
ancient 8.6
business 8.5
historic 8.2
window 8.2
uniform 8.1
looking 8
interior 8
smiling 8
industry 7.7
vintage 7.4
work 7.3
industrial 7.3
group 7.2
mother 7.1
night 7.1
architecture 7
indoors 7

Google
created on 2018-05-11

photograph 96.1
black and white 89.7
snapshot 81.8
standing 78
monochrome photography 76.2
vintage clothing 66.9
history 66.9
monochrome 64.5
family 51

Microsoft
created on 2018-05-11

person 99.8
posing 77.5
group 69.8
old 49.7
crowd 0.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Calm 70.9%
Angry 8.4%
Surprised 6.9%
Sad 6.3%
Fear 6.2%
Confused 5.3%
Happy 3.7%
Disgusted 1.8%

AWS Rekognition

Age 24-34
Gender Female, 95.7%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Angry 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 6-14
Gender Female, 89.6%
Happy 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.2%
Confused 0.1%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 6-14
Gender Female, 99.9%
Calm 98.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.9%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.5%
Calm 94.8%
Surprised 6.4%
Fear 5.9%
Happy 2.6%
Sad 2.4%
Angry 0.9%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Female, 59.5%
Calm 89.9%
Surprised 6.4%
Fear 6.4%
Angry 3.8%
Sad 2.5%
Confused 1.6%
Happy 1.2%
Disgusted 0.8%

AWS Rekognition

Age 12-20
Gender Female, 99.7%
Happy 97.3%
Surprised 6.4%
Fear 6.1%
Sad 2.3%
Angry 0.6%
Calm 0.5%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 25-35
Gender Female, 60.4%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.4%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 30-40
Gender Female, 95.6%
Fear 94.1%
Calm 14.3%
Surprised 6.4%
Sad 2.6%
Happy 0.5%
Confused 0.5%
Disgusted 0.3%
Angry 0.1%

AWS Rekognition

Age 11-19
Gender Male, 97.5%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 21-29
Gender Female, 74%
Calm 54.6%
Angry 19.6%
Happy 13.2%
Surprised 8.4%
Fear 6.8%
Sad 3.7%
Disgusted 1.7%
Confused 1%

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99%
Male 99%
Man 99%
Person 99%
Baby 97%

Categories

Imagga

paintings art 89.3%
streetview architecture 7.8%
people portraits 2%