Human Generated Data

Title

Untitled (Musgrove family, between Hecla and Pleasant Unity, Westmoreland County, Pennsylvania)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1223

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Musgrove family, between Hecla and Pleasant Unity, Westmoreland County, Pennsylvania)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1223

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 99.9
Apparel 99.9
Person 99.6
Human 99.6
Person 99.4
Hat 99.1
Person 99
Guitar 97.2
Musical Instrument 97.2
Leisure Activities 97.2
Person 93.5
Meal 90.5
Food 90.5
Sun Hat 83.4
Vacation 66.2
Cowboy Hat 60.7
People 60.6
Picnic 59.2

Clarifai
created on 2023-10-15

people 99.9
adult 99
group together 99
group 97.9
recreation 97.2
man 97
three 96.8
two 95.7
campsite 95.4
woman 95.3
portrait 94
four 93.6
five 93.2
child 91.4
tent 90.8
lid 88.7
monochrome 88.5
several 88.1
boy 87.7
wear 87.5

Imagga
created on 2021-12-15

man 34.9
male 32.7
outdoors 29.2
people 24.5
person 21
happy 20
couple 18.3
outdoor 16.8
active 16.3
elderly 16.3
senior 15.9
conveyance 15.9
adult 15.6
lifestyle 15.2
together 14.9
sitting 14.6
smiling 14.5
park 14.1
mature 13.9
boy 13.9
outside 13.7
fun 13.5
leisure 13.3
portrait 12.9
stretcher 12.6
old 12.5
smile 12.1
countryside 11.9
relaxing 11.8
vehicle 11.8
activity 11.6
hat 11.6
men 11.2
grass 11.1
two 11
helmet 10.6
summer 10.3
love 10.3
wheeled vehicle 10.2
litter 10.1
field 10
child 9.7
work 9.7
working 9.7
bench 9.6
sport 9.5
day 9.4
equipment 9.2
recreation 9
family 8.9
group 8.9
home 8.8
holiday 8.6
enjoying 8.5
worker 8.5
relaxation 8.4
father 8.3
bicycle 8.3
camera 8.3
children 8.2
vacation 8.2
mother 8.1
happiness 7.8
kin 7.7
retirement 7.7
adventure 7.6
relax 7.6
laughing 7.6
healthy 7.6
joy 7.5
friends 7.5
relaxed 7.5
landscape 7.4
teen 7.3
peaceful 7.3
cheerful 7.3
teenager 7.3
playing 7.3
road 7.2
job 7.1
rural 7
travel 7
country 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

person 99.9
outdoor 99.9
clothing 97.2
text 93.9
man 88.2
people 75
tree 69.4
group 55.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 99.6%
Angry 84.5%
Calm 8.3%
Confused 2.2%
Sad 2%
Disgusted 1.7%
Surprised 0.8%
Fear 0.5%
Happy 0.2%

AWS Rekognition

Age 45-63
Gender Male, 93.5%
Calm 78.2%
Sad 19.4%
Angry 1.5%
Surprised 0.4%
Fear 0.3%
Confused 0.2%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 32-48
Gender Male, 93.5%
Calm 87.9%
Sad 11.8%
Angry 0.2%
Confused 0.1%
Fear 0%
Happy 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 31-47
Gender Male, 69.8%
Sad 99.9%
Calm 0.1%
Fear 0%
Angry 0%
Happy 0%
Confused 0%
Disgusted 0%
Surprised 0%

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 99.1%
Guitar 97.2%

Categories

Imagga

people portraits 97.2%
paintings art 2.1%