Human Generated Data

Title

Untitled (Musgrove family, between Hecla and Pleasant Unity, Westmoreland County, Pennsylvania)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1285

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Musgrove family, between Hecla and Pleasant Unity, Westmoreland County, Pennsylvania)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1285

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Boy 99.4
Male 99.4
Person 99.4
Teen 99.4
Person 99.2
Person 99.2
Guitar 98.5
Musical Instrument 98.5
Clothing 91.4
Hat 84.6
Face 83.4
Head 83.4
Guitar 79.3
Ball 79.1
Rugby 79.1
Rugby Ball 79.1
Sport 79.1
Guitarist 78.8
Leisure Activities 78.8
Music 78.8
Musician 78.8
Performer 78.8
Banjo 65.5
Photography 55.8
Portrait 55.8
Soil 55.6

Clarifai
created on 2018-05-11

people 100
adult 99.3
group 98.2
child 97.9
man 97.4
group together 96.4
woman 94.9
two 94
three 92.1
sit 91.8
five 91.3
recreation 89.4
war 89.4
several 89.3
military 88.6
boy 87.7
four 86.3
portrait 84.7
many 84
one 83.2

Imagga
created on 2023-10-06

banjo 100
stringed instrument 81.2
musical instrument 73.8
man 31.6
male 28.4
people 27.3
outdoors 24.8
person 21.3
outdoor 16.8
hat 16.7
boy 16.5
fun 16.4
adult 16.3
drum 16.3
summer 15.4
happy 15
child 13.9
rock 13.9
outside 13.7
two 13.5
hiking 13.5
active 13.4
mountain 13.4
couple 13.1
lifestyle 13
guitar 12.7
grass 12.6
percussion instrument 12.4
old 11.8
smiling 11.6
musical 11.5
sky 11.5
vacation 11.4
together 11.4
instrument 11.3
love 11
music 10.9
field 10.9
park 10.7
family 10.7
sport 10.4
happiness 10.2
leisure 10
travel 9.8
attractive 9.8
day 9.4
holiday 9.3
beach 9.3
smile 9.3
joy 9.2
equipment 9.1
playing 9.1
portrait 9.1
father 9
country 8.8
hike 8.8
natural 8.7
play 8.6
sitting 8.6
adventure 8.5
casual 8.5
healthy 8.2
landscape 8.2
cowboy 8.2
musician 8
kid 8
guy 7.9
rural 7.9
hiker 7.9
player 7.8
band 7.8
men 7.7
elderly 7.7
hand 7.6
mother 7.6
human 7.5
sports 7.4
water 7.3
children 7.3
uniform 7.2
sun 7.2
meadow 7.2
activity 7.2

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

outdoor 99.9
grass 95.5
person 91.5
posing 58.4
group 57.1
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Female, 78.4%
Calm 87.2%
Surprised 6.5%
Fear 6.1%
Happy 4%
Confused 3.6%
Disgusted 2.9%
Sad 2.4%
Angry 0.6%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Sad 97.6%
Calm 40.2%
Surprised 6.3%
Fear 5.9%
Confused 5.8%
Angry 0.9%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Male, 100%
Confused 52.5%
Calm 32.4%
Surprised 7.1%
Fear 6.6%
Angry 4.8%
Disgusted 3.9%
Sad 2.7%
Happy 1.5%

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Boy 99.4%
Male 99.4%
Person 99.4%
Teen 99.4%
Guitar 98.5%
Hat 84.6%
Rugby Ball 79.1%

Categories