Human Generated Data

Title

Untitled (Musgrove family, between Hecla and Pleasant Unity, Westmoreland County, Pennsylvania)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1284
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Musgrove family, between Hecla and Pleasant Unity, Westmoreland County, Pennsylvania)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1284

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Person 99.1
Musical Instrument 99
Person 98.5
Adult 98.5
Male 98.5
Man 98.5
Person 98.1
Male 98.1
Boy 98.1
Child 98.1
Clothing 97.8
Face 97.8
Head 97.8
Photography 97.8
Portrait 97.8
Guitarist 96.8
Leisure Activities 96.8
Music 96.8
Musician 96.8
Performer 96.8
Guitar 95.4
Outdoors 74.2
Hat 68.9
Plant 57.2
Vegetation 57.2
Sitting 57
Soil 56.8
Shorts 56.8
Footwear 55.8
Shoe 55.8
Grass 55.5
Nature 55.5
Park 55.5
Sun Hat 55.3

Clarifai
created on 2018-05-11

people 100
child 99.3
adult 98.9
group 98.5
group together 98.5
two 98.5
man 97.1
three 96.1
war 95.6
military 94.4
offspring 93.4
four 92.9
wear 92
boy 91.9
recreation 91.7
several 91.6
five 91.4
soldier 90.9
sit 86.4
campsite 86.4

Imagga
created on 2023-10-06

man 28.2
barrow 24.6
people 24
water 21.3
outdoors 21.2
person 21.1
male 21
handcart 19.2
outdoor 18.3
wheeled vehicle 15.6
summer 14.1
beach 13.5
sunset 13.5
travel 13.4
outside 12.8
landscape 12.6
adult 12.5
sea 12.5
vacation 12.3
musical instrument 12.2
sky 12.1
sun 12.1
lake 11.9
child 11.8
boy 11.3
sitting 11.2
active 11
lifestyle 10.8
ocean 10.8
vehicle 10.8
mountain 10.7
fun 10.5
couple 10.5
adventure 10.4
rock 10.4
men 10.3
sport 10.3
relax 10.1
park 10
fisherman 9.9
portrait 9.7
love 9.5
day 9.4
two 9.3
stone 9.3
relaxation 9.2
peaceful 9.2
work 9
recreation 9
river 8.9
sand 8.7
hiking 8.7
wave 8.6
holiday 8.6
boat 8.4
rest 8.3
leisure 8.3
peace 8.2
stringed instrument 8.2
happy 8.1
activity 8.1
life 8
family 8
spring 7.8
tree 7.7
conveyance 7.7
shore 7.6
brass 7.5
silhouette 7.4
sports 7.4
natural 7.4
bench 7.3
hat 7.3
wind instrument 7.1
grass 7.1
autumn 7
country 7
together 7

Google
created on 2018-05-11

photograph 95.9
black and white 91.7
snapshot 81.8
monochrome photography 80.8
monochrome 70.1
tree 69.1
human behavior 62.3
recreation 61.4
child 56.9
stock photography 54.2

Microsoft
created on 2018-05-11

outdoor 100
person 95.8
old 77.3
white 69
black 68.5
crowd 2.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Male, 100%
Sad 100%
Confused 6.4%
Surprised 6.3%
Fear 6%
Calm 5.1%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 2-10
Gender Female, 76.1%
Calm 87%
Sad 10.5%
Surprised 6.4%
Fear 6%
Confused 0.2%
Angry 0.2%
Disgusted 0.2%
Happy 0.2%

Microsoft Cognitive Services

Age 19
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Adult 98.5%
Male 98.5%
Man 98.5%
Boy 98.1%
Child 98.1%
Guitar 95.4%
Hat 68.9%
Shoe 55.8%

Categories

Imagga

paintings art 65.9%
nature landscape 20.4%
people portraits 10.2%
streetview architecture 2.3%

Captions

Microsoft
created on 2018-05-11

a vintage photo of a boy 81.6%
a black and white photo of a boy 75.8%
an old black and white photo of a boy 75.7%