Human Generated Data

Title

Untitled (Fourth of July festivities, Jersey Homesteads, New Jersey)
Date

July 1939
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3554
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Fourth of July festivities, Jersey Homesteads, New Jersey)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1939

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3554

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Bag 99.9
Boy 99.1
Child 99.1
Male 99.1
Person 99.1
Male 98.7
Person 98.7
Adult 98.7
Man 98.7
Boy 98.5
Male 98.5
Person 98.5
Teen 98.5
Person 98.5
Adult 98.5
Bride 98.5
Female 98.5
Wedding 98.5
Woman 98.5
Person 98.3
Person 98.2
Adult 98.2
Female 98.2
Woman 98.2
Person 98.1
Face 83.1
Head 83.1
Sack 71.3
Outdoors 67.6
War 57

Clarifai
created on 2018-05-10

people 100
adult 98.7
military 98
group 98
group together 97.8
child 97.3
war 96.3
man 96.3
wear 94.9
soldier 92.7
woman 92.3
uniform 90.2
many 87.4
five 87.3
boy 86.9
four 85.7
two 82.8
outfit 82.6
administration 82.2
mammal 81.8

Imagga
created on 2023-10-06

beach 51.8
ocean 41.4
man 35.6
sea 34.6
sunset 29.7
sand 28.9
water 28.7
summer 26.4
people 25.7
male 24.9
vacation 23.7
sky 23.7
kin 23.4
silhouette 21.5
person 20.4
travel 20.4
engineer 20.2
sun 20.1
coast 19.8
waves 18.6
outdoors 18.4
couple 18.3
walking 18
shore 17.8
sport 17.7
active 17.1
adult 17
outdoor 16.1
child 15.1
tropical 14.5
relax 14.3
boy 13.9
two 13.6
love 13.4
landscape 13.4
romantic 13.4
family 13.3
walk 13.3
together 12.3
holiday 12.2
sunny 12.1
men 12
mountain 11.6
lifestyle 11.6
dusk 11.4
coastline 11.3
fun 11.2
evening 11.2
horizon 10.8
happy 10.7
mother 10.2
lake 10.1
freedom 10.1
oriental 9.9
happiness 9.4
sunrise 9.4
leisure 9.1
tourist 9.1
recreation 9
romance 8.9
soldier 8.8
outside 8.6
free 8.4
holidays 8.4
uniform 8.2
danger 8.2
activity 8.1
twilight 7.8
fishing 7.7
clothing 7.7
clouds 7.6
fisherman 7.6
hill 7.5
life 7.5
holding 7.4
gun 7.4
rifle 7.3
protection 7.3
exercise 7.3
looking 7.2
father 7.1
scenic 7

Google
created on 2018-05-10

white 95.8
photograph 95.6
black 95.5
black and white 91
snapshot 81.8
photography 79.3
monochrome photography 79.2
monochrome 65.2
troop 61
history 51.5
stock photography 50.3

Microsoft
created on 2018-05-10

outdoor 99.3
megalith 20.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-24
Gender Male, 89.2%
Calm 67.8%
Sad 37.6%
Surprised 6.9%
Fear 6.3%
Confused 2.5%
Disgusted 1.8%
Happy 1.2%
Angry 1%

AWS Rekognition

Age 6-14
Gender Female, 96.3%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 1.6%
Confused 1.5%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Female, 73.3%
Sad 99.8%
Calm 19.9%
Surprised 6.4%
Fear 6.3%
Happy 5.5%
Confused 3%
Disgusted 0.4%
Angry 0.4%

AWS Rekognition

Age 7-17
Gender Female, 71.5%
Sad 100%
Surprised 9.3%
Calm 7.3%
Fear 5.9%
Confused 3.1%
Happy 0.4%
Angry 0.4%
Disgusted 0.2%

AWS Rekognition

Age 37-45
Gender Female, 73.7%
Sad 100%
Calm 15%
Surprised 6.3%
Fear 5.9%
Confused 0.1%
Happy 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Female, 82.9%
Calm 73.9%
Happy 9.9%
Sad 8%
Surprised 6.7%
Fear 6%
Confused 2.9%
Disgusted 1.4%
Angry 1.1%

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 53
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Boy 99.1%
Child 99.1%
Male 99.1%
Person 99.1%
Adult 98.7%
Man 98.7%
Teen 98.5%
Bride 98.5%
Female 98.5%
Woman 98.5%

Text analysis

Amazon

GREA
EENBERG
G.NE
N
ANIMAL N
ANIMAL