Human Generated Data

Title

Untitled (Fourth of July festivities, Jersey Homesteads, New Jersey)
Date

July 1939
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3555
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Fourth of July festivities, Jersey Homesteads, New Jersey)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1939

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3555

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

People 99.9
Bench 99.3
Furniture 99.3
Person 99
Adult 99
Male 99
Man 99
Person 98.5
Person 97.7
Adult 97.7
Male 97.7
Man 97.7
Person 97.6
Person 96.5
Adult 96.5
Male 96.5
Man 96.5
Person 95.7
Person 95.6
Person 95.5
Adult 95.5
Male 95.5
Man 95.5
Person 94.7
Person 94.2
Person 93.9
Baby 93.9
Person 92.8
Person 91.6
Person 91.4
Person 90.2
Person 89
Adult 89
Male 89
Man 89
Person 88.6
Adult 88.6
Male 88.6
Man 88.6
Face 85.8
Head 85.8
Person 85.7
Person 83.4
Person 83.3
Person 83.1
Person 80.6
Person 80.2
Person 77.6
Person 72.8
American Flag 71.5
Flag 71.5
Person 69.2
Photography 68.4
Portrait 68.4
Crowd 68.3
Person 66
Person 65.5
Car 64.5
Transportation 64.5
Vehicle 64.5
Person 64.2
Person 61.7
Person 60.3
Clothing 57.6
Hat 57.6
Car 57.5
Architecture 56.4
Building 56.4
Outdoors 56.4
Shelter 56.4
Person 55.8
Urban 55.6
Factory 55.3
Audience 55.3
Formal Wear 55.2
Suit 55.2

Clarifai
created on 2018-05-10

people 99.9
group 99.2
many 99.2
adult 97.9
group together 97.8
vehicle 95.1
administration 93.7
war 93.6
man 92.9
military 92.7
several 89
child 88.7
home 88.6
leader 88.2
woman 86.5
transportation system 86.5
soldier 84.8
furniture 82.8
crowd 82.5
watercraft 81.6

Imagga
created on 2023-10-05

sky 26.2
travel 21.1
architecture 21.1
snow 19.7
landscape 19.3
city 19.1
sea 18.8
building 17.2
ocean 16.8
water 16.7
tourism 16.5
beach 15.8
clouds 15.2
coast 14.4
house 14.2
tree 13.3
shore 13.1
cityscape 12.3
vacation 12.3
people 12.3
urban 12.2
cloud 12
winter 11.9
lake 11.9
day 11.8
summer 11.6
river 11.6
man 11.5
buildings 11.3
park 11.2
history 10.7
outdoor 10.7
old 10.4
street 10.1
life 9.9
world 9.8
pollution 9.6
spectator 9.2
tower 8.9
seller 8.4
weather 8.4
town 8.3
sand 8.2
island 8.2
center 8.2
person 8
destruction 7.8
disaster 7.8
wave 7.8
cold 7.7
england 7.6
walking 7.6
waves 7.4
environment 7.4
danger 7.3
sun 7.2
horizon 7.2
holiday 7.2
trees 7.1
pedestrian 7

Google
created on 2018-05-10

photograph 95.4
black and white 87.9
car 82.6
snapshot 81.8
monochrome photography 74.3
vehicle 74.1
motor vehicle 69.8
monochrome 62.4
history 58.2
recreation 55.7

Microsoft
created on 2018-05-10

outdoor 90.2
person 88.5
group 69.4
crowd 2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 40-48
Gender Female, 62.9%
Angry 83.1%
Surprised 6.6%
Fear 6.1%
Sad 5%
Calm 4.9%
Confused 2%
Happy 2%
Disgusted 0.5%

AWS Rekognition

Age 11-19
Gender Female, 97.5%
Fear 70.9%
Sad 19.3%
Happy 11.8%
Surprised 8.5%
Calm 7.1%
Confused 3.7%
Disgusted 1.2%
Angry 1%

AWS Rekognition

Age 47-53
Gender Male, 98.8%
Sad 100%
Calm 12.1%
Surprised 6.5%
Fear 6.4%
Confused 2.8%
Angry 0.9%
Happy 0.7%
Disgusted 0.4%

AWS Rekognition

Age 20-28
Gender Male, 67.4%
Calm 97.5%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Happy 1.1%
Confused 0.3%
Disgusted 0.3%
Angry 0.1%

AWS Rekognition

Age 50-58
Gender Male, 99.7%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.5%
Disgusted 0.1%
Confused 0.1%
Angry 0%

AWS Rekognition

Age 23-33
Gender Male, 99%
Sad 63.8%
Calm 50.7%
Confused 7.5%
Disgusted 7.2%
Surprised 6.7%
Fear 6.1%
Angry 1.2%
Happy 1.2%

AWS Rekognition

Age 18-26
Gender Female, 77.2%
Sad 69%
Calm 34.1%
Happy 14.9%
Surprised 8.9%
Fear 7.5%
Disgusted 6.2%
Angry 2.6%
Confused 1.5%

AWS Rekognition

Age 21-29
Gender Male, 58.6%
Calm 95.9%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Confused 1.7%
Happy 1%
Angry 0.4%
Disgusted 0.2%

AWS Rekognition

Age 16-22
Gender Female, 62.6%
Sad 82.6%
Fear 18.3%
Angry 17.8%
Calm 13.2%
Surprised 8.4%
Disgusted 5.2%
Confused 2.2%
Happy 1.2%

AWS Rekognition

Age 18-24
Gender Female, 63.7%
Calm 30.9%
Fear 25.2%
Surprised 12%
Sad 11.9%
Confused 9.5%
Happy 4.5%
Angry 4.5%
Disgusted 4.4%

AWS Rekognition

Age 12-20
Gender Female, 74.7%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.6%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 16-24
Gender Male, 80.5%
Sad 50.5%
Fear 28.8%
Disgusted 22%
Calm 10.1%
Surprised 7.2%
Happy 6.8%
Angry 2.9%
Confused 1.8%

AWS Rekognition

Age 2-8
Gender Female, 99.1%
Sad 52.1%
Fear 26.1%
Calm 15.5%
Confused 12.8%
Angry 11.8%
Surprised 7.8%
Happy 2.4%
Disgusted 1.5%

AWS Rekognition

Age 7-17
Gender Male, 69.3%
Calm 85.8%
Fear 9.3%
Surprised 6.4%
Angry 3.3%
Sad 2.3%
Happy 1.5%
Disgusted 0.7%
Confused 0.5%

AWS Rekognition

Age 21-29
Gender Male, 99.4%
Calm 97.7%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Angry 0.5%
Happy 0.3%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 13-21
Gender Female, 60.6%
Calm 80.8%
Happy 10.9%
Surprised 6.5%
Fear 6%
Sad 4.3%
Angry 0.9%
Disgusted 0.9%
Confused 0.7%

AWS Rekognition

Age 6-14
Gender Male, 96.3%
Sad 81.8%
Calm 32.1%
Fear 13.7%
Angry 8.3%
Surprised 6.7%
Disgusted 5%
Happy 1.4%
Confused 1.3%

AWS Rekognition

Age 23-33
Gender Male, 98.9%
Calm 96.3%
Surprised 6.3%
Fear 5.9%
Sad 2.7%
Angry 1.8%
Confused 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 27-37
Gender Female, 75.7%
Calm 78.7%
Surprised 13.8%
Sad 6.1%
Fear 6%
Confused 1.4%
Angry 0.8%
Happy 0.8%
Disgusted 0.3%

Feature analysis

Amazon

Person 99%
Adult 99%
Male 99%
Man 99%
Baby 93.9%
Car 64.5%

Captions

Microsoft
created on 2018-05-10

a group of people on a boat 74.1%
a group of people in a boat 74%
a group of people sitting on a boat 62.5%