Human Generated Data

Title

Untitled (Fourth of July festivities, Jersey Homesteads, New Jersey)
Date

July 1939
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3556
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Fourth of July festivities, Jersey Homesteads, New Jersey)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1939

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3556

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Person 99.3
Adult 98.8
Male 98.8
Man 98.8
Person 98.8
Person 98.1
Person 96.2
Person 95.6
Person 92
Face 83
Head 83
Clothing 82.2
Footwear 82.2
Shoe 82.2
Shoe 78.1
Person 74.9
Chair 74.2
Furniture 74.2
Kicking 73.5
Shoe 69.4
Person 64.7
Shoe 61.5
People 56.9

Clarifai
created on 2018-05-10

people 99.9
group together 98.7
group 98.7
adult 98.3
man 97.5
two 93.8
three 92.9
woman 91.8
vehicle 90.4
many 90.4
administration 90.3
several 90.3
wear 89.8
four 89.8
five 89.6
war 86.4
music 85.2
child 84.1
military 84
outfit 82.5

Imagga
created on 2023-10-05

sax 63.1
wind instrument 42
brass 35.4
silhouette 29.8
horn 28.8
man 28.2
device 25.1
musical instrument 23.5
cornet 22.6
sunset 21.6
people 21.2
male 20.6
men 18
instrumentality 17.3
black 16.8
sport 16.4
adult 16.4
person 15.2
sky 14
boy 12.2
play 12.1
active 11.9
shadow 11.6
artifact 11.5
outdoor 11.5
group 11.3
business 10.9
trombone 10.9
leisure 10.8
outdoors 10.7
businessman 10.6
together 10.5
activity 9.9
couple 9.6
women 9.5
beach 9.3
action 9.3
exercise 9.1
life 9
summer 9
human 9
walking 8.5
dark 8.4
city 8.3
music 8.2
danger 8.2
recreation 8.1
sun 8.1
body 8
lifestyle 8
day 7.8
travel 7.7
relax 7.6
fun 7.5
holding 7.4
teenager 7.3
success 7.2
world 7.2
family 7.1
posing 7.1

Google
created on 2018-05-10

photograph 95.9
black 95.5
black and white 90.2
snapshot 81.8
photography 80
monochrome photography 77.3
crew 75.1
monochrome 64.9
recreation 63.2

Microsoft
created on 2018-05-10

person 99.8
man 98.4
outdoor 98.1
standing 88.4
black 72.7
white 63.5
posing 52.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-22
Gender Male, 99.9%
Happy 85.1%
Surprised 6.7%
Fear 6.2%
Sad 5.5%
Disgusted 3.2%
Confused 1.8%
Calm 1%
Angry 0.6%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Happy 63.9%
Disgusted 11%
Surprised 7.3%
Fear 6.8%
Sad 5.9%
Angry 5.8%
Confused 5.1%
Calm 2.6%

AWS Rekognition

Age 14-22
Gender Male, 98.7%
Happy 65.9%
Confused 13.7%
Surprised 7.5%
Fear 6.6%
Angry 5.1%
Disgusted 4.3%
Sad 3.5%
Calm 3.3%

AWS Rekognition

Age 20-28
Gender Male, 81.8%
Calm 84%
Fear 6.6%
Surprised 6.4%
Happy 3.9%
Sad 3.8%
Confused 3.5%
Disgusted 1.4%
Angry 0.8%

AWS Rekognition

Age 30-40
Gender Male, 90.6%
Happy 60.9%
Calm 32.8%
Surprised 6.7%
Fear 6.3%
Sad 2.6%
Disgusted 1.6%
Confused 0.7%
Angry 0.6%

AWS Rekognition

Age 19-27
Gender Male, 99.6%
Calm 53.7%
Happy 17.1%
Surprised 10.1%
Sad 8.9%
Fear 6.9%
Angry 5.9%
Disgusted 2.8%
Confused 1.5%

AWS Rekognition

Age 20-28
Gender Male, 98.9%
Calm 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.2%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 12
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Male
Man
Person
Shoe
Chair
Adult 99.3%
Adult 98.8%
Male 99.3%
Male 98.8%
Man 99.3%
Man 98.8%
Person 99.3%
Person 99.3%
Person 98.8%
Person 98.1%
Person 96.2%
Person 95.6%
Person 92%
Person 74.9%
Person 64.7%
Shoe 82.2%
Shoe 78.1%
Shoe 69.4%
Shoe 61.5%
Chair 74.2%