Human Generated Data

Title

Untitled (Houston Street Playground, East Houston Street, New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2463

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Houston Street Playground, East Houston Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2463

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Adult 98.9
Male 98.9
Man 98.9
Person 98.9
Person 98.7
Person 98.6
Person 98.1
Person 97.9
Clothing 97.6
Machine 97.4
Wheel 97.4
Person 97.2
Person 96.9
Person 96
Footwear 91
Shoe 91
Shoe 87.2
Outdoors 83.2
Person 76.7
Face 72.7
Head 72.7
Coat 72.3
Person 66.6
Nature 65.5
Transportation 65.3
Vehicle 65.3
Shoe 62.3
Snow 61.7
Shoe 60
Coat 57.7
City 57.2
Overcoat 56.5
Road 55.7
Street 55.7
Urban 55.7
Walking 55.1

Clarifai
created on 2018-05-10

people 100
group together 99.8
group 99.2
many 98.8
adult 98.6
several 97.1
man 96.4
vehicle 95.9
military 95.3
two 94.6
administration 94.1
wear 93.2
three 92.7
four 91.7
transportation system 91.6
war 91.6
recreation 91.1
leader 90.5
woman 89.6
five 87.8

Imagga
created on 2023-10-06

man 30.2
people 27.3
pedestrian 25.5
male 22.7
men 20.6
silhouette 18.2
snow 17.6
active 17.2
person 16.7
sport 16.4
ski 14.8
business 14.6
outdoor 14.5
group 14.5
winter 14.5
adult 14.4
city 14.1
walking 13.3
walk 12.4
action 12.1
cold 12.1
travel 12
women 11.9
hockey stick 11.7
mountain 11.6
lifestyle 11.6
urban 11.4
cello 11
stick 10.9
activity 10.7
crowd 10.6
fun 10.5
outdoors 10.5
equipment 10.4
work 10.2
sky 10.2
musical instrument 9.8
bowed stringed instrument 9.7
photographer 9.7
boy 9.6
leisure 9.1
exercise 9.1
black 9.1
life 9
team 9
success 8.9
businessman 8.8
stringed instrument 8.6
day 8.6
architecture 8.6
motion 8.6
beach 8.4
building 8.2
office 8.2
happy 8.1
suit 8.1
bassoon 8
tripod 7.8
high 7.8
youth 7.7
sports equipment 7.5
human 7.5
hill 7.5
one 7.5
sports 7.4
vacation 7.4
window 7.3
speed 7.3
wind instrument 7.1
support 7.1
worker 7.1
job 7.1

Google
created on 2018-05-10

photograph 95.3
black and white 89.3
snapshot 81.8
photography 78.5
winter 77.9
snow 74.9
monochrome photography 74
street 72.7
vehicle 65.3
monochrome 64.9
car 54.4
blizzard 53.3
road 51.5
ice 51.1

Microsoft
created on 2018-05-10

outdoor 99.9
person 92.6
transport 67.4
pulling 62.6
old 47.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Male, 100%
Sad 70.8%
Calm 52.9%
Fear 8.1%
Surprised 7.1%
Angry 2.7%
Happy 1.8%
Confused 1.5%
Disgusted 1.3%

AWS Rekognition

Age 23-33
Gender Male, 97.5%
Fear 60.4%
Calm 21.3%
Surprised 16.3%
Happy 6.1%
Sad 5.1%
Angry 2.8%
Disgusted 2.3%
Confused 1.3%

AWS Rekognition

Age 18-26
Gender Male, 92.5%
Calm 53.9%
Sad 14.6%
Happy 11.9%
Fear 9%
Surprised 8.5%
Disgusted 4.1%
Angry 2.5%
Confused 2.4%

AWS Rekognition

Age 18-26
Gender Female, 59.6%
Sad 82.6%
Calm 56%
Surprised 6.4%
Fear 6.2%
Angry 2.2%
Happy 1.3%
Confused 0.9%
Disgusted 0.9%

AWS Rekognition

Age 21-29
Gender Male, 97.3%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.1%
Angry 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 6-14
Gender Male, 64.5%
Happy 49.5%
Sad 47%
Surprised 9.1%
Angry 7.2%
Fear 6.8%
Calm 5.8%
Confused 2.4%
Disgusted 2%

Microsoft Cognitive Services

Age 16
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.4%
Male 99.4%
Man 99.4%
Person 99.4%
Wheel 97.4%
Shoe 91%
Coat 72.3%

Text analysis

Amazon

e
5
Or
DRO