Human Generated Data

Title

Houston St. Playground (East Houston Street, New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2205

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Houston St. Playground (East Houston Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2205

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.7
Person 99.7
Person 99.6
Person 99.5
Person 99.4
Person 99.3
Person 99.3
Person 99.2
Machine 99.2
Wheel 99.2
Person 98.9
Person 97.9
Pedestrian 90.2
Transportation 86.6
Vehicle 86.4
Clothing 80.4
Footwear 80.4
Shoe 80.4
Apparel 80.4
Person 72.3
Shoe 69.1
People 68.7
Person 66.7
Person 66.4
Coat 60.1
Overcoat 60.1
Spoke 56.9
Shoe 52.3

Clarifai
created on 2018-02-09

people 99.9
group together 99.7
group 99.3
many 99
adult 97.9
man 96.5
several 95.4
administration 94.2
vehicle 93.4
war 92.1
military 91.6
two 91.5
leader 90.6
three 90.2
wear 89.7
woman 88.9
transportation system 88.8
street 88.5
four 84.7
child 82.5

Imagga
created on 2018-02-09

stretcher 42.8
litter 35.1
conveyance 28
man 26.2
pedestrian 19.1
people 17.8
male 17.7
building 16.8
city 15
gun 13.3
person 12.9
architecture 12.6
urban 12.2
outdoors 12.1
cannon 11.7
outdoor 11.5
street 11
sky 10.8
silhouette 10.8
travel 10.6
weapon 10.5
old 10.4
men 10.3
day 10.2
water 10
barrow 9.9
adult 9.8
relax 9.3
brass 9.2
sitting 8.6
construction 8.6
trombone 8.3
landscape 8.2
vacation 8.2
happy 8.1
mountain 8
lifestyle 7.9
handcart 7.9
tourist 7.9
couple 7.8
destruction 7.8
stone 7.6
beach 7.6
walking 7.6
business 7.3
protection 7.3
sun 7.2
dirty 7.2
suit 7.2
history 7.2
summer 7.1
happiness 7

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

outdoor 99.5
person 88.4
old 65.1
pulling 33.3
older 24

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 65.3%
Disgusted 4.6%
Confused 2.5%
Angry 4.7%
Surprised 4.4%
Happy 3.3%
Sad 15.8%
Calm 64.7%

AWS Rekognition

Age 35-52
Gender Male, 98.7%
Disgusted 1.1%
Confused 6.1%
Angry 6.4%
Surprised 2.7%
Happy 0.9%
Sad 15.7%
Calm 67%

AWS Rekognition

Age 45-63
Gender Female, 53.7%
Angry 45.2%
Confused 45.1%
Disgusted 45.4%
Happy 52%
Surprised 45.3%
Sad 45.9%
Calm 46.1%

AWS Rekognition

Age 35-52
Gender Female, 54.2%
Disgusted 45.3%
Sad 50.2%
Angry 46.9%
Calm 45.9%
Surprised 46%
Happy 45.1%
Confused 45.8%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Happy 49.6%
Disgusted 50.1%
Confused 49.5%
Angry 49.6%
Surprised 49.5%
Sad 49.6%
Calm 49.5%

AWS Rekognition

Age 20-38
Gender Male, 54.3%
Disgusted 45.1%
Sad 46.3%
Calm 50.3%
Surprised 45.2%
Happy 46.8%
Confused 45.9%
Angry 45.3%

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Wheel 99.2%
Shoe 80.4%

Captions

Azure OpenAI

Created on 2024-01-27

This is a black and white photograph depicting an urban street scene. In the foreground, individuals can be seen walking on the sidewalk, and a person is pushing a wheelbarrow filled with what appears to be dirt or debris. In the background, there are more individuals walking, and some buildings with architectural details and signage are visible. The environment suggests an earlier era, indicated by the style of clothing of the people and the design of the buildings. The image has a vintage look, with some spots and marks that are indicative of aging photographic materials. Looming over the scene is a tall barrier wall with numbers '9' and '10' visible, possibly indicating construction sections or plots. The atmosphere seems busy but orderly, with individuals going about their tasks or travels.

Anthropic Claude

Created on 2024-03-29

The image appears to be a black and white photograph from what seems to be an early 20th century urban setting. It depicts a crowded street scene with several people visible, some standing and others carrying what looks like a wheelbarrow or cart. The buildings in the background have an ornate, architectural style characteristic of that time period. The overall mood and attire of the people suggest this is likely an image from the early to mid 1900s.

Text analysis

Amazon

10
9

Google

10
10