Human Generated Data

Title

Untitled (elderly man sitting on city bench, head down)

Date

1961

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16097.2

Human Generated Data

Title

Untitled (elderly man sitting on city bench, head down)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Human 99.9
Person 99.9
Person 99.8
Person 99.3
Furniture 92.4
Path 85.6
Person 84.5
Pedestrian 79.1
Person 68.5
Transportation 68.3
Vehicle 68.3
Pavement 66.3
Sidewalk 66.3
Helmet 61.3
Apparel 61.3
Clothing 61.3
Face 61.1
Road 59.7
Tarmac 58.5
Asphalt 58.5
City 58.3
Street 58.3
Town 58.3
Building 58.3
Urban 58.3
Overcoat 56.3
Coat 56.3
Bench 55.7

Imagga
created on 2022-02-11

swab 57.6
cleaning implement 49.4
cleaner 26.6
man 20.1
building 19.1
city 16.6
male 16.3
people 16.2
rake 14.3
tool 14
street 13.8
television camera 13.7
architecture 13.4
silhouette 13.2
engineer 12.8
travel 12
sport 11.6
person 11.6
television equipment 11
old 10.4
sky 10.2
weapon 10.2
equipment 9.5
buildings 9.4
men 9.4
water 9.3
adult 9
outdoors 9
black 8.8
urban 8.7
power 8.4
electronic equipment 8.2
alone 8.2
ancient 7.8
walking 7.6
historic 7.3
protection 7.3
danger 7.3
worker 7.1

Google
created on 2022-02-11

Building 93.7
Sky 86.6
Travel 82.1
Road surface 80.1
Urban design 78.2
Asphalt 77.3
Tints and shades 77.1
Tree 76.3
Wood 76.1
Rectangle 76
City 75.5
Road 73.8
Sidewalk 72.9
Leisure 70.4
Street 68.9
Pedestrian 67.6
Metal 67
Sitting 64.7
Flooring 64.4
Recreation 63.1

Microsoft
created on 2022-02-11

outdoor 99.6
street 95.2
person 94.4
city 92.3
text 90.8
clothing 86.7
skyscraper 82.1
man 73.3
park 62.9
sky 58.5
waste container 58
building 53.9

Face analysis

Amazon

AWS Rekognition

Age 29-39
Gender Female, 77.1%
Happy 43.4%
Angry 33%
Calm 17.3%
Sad 2.8%
Confused 1.1%
Fear 0.9%
Disgusted 0.8%
Surprised 0.7%

AWS Rekognition

Age 4-12
Gender Male, 68.3%
Fear 39.3%
Calm 26.2%
Sad 18.3%
Confused 4.4%
Angry 4.1%
Disgusted 3.4%
Happy 2.6%
Surprised 1.8%

Feature analysis

Amazon

Person 99.9%
Helmet 61.3%
Bench 55.7%

Captions

Microsoft

a person sitting on a bench in the city 73%
a person sitting on a bench in a city 71.7%
a person sitting on a bench on a city street 66.5%

Text analysis

Amazon

ROCK
AVE
LOANS
KODYK
LOUIS
BENEFICIAL
ROCK H
3523 ST. LOUIS AVE
H
3523 ST.
EIFW
207٤٤٤٨ EIFW
LIFW
Thomps
Done
207٤٤٤٨

Google

HETHO MJI XAGOX
HETHO
XAGOX
MJI