Human Generated Data

Title

Untitled (elderly man sitting on city bench, head down)

Date

1961

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16098.2

Human Generated Data

Title

Untitled (elderly man sitting on city bench, head down)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Clothing 99.8
Footwear 99.8
Apparel 99.8
Shoe 99.8
Person 99.6
Human 99.6
Person 99.1
Person 98.6
Person 97.1
Furniture 97.1
Shoe 93.1
Shoe 92.4
Bench 78.8
Sitting 75.3
Pedestrian 65.2
Path 61.6
Banister 57.5
Handrail 57.5
Asphalt 57.3
Tarmac 57.3
Photography 55.7
Face 55.7
Photo 55.7
Portrait 55.7

Imagga
created on 2022-02-11

television camera 34.5
television equipment 27.6
city 25.8
architecture 22.2
tripod 21.6
electronic equipment 21
building 20
people 19.5
engineer 19.2
urban 18.3
sky 17.8
rack 17.2
male 17
travel 16.9
man 16.8
silhouette 14.9
support 14.6
street 13.8
equipment 13.6
business 12.8
buildings 12.3
photographer 12
person 11.8
adult 11.6
outdoor 11.5
old 11.1
structure 10.9
road 9.9
transportation 9.9
reflection 9.7
light 9.4
tourism 9.1
barrier 9
loneliness 8.8
men 8.6
glass 8.6
office 8.5
lamp 8.5
black 8.5
transport 8.2
alone 8.2
square 8.1
landmark 8.1
water 8
mountain 8
life 7.9
work 7.8
day 7.8
billboard 7.6
walking 7.6
cityscape 7.6
one 7.5
landscape 7.4
town 7.4
vacation 7.4
historic 7.3
holiday 7.2
women 7.1

Google
created on 2022-02-11

Building 93.7
Asphalt 87.9
Road surface 87.8
Standing 86.4
Mode of transport 85.6
Sidewalk 81
Tree 80.1
Travel 79.7
Sky 79.4
Road 77.2
Tints and shades 77.2
City 75.3
Metal 70.3
Pedestrian 69.2
Bag 69
Flooring 68.7
Design 68.3
Street 68
Track 67.6
Lane 64.2

Microsoft
created on 2022-02-11

outdoor 99.8
bench 99.2
ground 95.3
clothing 86.1
person 85.7
street 82.9
park 77.7
waste container 73.2
man 68.7
city 65.2
text 59.5

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 92.1%
Calm 95%
Happy 2.1%
Angry 0.7%
Sad 0.7%
Confused 0.6%
Surprised 0.3%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Confused 63.1%
Calm 27.6%
Surprised 5.1%
Sad 1.5%
Angry 1.1%
Disgusted 1%
Fear 0.4%
Happy 0.3%

AWS Rekognition

Age 52-60
Gender Male, 87.2%
Calm 85.9%
Happy 4.9%
Angry 3.6%
Sad 1.7%
Surprised 1.3%
Disgusted 1.2%
Confused 1%
Fear 0.5%

AWS Rekognition

Age 23-33
Gender Female, 89.2%
Calm 97.8%
Sad 0.8%
Fear 0.3%
Angry 0.3%
Surprised 0.3%
Happy 0.3%
Disgusted 0.2%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Shoe 99.8%
Person 99.6%

Captions

Microsoft

a person sitting on a bench 89.3%
a person sitting on a bench 89.2%
a man and a woman sitting on a bench 79.2%

Text analysis

Amazon

LOANS
BENEFICIAL
LOUIS
AVE
TRAVEL
3523 ST LOUIS AVE
KODYK
3523 ST
AKC
EITN
ESTER

Google

3523
BENEFICIAL
AVE
BENEFICIAL LOANS ww.H TIPTE 3523 ST LOUIS AVE
ww.H
TIPTE
LOANS
ST
LOUIS