Human Generated Data

Title

Untitled (elderly man sitting on city bench, head down)

Date

1961

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16098.3

Human Generated Data

Title

Untitled (elderly man sitting on city bench, head down)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.8
Human 99.8
Person 99.6
Person 98
Musician 95.1
Musical Instrument 95.1
Clothing 85.5
Footwear 85.5
Shoe 85.5
Apparel 85.5
Path 77.3
Sitting 75.7
Road 75.3
Building 70.9
Street 70.9
Town 70.9
City 70.9
Urban 70.9
Furniture 70.7
Stick 67.7
Cane 58.2
Percussion 57.6
Drummer 57.6
Pedestrian 57.4
Face 57.1
Photography 56.9
Photo 56.9
Portrait 56.9

Imagga
created on 2022-02-11

billboard 33.6
television camera 32.5
engineer 30.4
signboard 27.4
television equipment 26
structure 22.5
people 21.2
urban 21
man 20.8
sky 20.4
electronic equipment 20.1
travel 18.3
city 18.3
male 17.7
architecture 16.4
building 16.3
person 15.8
silhouette 15.7
equipment 14.4
transportation 14.3
business 12.7
water 12.7
landscape 11.1
transport 10.9
outdoor 10.7
light 10.7
vacation 10.6
men 10.3
television 10.1
clouds 10.1
tourism 9.9
old 9.7
reflection 9.7
traffic 9.5
walking 9.5
work 9.4
outside 9.4
black 9.1
adult 9
road 9
summer 9
outdoors 9
motion 8.6
modern 8.4
office 8.2
tower 8.1
life 8
holiday 7.9
glass 7.8
move 7.7
walk 7.6
house 7.5
evening 7.5
one 7.5
street 7.4
lake 7.3
alone 7.3
lifestyle 7.2
active 7.2
sunset 7.2
mountain 7.1
night 7.1

Google
created on 2022-02-11

Building 92.4
Tree 84.5
Asphalt 83.2
Street fashion 82.7
Line 82.4
Travel 82.2
Road surface 80.4
Sky 77.8
Tints and shades 77.2
Sidewalk 75.7
City 72.6
Road 72.4
Leisure 71
Hat 70.5
Musician 69.3
Street 68.8
Pedestrian 68.2
Metal 68.1
T-shirt 65.9
Cameras & optics 64.9

Microsoft
created on 2022-02-11

outdoor 99.4
person 92.5
clothing 82.4
text 77.1
man 76.3
park 74.4
street 59
skyscraper 51.6

Face analysis

Amazon

Google

AWS Rekognition

Age 71-81
Gender Female, 56.2%
Happy 56.3%
Angry 17.6%
Calm 9.4%
Surprised 6.1%
Confused 5.7%
Disgusted 1.8%
Sad 1.6%
Fear 1.4%

AWS Rekognition

Age 28-38
Gender Male, 99%
Calm 49.5%
Sad 47.5%
Fear 0.7%
Disgusted 0.6%
Happy 0.6%
Confused 0.5%
Surprised 0.4%
Angry 0.2%

AWS Rekognition

Age 21-29
Gender Male, 97.9%
Calm 83.9%
Confused 5.8%
Fear 4.6%
Sad 2.3%
Surprised 1.9%
Happy 0.8%
Disgusted 0.5%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 85.5%

Captions

Microsoft

a person sitting on a bench 81%
a person sitting on a park bench 66.8%
a man and a woman sitting on a bench 64.4%

Text analysis

Amazon

LOUIS
LOANS
AVE
BENEFICIAL
5
3523 ST. LOUIS AVE
USARMY
3523 ST.
25TH
INTERSTATE 25TH
INTERSTATE
-

Google

AVE
LOANS
H&RH BEWEFICIAL LOANS ww.H TPTE 3523 ST LOUS AVE VSARMY
TPTE
LOUS
H&RH
BEWEFICIAL
3523
VSARMY
ww.H
ST