Human Generated Data

Title

Untitled (elderly man sitting on city bench, head down)

Date

1961

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16097.3

Human Generated Data

Title

Untitled (elderly man sitting on city bench, head down)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Human 99.7
Person 99.7
Person 99.6
Person 98.4
Person 96.9
Pedestrian 93
Musical Instrument 74.1
Musician 74.1
Path 67.7
Skirt 61.1
Clothing 61.1
Apparel 61.1
Tarmac 59.4
Asphalt 59.4
Flagstone 59
Drummer 57.8
Percussion 57.8

Imagga
created on 2022-02-11

television camera 35.3
city 29.1
television equipment 28.2
engineer 24.6
architecture 24.6
building 23
swab 21.7
electronic equipment 21.4
people 20.6
sky 20.4
cleaning implement 19.9
urban 19.2
man 18.8
equipment 15.8
silhouette 15.7
travel 15.5
male 14.2
street 13.8
buildings 13.2
business 12.1
cityscape 11.3
old 11.1
structure 10.9
office 10.6
men 10.3
photographer 10
reflection 9.7
person 9.7
tool 9.5
water 9.3
clouds 9.3
outdoor 9.2
window 9.2
modern 9.1
landmark 9
summer 9
skyscraper 8.8
work 8.6
england 8.6
glass 8.6
adult 8.4
tourism 8.2
rake 8.2
outdoors 8.2
vacation 8.2
square 8.1
new 8.1
lamp 8.1
tower 8.1
light 8
black 7.9
tripod 7.7
support 7.7
construction 7.7
skyline 7.6
walking 7.6
bridge 7.6
one 7.5
landscape 7.4
alone 7.3
holiday 7.2
rack 7.1
worker 7.1
working 7.1
life 7

Google
created on 2022-02-11

Trousers 96.3
Building 92.1
Sky 86.2
Travel 82.5
Line 81.9
Musician 79.7
Asphalt 78.2
Road 77.2
Tree 76.4
Road surface 75
Bag 74.9
Sidewalk 73.3
Street fashion 73
Leisure 72.3
City 71.6
Design 68.4
Street 68
Hat 66.7
Metal 66.3
Recreation 65.9

Microsoft
created on 2022-02-11

outdoor 99.4
person 96.2
ground 95.4
clothing 94.5
street 93.8
man 93.1
city 89.8
text 78.5
skyscraper 57.1
park 56.6

Face analysis

Amazon

Google

AWS Rekognition

Age 16-24
Gender Female, 93.2%
Calm 93.4%
Happy 3.6%
Sad 1.5%
Angry 0.6%
Fear 0.3%
Surprised 0.3%
Confused 0.2%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Skirt 61.1%

Captions

Microsoft

a group of people sitting on a bench 75.8%
a group of people that are sitting on a bench 70.8%
a group of people sitting on a wooden bench 70.1%

Text analysis

Amazon

LOANS
ROCK
ROCK HUDSON
OUIS
OUIS AVE
HUDSON
AVE
BENEFICIAL
KODYY
T3
KODYY COVERA ELEW
Toup
Al
ELEW
COVERA
NATURAL

Google

BENEFICIAL LOANS ww.it ROCK HUDSON OUIS AVE A2 AG
ww.it
BENEFICIAL
ROCK
HUDSON
AVE
OUIS
A2
LOANS
AG