Human Generated Data

Title

Untitled (elderly man sitting on city bench)

Date

1961

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16096.3

Human Generated Data

Title

Untitled (elderly man sitting on city bench)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Human 99.8
Person 99.8
Person 99.8
Furniture 99.6
Person 99.2
Clothing 99
Apparel 99
Sitting 98.3
Shoe 98.2
Footwear 98.2
Shoe 97
Bench 87.2
Person 81.6
Park Bench 70.7
Overcoat 70.1
Coat 70.1
Hat 69.4
Person 66.3
Person 64.5
Shoe 63.5
Pedestrian 62.2
Face 57.1
Shorts 55

Imagga
created on 2022-02-11

business 32.2
people 31.2
office 30.2
silhouette 23.2
building 22.5
person 22.3
man 22.2
male 21.3
city 20.8
corporate 19.8
urban 18.3
businessman 17.7
crowd 17.3
architecture 16.4
work 15.7
men 14.6
businesswoman 14.5
professional 14.3
suit 14.1
adult 14
black 13
group 12.1
travel 12
modern 11.9
team 11.6
laptop 11.5
success 11.3
lights 10.2
executive 9.8
job 9.7
flag 9.6
billboard 9.5
glass 9.3
manager 9.3
finance 9.3
computer 9.2
spectator 9.2
design 9
worker 8.9
cheering 8.8
nighttime 8.8
audience 8.8
stadium 8.8
university 8.8
gate 8.7
women 8.7
patriotic 8.6
walk 8.6
traffic 8.5
nation 8.5
window 8.4
musical instrument 8.3
center 8.2
notebook 8.2
structure 8.1
symbol 8.1
harp 8
standing 7.8
airport 7.8
outside 7.7
construction 7.7
boss 7.6
muscular 7.6
stringed instrument 7.6
signboard 7.6
career 7.6
buildings 7.6
communication 7.6
meeting 7.5
outdoors 7.5
life 7.4
technology 7.4
town 7.4
teamwork 7.4
street 7.4
light 7.3
competition 7.3
indoor 7.3
electronic equipment 7.1
interior 7.1
working 7.1
vibrant 7

Google
created on 2022-02-11

Footwear 98.1
Building 93.9
Sky 89.7
Street fashion 87.4
Hat 86.1
Style 83.9
Travel 82.9
Line 81.6
Tints and shades 77.3
Bag 75.9
Luggage and bags 75.2
Beauty 74.8
Technology 74.4
Electronic device 74.1
Road 71.9
City 70.3
Eyewear 70.1
Pedestrian 69
Sidewalk 68.7
Sitting 68.1

Microsoft
created on 2022-02-11

outdoor 99.2
clothing 97.2
footwear 92.9
man 91.2
person 90.6
street 89
text 73.8
city 71.6
skyscraper 69.5
people 64.1
park 59.9
woman 58.4

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 96.6%
Calm 85.5%
Sad 9.6%
Happy 1.4%
Angry 1%
Confused 0.7%
Surprised 0.6%
Fear 0.6%
Disgusted 0.5%

AWS Rekognition

Age 18-24
Gender Male, 99.7%
Sad 49.3%
Confused 37.8%
Surprised 5.4%
Calm 3.5%
Angry 1.9%
Disgusted 1.1%
Happy 0.6%
Fear 0.5%

AWS Rekognition

Age 43-51
Gender Male, 99.5%
Calm 96.8%
Happy 0.8%
Sad 0.7%
Angry 0.6%
Confused 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 98.2%
Hat 69.4%

Captions

Microsoft

a group of people sitting on a bench 94.5%
a group of people sitting on a bench in the city 92.6%
a group of people that are sitting on a bench 91.9%

Text analysis

Amazon

LOANS
2
BENEFICIAL
HUD
ROCK HUD
ROCK
LOANS !
AKC
tiln
KODYR tiln
KODYR
!
X
are

Google

BOCK
HUD
EAGOX
BEKEFICIA LOANS BOCK HUD MIIRYT3RA2 EAGOX
MIIRYT3RA2
LOANS
BEKEFICIA