Human Generated Data

Title

Untitled (elderly man sitting on city bench)

Date

1961

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16096.3

Human Generated Data

Title

Untitled (elderly man sitting on city bench)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16096.3

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.8
Human 99.8
Person 99.8
Furniture 99.6
Person 99.2
Clothing 99
Apparel 99
Sitting 98.3
Shoe 98.2
Footwear 98.2
Shoe 97
Bench 87.2
Person 81.6
Park Bench 70.7
Overcoat 70.1
Coat 70.1
Hat 69.4
Person 66.3
Person 64.5
Shoe 63.5
Pedestrian 62.2
Face 57.1
Shorts 55

Clarifai
created on 2023-10-29

street 99.7
people 99.5
city 99
man 98.1
bench 97.4
portrait 94.7
urban 94.5
adult 94.5
woman 94.1
travel 93.7
chair 90.7
lid 89.8
landscape 88.2
group 88.1
group together 86.3
road 86.1
uniform 84.4
square 83.7
tourist 83.4
two 83.2

Imagga
created on 2022-02-11

business 32.2
people 31.2
office 30.2
silhouette 23.2
building 22.5
person 22.3
man 22.2
male 21.3
city 20.8
corporate 19.8
urban 18.3
businessman 17.7
crowd 17.3
architecture 16.4
work 15.7
men 14.6
businesswoman 14.5
professional 14.3
suit 14.1
adult 14
black 13
group 12.1
travel 12
modern 11.9
team 11.6
laptop 11.5
success 11.3
lights 10.2
executive 9.8
job 9.7
flag 9.6
billboard 9.5
glass 9.3
manager 9.3
finance 9.3
computer 9.2
spectator 9.2
design 9
worker 8.9
cheering 8.8
nighttime 8.8
audience 8.8
stadium 8.8
university 8.8
gate 8.7
women 8.7
patriotic 8.6
walk 8.6
traffic 8.5
nation 8.5
window 8.4
musical instrument 8.3
center 8.2
notebook 8.2
structure 8.1
symbol 8.1
harp 8
standing 7.8
airport 7.8
outside 7.7
construction 7.7
boss 7.6
muscular 7.6
stringed instrument 7.6
signboard 7.6
career 7.6
buildings 7.6
communication 7.6
meeting 7.5
outdoors 7.5
life 7.4
technology 7.4
town 7.4
teamwork 7.4
street 7.4
light 7.3
competition 7.3
indoor 7.3
electronic equipment 7.1
interior 7.1
working 7.1
vibrant 7

Google
created on 2022-02-11

Footwear 98.1
Building 93.9
Sky 89.7
Street fashion 87.4
Hat 86.1
Style 83.9
Travel 82.9
Line 81.6
Tints and shades 77.3
Bag 75.9
Luggage and bags 75.2
Beauty 74.8
Technology 74.4
Electronic device 74.1
Road 71.9
City 70.3
Eyewear 70.1
Pedestrian 69
Sidewalk 68.7
Sitting 68.1

Microsoft
created on 2022-02-11

outdoor 99.2
clothing 97.2
footwear 92.9
man 91.2
person 90.6
street 89
text 73.8
city 71.6
skyscraper 69.5
people 64.1
park 59.9
woman 58.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 96.6%
Calm 85.5%
Sad 9.6%
Happy 1.4%
Angry 1%
Confused 0.7%
Surprised 0.6%
Fear 0.6%
Disgusted 0.5%

AWS Rekognition

Age 18-24
Gender Male, 99.7%
Sad 49.3%
Confused 37.8%
Surprised 5.4%
Calm 3.5%
Angry 1.9%
Disgusted 1.1%
Happy 0.6%
Fear 0.5%

AWS Rekognition

Age 43-51
Gender Male, 99.5%
Calm 96.8%
Happy 0.8%
Sad 0.7%
Angry 0.6%
Confused 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Hat
Person 99.8%
Person 99.8%
Person 99.2%
Person 81.6%
Person 66.3%
Person 64.5%
Shoe 98.2%
Shoe 97%
Shoe 63.5%
Hat 69.4%

Categories

Text analysis

Amazon

LOANS
2
BENEFICIAL
HUD
ROCK HUD
ROCK
LOANS !
AKC
tiln
KODYR tiln
KODYR
!
X
are

Google

BEKEFICIA LOANS BOCK HUD MIIRYT3RA2 EAGOX
BEKEFICIA
LOANS
BOCK
HUD
MIIRYT3RA2
EAGOX