Human Generated Data

Title

Untitled (elderly man sitting on city bench, head down)

Date

1961

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16097

Human Generated Data

Title

Untitled (elderly man sitting on city bench, head down)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.9
Human 99.9
Person 99.7
Person 99.1
Person 86
Furniture 84.6
Apparel 83.9
Footwear 83.9
Shoe 83.9
Clothing 83.9
Pedestrian 80.2
Path 73.1
Shoe 67.6
Vehicle 59.6
Transportation 59.6
Stick 57.6
Bench 56.8
Handrail 55.9
Banister 55.9
Flagstone 55.8
Sidewalk 55.2
Pavement 55.2

Imagga
created on 2022-02-11

swab 59.9
cleaning implement 53.9
man 23.5
male 21.3
building 20.4
people 18.4
city 18.3
engineer 16.4
architecture 15
weapon 14.4
old 13.9
street 13.8
silhouette 13.2
person 12.9
cleaner 11.5
urban 11.4
adult 11
sport 10.7
black 10.3
business 10.3
men 10.3
sky 10.2
outdoors 9.7
office 9.7
travel 9.1
television camera 8.7
buildings 8.5
modern 8.4
ancient 7.8
power 7.6
tool 7.5
town 7.4
window 7.3
alone 7.3
sword 7.1
life 7

Google
created on 2022-02-11

Building 94.6
Sky 89.1
Plant 82.4
Line 81.7
Travel 81.5
Tints and shades 77.2
Road surface 76
City 75.7
Rectangle 75.1
Road 74.6
Sidewalk 72
Asphalt 70.1
Leisure 69.8
Tree 69.2
Metal 69.1
Street 66.7
Pedestrian 66.2
Recreation 64.5
Town 62.6
T-shirt 61.6

Microsoft
created on 2022-02-11

outdoor 97.2
text 88.9
person 75.9
city 75.6
skyscraper 69.5
street 66.5
waste container 62.5
park 60.7

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 93.2%
Calm 65.6%
Happy 16.4%
Angry 6.6%
Sad 5%
Surprised 2.7%
Confused 1.5%
Disgusted 1.3%
Fear 0.9%

AWS Rekognition

Age 18-26
Gender Female, 51.5%
Calm 69.3%
Happy 10.3%
Sad 6.4%
Confused 6.1%
Fear 2.6%
Surprised 2%
Angry 1.8%
Disgusted 1.6%

AWS Rekognition

Age 9-17
Gender Male, 92.9%
Sad 56.3%
Calm 38.8%
Disgusted 1.1%
Surprised 1.1%
Happy 1%
Fear 0.9%
Angry 0.5%
Confused 0.4%

AWS Rekognition

Age 6-14
Gender Male, 83.8%
Fear 62.4%
Sad 18.3%
Calm 8.7%
Angry 3.4%
Happy 2.4%
Disgusted 2.1%
Surprised 1.3%
Confused 1.3%

AWS Rekognition

Age 28-38
Gender Male, 96.6%
Calm 63.9%
Fear 13%
Sad 11.8%
Happy 5.7%
Surprised 2.3%
Disgusted 2%
Angry 0.8%
Confused 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Shoe 83.9%
Bench 56.8%

Captions

Microsoft

a person sitting on a bench 76.1%
a man and a woman sitting on a bench 59.7%
a person sitting on a bench in the city 59.6%

Text analysis

Amazon

LOUIS
10
ROCK
LOANS
BENEFICIAL
ROCK H
AVE
H
3523 ST LOUIS AVE
10 ى
-
ى
3523 ST
KOOYK
EIRA
KOOYK ROVERARY EIRA
adidas
ROVERARY

Google

BOCK
ST
LOUIS
BENEFICIAL
USARMY
T
3523
TRAVEL
G
U-FO BENEFICIAL LOANS BOCK H T 3523 ST LOUIS AVE TRAVEL USARMY G 10
U-FO
LOANS
H
AVE
10