Human Generated Data

Title

Untitled (men with one policeman in front of building)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14770

Human Generated Data

Title

Untitled (men with one policeman in front of building)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.1
Person 99.1
Person 98.5
Person 98.5
Person 98.4
Clothing 93.6
Apparel 93.6
Home Decor 80.4
Door 71
Coat 61.6
Overcoat 61.6
Wall 59.7

Imagga
created on 2022-01-29

building 36.6
architecture 32.8
office 29.2
room 29.1
classroom 26.3
wall 25.7
shop 24.2
door 23
city 21.6
old 20.9
structure 19.5
barbershop 18.4
mercantile establishment 17.8
window 17.2
construction 15.4
brick 15.2
house 15
urban 14.9
business 14
ancient 13.8
screen 13.2
modern 12.6
tourism 12.4
travel 12
grunge 11.9
place of business 11.8
stone 11.8
dirty 11.7
design 11.3
texture 11.1
exterior 11.1
historic 11
entrance 10.6
buildings 10.4
vintage 9.9
interior 9.7
glass 9.3
finance 9.3
wood 9.2
library 9.1
aged 9
retro 9
rust 8.7
art 8.6
prison 8.4
town 8.3
frame 8.3
history 8
detail 8
home 8
indoors 7.9
textured 7.9
color 7.8
corporate 7.7
castle 7.7
grungy 7.6
establishment 7.4
metal 7.2
decoration 7.2
black 7.2
facade 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

black and white 98.3
clothing 97.2
person 95.3
outdoor 94.2
street 92.7
monochrome 89.1
man 85.8
footwear 83.3
text 80.2
jacket 70.8
jeans 65.7

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Female, 98.6%
Fear 22%
Calm 21.6%
Sad 20.2%
Surprised 14.5%
Disgusted 9.9%
Happy 7.6%
Angry 3.1%
Confused 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a person standing in front of a building 90.6%
a group of people standing in front of a building 90.2%
a man and a woman standing in front of a building 80.2%

Text analysis

Amazon

MJI7
EIT
ao
MJI7 "YT37A2
ao K.
"YT37A2
K.

Google

K
K oe V E EIdo ETTW EEIA ETT
oe
EIdo
V
E
ETTW
EEIA
ETT