Human Generated Data

Title

Untitled (couple at carnival booth)
Date

1952
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7740
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple at carnival booth)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.8
Person 99.8
Person 93.8
Musician 88
Musical Instrument 88
Furniture 83.8
Clothing 80.7
Apparel 80.7
Chair 80.3
Text 78.9
Leisure Activities 77.9
Face 77.6
People 71.9
Performer 68.7
Guitar 68.7
Guitarist 68.7
Person 67.6
Outdoors 65.6
Crowd 63.5
Person 62.9
Female 61
Nature 59.3
Door 58.1
Drum 56.1
Percussion 56.1

Imagga
created on 2022-01-09

shop 35.2
building 27.9
mercantile establishment 24.5
architecture 23.6
old 20.2
city 19.1
sign 18.8
door 18.1
vintage 16.5
wall 16.3
place of business 16.2
house 14.2
stall 13.9
structure 13.8
bakery 13.2
window 13.1
street 12.9
office 12.8
billboard 11.8
business 11.5
barbershop 10.7
retro 10.6
entrance 10.6
texture 10.4
brick 10.4
dirty 9.9
travel 9.9
urban 9.6
home 9.6
antique 9.5
exterior 9.2
signboard 9.2
newspaper 9
light 8.7
glass 8.6
grunge 8.5
black 8.4
pattern 8.2
product 8.2
history 8
wooden 7.9
establishment 7.8
ancient 7.8
new 7.3
aged 7.2
bank 7.2
balcony 7.1
financial 7.1

Google
created on 2022-01-09

Black-and-white 84.8
Font 78.6
Motor vehicle 74.2
Monochrome photography 73.6
Monochrome 72.9
Suit 65.3
Stock photography 64.8
Advertising 59.8
Signage 58.1
Room 55.2
Banner 53.5
Street 52.8
Vintage clothing 51.2
T-shirt 50.3
Photo caption 50

Microsoft
created on 2022-01-09

text 97.7
outdoor 95.9
person 90.6
clothing 83.5
black and white 53.5

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Female, 90.3%
Happy 48.4%
Calm 45.9%
Surprised 1.8%
Confused 1.7%
Sad 1%
Angry 0.6%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 26-36
Gender Male, 82.2%
Happy 87%
Calm 8.4%
Surprised 2.4%
Sad 0.7%
Disgusted 0.4%
Fear 0.4%
Angry 0.4%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a sign on the side of a building 60%
a close up of a sign 59.9%
a sign on a building 52%

Text analysis

Amazon

SADIE'S
ST
FRONT
GIRLESK
BE
E SADIE'S
MUST BE
OVER
E
MUST
12 FRONT ST
18 YRS
619HE
12
PLU

Google

BE
GIRLESK SADIES 12 FRONT ST MUST BE OVER
GIRLESK
SADIES
12
FRONT
OVER
MUST
ST