Human Generated Data

Title

Street scene, Worthington, Ohio
Date

1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3039

Human Generated Data

Title

Street scene, Worthington, Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.7
Person 99.7
Person 99.6
Person 99.5
Person 99.4
Apparel 97.8
Clothing 97.8
Food 71.7
Meal 71.7
Pants 68.5
People 65.2
Shorts 63
Hat 62.7
Person 61.4
Hardhat 58.2
Helmet 58.2
Overcoat 57.7
Coat 57.7

Imagga
created on 2021-12-15

barbershop 100
shop 100
mercantile establishment 95.8
place of business 63.9
establishment 32
old 24.4
door 22.8
wall 22.2
building 21.2
vintage 18.2
window 15.7
retro 15.6
house 15
architecture 14.8
city 14.1
antique 13.8
urban 12.2
ancient 12.1
sign 12
grunge 11.9
aged 11.8
texture 10.4
glass 10.1
entrance 9.7
bakery 9.5
empty 9.4
brick 9.4
travel 9.2
history 8.9
decoration 8.9
brown 8.8
man 8.7
people 8.4
wood 8.3
exterior 8.3
street 8.3
structure 8.2
wooden 7.9
text 7.9
paper 7.8
color 7.8
closed 7.7
blank 7.7
construction 7.7
weathered 7.6
design 7.3
board 7.2
dirty 7.2
home 7.2
male 7.1

Google
created on 2021-12-15

Trousers 96
Hat 90.2
Black 89.6
Standing 86.4
Door 85.4
Black-and-white 84.2
Style 83.8
Font 83.1
Monochrome photography 75.3
Vintage clothing 74.3
Monochrome 74.2
Musical instrument 71.9
Event 67.6
Room 65.9
Window 65
Sun hat 64
History 61.9
Street 61.1
Advertising 60.8
Luggage and bags 60.7

Microsoft
created on 2021-12-15

text 100
clothing 98.2
outdoor 97.8
person 92.7
man 90
standing 78.3
people 77.4
group 60.2
store 40.6
shop 11.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-56
Gender Male, 97.4%
Angry 72%
Calm 18.8%
Happy 3.8%
Surprised 1.4%
Disgusted 1.3%
Sad 1.2%
Confused 0.9%
Fear 0.7%

AWS Rekognition

Age 47-65
Gender Male, 69.8%
Happy 97.6%
Calm 1.7%
Surprised 0.4%
Sad 0.1%
Fear 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 38-56
Gender Male, 91.8%
Calm 85.5%
Happy 7.1%
Sad 4.8%
Confused 1.5%
Angry 0.5%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 23-35
Gender Male, 98.9%
Calm 65.4%
Angry 22.6%
Sad 6.5%
Happy 2.7%
Fear 2.7%
Surprised 0.1%
Confused 0%
Disgusted 0%

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people standing in front of a store 96.1%
a group of people that are standing in front of a store 92.2%
a group of people standing in a store 92.1%

Text analysis

Amazon

POULTRY
HOME
EGGS
BROS.
MEATS
AND
CHAPIN
DRESSED
TO
M
PO
C

Google

HOME
PO
TO
MEATS
CHAPIN
BROS.
HOME POULTRY PO TO DRESSED AND MEATS CHAPIN EGGS BROS.
DRESSED
EGGS
POULTRY
AND