Human Generated Data

Title

Street scene, Worthington, Ohio
Date

1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3039

Human Generated Data

Title

Street scene, Worthington, Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3039

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.7
Human 99.7
Person 99.6
Person 99.5
Person 99.4
Clothing 97.8
Apparel 97.8
Meal 71.7
Food 71.7
Pants 68.5
People 65.2
Shorts 63
Hat 62.7
Person 61.4
Hardhat 58.2
Helmet 58.2
Overcoat 57.7
Coat 57.7

Clarifai
created on 2023-10-15

people 100
adult 99
man 98.9
group together 98.9
group 98.7
woman 98
four 96.8
monochrome 96.8
street 96.6
three 95.2
several 94.5
recreation 94.2
two 94
veil 92.6
commerce 92.4
wear 91.6
lid 91.1
administration 90.2
child 88.4
police 87

Imagga
created on 2021-12-15

barbershop 100
shop 100
mercantile establishment 95.8
place of business 63.9
establishment 32
old 24.4
door 22.8
wall 22.2
building 21.2
vintage 18.2
window 15.7
retro 15.6
house 15
architecture 14.8
city 14.1
antique 13.8
urban 12.2
ancient 12.1
sign 12
grunge 11.9
aged 11.8
texture 10.4
glass 10.1
entrance 9.7
bakery 9.5
empty 9.4
brick 9.4
travel 9.2
history 8.9
decoration 8.9
brown 8.8
man 8.7
people 8.4
wood 8.3
exterior 8.3
street 8.3
structure 8.2
wooden 7.9
text 7.9
paper 7.8
color 7.8
closed 7.7
blank 7.7
construction 7.7
weathered 7.6
design 7.3
board 7.2
dirty 7.2
home 7.2
male 7.1

Google
created on 2021-12-15

Trousers 96
Hat 90.2
Black 89.6
Standing 86.4
Door 85.4
Black-and-white 84.2
Style 83.8
Font 83.1
Monochrome photography 75.3
Vintage clothing 74.3
Monochrome 74.2
Musical instrument 71.9
Event 67.6
Room 65.9
Window 65
Sun hat 64
History 61.9
Street 61.1
Advertising 60.8
Luggage and bags 60.7

Microsoft
created on 2021-12-15

text 100
clothing 98.2
outdoor 97.8
person 92.7
man 90
standing 78.3
people 77.4
group 60.2
store 40.6
shop 11.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-56
Gender Male, 97.4%
Angry 72%
Calm 18.8%
Happy 3.8%
Surprised 1.4%
Disgusted 1.3%
Sad 1.2%
Confused 0.9%
Fear 0.7%

AWS Rekognition

Age 47-65
Gender Male, 69.8%
Happy 97.6%
Calm 1.7%
Surprised 0.4%
Sad 0.1%
Fear 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 38-56
Gender Male, 91.8%
Calm 85.5%
Happy 7.1%
Sad 4.8%
Confused 1.5%
Angry 0.5%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 23-35
Gender Male, 98.9%
Calm 65.4%
Angry 22.6%
Sad 6.5%
Happy 2.7%
Fear 2.7%
Surprised 0.1%
Confused 0%
Disgusted 0%

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

streetview architecture 65.1%
paintings art 30.9%
people portraits 1.9%

Text analysis

Amazon

POULTRY
HOME
EGGS
BROS.
MEATS
AND
CHAPIN
DRESSED
TO
M
PO
C

Google

HOME
POULTRY
TO
AND
MEATS
CHAPIN
EGGS
BROS.
HOME POULTRY PO TO DRESSED AND MEATS CHAPIN EGGS BROS.
PO
DRESSED