Human Generated Data

Title

Untitled (Main Street, Lancaster, Ohio)

Date

August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3613

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Main Street, Lancaster, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.9
Human 99.9
Person 99.7
Person 99.7
Person 99.4
Shoe 98.8
Footwear 98.8
Apparel 98.8
Clothing 98.8
Person 98.8
Person 97.6
Shoe 94.1
Text 87.8
Crowd 86
Parade 69.3
Shop 64.5
Word 56.2

Imagga
created on 2021-12-15

man 27.5
people 22.9
person 20.9
stick 19.6
photographer 19.5
male 19.1
adult 18.2
business 17.6
men 16.3
sport 14.7
hockey stick 14.6
black 14.5
sports equipment 13.7
walking 13.3
businessman 13.2
silhouette 13.2
old 13.2
weapon 12.4
astronaut 12.4
walk 12.4
group 12.1
travel 12
life 11.8
activity 11.6
city 11.6
success 11.3
active 10.8
human 10.5
urban 10.5
women 10.3
sword 10.2
clothing 9.9
outdoor 9.9
equipment 9.9
fashion 9.8
crowd 9.6
motion 9.4
dark 9.2
portrait 9.1
job 8.8
work 8.6
move 8.6
corporate 8.6
brass 8.3
street 8.3
occupation 8.2
protection 8.2
danger 8.2
suit 8.1
lifestyle 7.9
winter 7.7
world 7.6
power 7.6
sign 7.5
fun 7.5
leisure 7.5
manager 7.4
professional 7.4
back 7.3
speed 7.3
successful 7.3
looking 7.2
posing 7.1
happiness 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 100
clothing 97.7
person 97.3
skiing 96.1
man 94.2
outdoor 94.1
snow 93
poster 88.7
newspaper 85.4
posing 73.2
sign 72.8
handwriting 70.7
group 56.8
slope 30.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 99.2%
Calm 74.7%
Confused 11.2%
Sad 4.9%
Happy 3.7%
Angry 2%
Surprised 1.5%
Disgusted 1.2%
Fear 0.6%

AWS Rekognition

Age 28-44
Gender Male, 99.2%
Calm 74.5%
Angry 14.2%
Fear 3.6%
Sad 3.1%
Confused 1.6%
Happy 1.3%
Surprised 1%
Disgusted 0.8%

AWS Rekognition

Age 30-46
Gender Male, 99.8%
Angry 60%
Disgusted 20.8%
Confused 5.4%
Fear 5.3%
Calm 5%
Sad 1.6%
Happy 1.1%
Surprised 0.9%

AWS Rekognition

Age 13-25
Gender Male, 68.9%
Happy 92.6%
Surprised 3.4%
Fear 1.5%
Calm 0.9%
Angry 0.9%
Sad 0.3%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 26-40
Gender Male, 92.4%
Fear 41%
Angry 27.5%
Calm 11.8%
Sad 8.7%
Happy 6%
Confused 3.2%
Surprised 1.2%
Disgusted 0.6%

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Shoe 98.8%

Captions

Microsoft

a group of people standing around a sign posing for the camera 88.3%
a group of people standing in the snow 85.8%
a group of people posing for the camera 85.7%

Text analysis

Amazon

CITIZEN
MAGAZINES
forget
FORM
DAILY RACING FORM
NEWSPAPERS
DAILY
RACING
Don't forget your
B4
OHIO
your
Don't
BARBER
The
SHOP
RELIEF
GO
KILL
Citizen
PLAN.
HINE
Coca-Cola
ASSURED
HNA591 B4
KILL OHIO RELIEF PLAN. GO HU
IG FORM
-CANDY
HNA591
The Columbes Citizen
KILL OHIO RELIEF PLAY
IG
3.
K
CASTE ASSURED
DOWNSTAIR
HOM
The Otive
Columbes
Eas
S-OGARETTES -CANDY -SOFT DR
HU
PLAY
CASTE
Lapraster Eas
-SOFT DR
Lapraster
S-OGARETTES
Otive
Day

Google

NEWSPAPERS
SHOP
CADY-SOTR
Turt
CITIZEN
Columbos
forget
your
IG
Later
Ea
OHIO
PLAN
NEWSPAPERS Coca-ColaMAGAZINES BARBER SHOP DOWNSTAIR s OGLETTES CADY-SOTR DAILY RACING FORM Americas Turt Ruthority Dont forget your CITIZEN The Columbos Citizen IG FORM KILL OHIO RELIEF PLAN. GO Later Ea CASTER ASSIBE TETRIR The Columbs Oi KILL OHIO RELIEE PLAN 15" 16 HNAS9I B4
Coca-ColaMAGAZINES
BARBER
DAILY
FORM
Citizen
RELIEF
GO
15"
16
HNAS9I
DOWNSTAIR
OGLETTES
Americas
Dont
KILL
PLAN.
CASTER
ASSIBE
TETRIR
The
Oi
B4
s
RACING
Ruthority
Columbs
RELIEE