Human Generated Data

Title

Amite City, Louisiana

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3103

Human Generated Data

Title

Amite City, Louisiana

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.6
Person 99.6
Tie 99.1
Accessory 99.1
Accessories 99.1
Coat 98.4
Overcoat 98.4
Clothing 98.4
Suit 98.4
Apparel 98.4
Person 90.7
Blackboard 83.5
Crowd 60.7

Imagga
created on 2021-12-15

blackboard 57.7
man 29.6
male 26.3
businessman 23
education 20.8
person 20.7
business 20.6
people 20.6
student 19.5
sign 17.3
teacher 16.5
world 16.4
school 16.3
board 15.3
office 14.1
chalkboard 13.7
billboard 13.5
class 13.5
chart 13.4
black 13.3
classroom 13.2
writing 13.2
men 12.9
success 12.9
human 12.7
teaching 12.7
adult 12.6
financial 12.5
portrait 12.3
hand 12.1
old 11.8
diagram 11.5
happy 11.3
looking 11.2
modern 10.5
shop 10.5
signboard 10.3
drawing 10.3
work 10.2
finance 10.1
professional 9.9
barbershop 9.8
chalk 9.7
technology 9.6
text 9.6
structure 9.6
grunge 9.4
study 9.3
message 9.1
vintage 9.1
group 8.9
teach 8.8
standing 8.7
suit 8.3
letter 8.2
building 8.2
child 8
boy 7.8
lesson 7.8
corporate 7.7
wall 7.7
graph 7.7
money 7.7
marketing 7.6
college 7.6
learn 7.6
meeting 7.5
smart 7.5
write 7.5
senior 7.5
stock 7.5
manager 7.4
holding 7.4
symbol 7.4
back 7.3
occupation 7.3
design 7.3
graphic 7.3
new 7.3
smiling 7.2
smile 7.1
market 7.1
job 7.1
mercantile establishment 7
university 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 100
clothing 94.6
person 92.9
standing 90.2
man 89.5
handwriting 86.3
poster 76.3
black and white 75.9
posing 49.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-52
Gender Male, 99%
Calm 97.7%
Happy 1.3%
Confused 0.4%
Sad 0.3%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 23-35
Gender Male, 95.4%
Calm 92.6%
Angry 3.3%
Happy 2.5%
Sad 0.7%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 26-42
Gender Male, 97.9%
Calm 95.5%
Surprised 1%
Sad 0.9%
Angry 0.8%
Fear 0.7%
Confused 0.6%
Happy 0.3%
Disgusted 0.2%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 99.1%
Suit 98.4%

Captions

Microsoft

Louis de Wohl et al. standing in front of a store 81%
Louis de Wohl et al. standing in front of a store 69.3%
Louis de Wohl et al. standing in front of a newspaper 66.2%

Text analysis

Amazon

PERS
FLOUR
STORES
RICE
24
DS
PLATE
28
ELIANCE
Jewel
t
SUGAR
EAL
HE
51
5LBS
Swift
CHEESE-
MEAT DS PLATE
DO
RELIANCE
SiZE
-
LBS
BRAND
PRUNES FLOUR
5LBS 24'z 5LAS 24
EYE
RECiAL'S SUGAR RICE
RCK EYE
70 $0 SiZE
MEAT
RCK
BETTER
WEINERS
24USS
LARD
PRUNES
A
5LAS
24'z
the -
70 $0
24USS 87
RESING
M - -
INEA
6218
Sm.SANSIGE
Sm.SANSIGE WEINERS 13
87
x
EQ-GO!
You RESING
GeLB
and x
18L€LB
RECiAL'S
M
the
and
EQ-GO! 2019
13
COUNTRY RoLL
You
swith
2019

Google

STORES CnbUGAR RICE 524 5 24 PRUVES FLOURE 24s 81 LBS www RELIANGE 70s0 Size LBS CK AF TIERTR CHEESE-"T PLATE PERS Sm.SruSIGE 182 B WEKERS COUNTRY ROLL AHEAFO-GOARD ELIANCE Jewer RAND u NG FLOUR EAL
81
www
RELIANGE
Size
CK
PERS
ELIANCE
u
FLOUR
CnbUGAR
PRUVES
LBS
TIERTR
AHEAFO-GOARD
NG
RICE
5
24
FLOURE
PLATE
ROLL
Jewer
STORES
524
24s
AF
CHEESE-"T
182
B
WEKERS
COUNTRY
EAL
70s0
Sm.SruSIGE
RAND