Human Generated Data

Title

Amite City, Louisiana

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3103

Human Generated Data

Title

Amite City, Louisiana

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3103

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.6
Person 99.6
Tie 99.1
Accessories 99.1
Accessory 99.1
Apparel 98.4
Suit 98.4
Clothing 98.4
Coat 98.4
Overcoat 98.4
Person 90.7
Blackboard 83.5
Crowd 60.7

Clarifai
created on 2023-10-15

people 99.8
adult 96.5
group 96.1
administration 96.1
man 94.7
group together 93.9
war 93.3
monochrome 92.4
leader 90.6
portrait 87.5
school 84
woman 83.9
newspaper 80.7
education 79.4
teacher 78.6
street 78.2
one 77.4
three 76.3
four 73.8
many 73.7

Imagga
created on 2021-12-15

blackboard 57.7
man 29.6
male 26.3
businessman 23
education 20.8
person 20.7
business 20.6
people 20.6
student 19.5
sign 17.3
teacher 16.5
world 16.4
school 16.3
board 15.3
office 14.1
chalkboard 13.7
billboard 13.5
class 13.5
chart 13.4
black 13.3
classroom 13.2
writing 13.2
men 12.9
success 12.9
human 12.7
teaching 12.7
adult 12.6
financial 12.5
portrait 12.3
hand 12.1
old 11.8
diagram 11.5
happy 11.3
looking 11.2
modern 10.5
shop 10.5
signboard 10.3
drawing 10.3
work 10.2
finance 10.1
professional 9.9
barbershop 9.8
chalk 9.7
technology 9.6
text 9.6
structure 9.6
grunge 9.4
study 9.3
message 9.1
vintage 9.1
group 8.9
teach 8.8
standing 8.7
suit 8.3
letter 8.2
building 8.2
child 8
boy 7.8
lesson 7.8
corporate 7.7
wall 7.7
graph 7.7
money 7.7
marketing 7.6
college 7.6
learn 7.6
meeting 7.5
smart 7.5
write 7.5
senior 7.5
stock 7.5
manager 7.4
holding 7.4
symbol 7.4
back 7.3
occupation 7.3
design 7.3
graphic 7.3
new 7.3
smiling 7.2
smile 7.1
market 7.1
job 7.1
mercantile establishment 7
university 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 100
clothing 94.6
person 92.9
standing 90.2
man 89.5
handwriting 86.3
poster 76.3
black and white 75.9
posing 49.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-52
Gender Male, 99%
Calm 97.7%
Happy 1.3%
Confused 0.4%
Sad 0.3%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 23-35
Gender Male, 95.4%
Calm 92.6%
Angry 3.3%
Happy 2.5%
Sad 0.7%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 26-42
Gender Male, 97.9%
Calm 95.5%
Surprised 1%
Sad 0.9%
Angry 0.8%
Fear 0.7%
Confused 0.6%
Happy 0.3%
Disgusted 0.2%

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 99.1%
Suit 98.4%

Categories

Text analysis

Amazon

PERS
FLOUR
STORES
RICE
24
DS
PLATE
28
ELIANCE
Jewel
t
SUGAR
EAL
HE
51
5LBS
Swift
CHEESE-
MEAT DS PLATE
DO
RELIANCE
SiZE
-
LBS
BRAND
PRUNES FLOUR
5LBS 24'z 5LAS 24
EYE
RECiAL'S SUGAR RICE
RCK EYE
70 $0 SiZE
MEAT
RCK
BETTER
WEINERS
24USS
LARD
PRUNES
A
5LAS
24'z
the -
70 $0
24USS 87
RESING
M - -
INEA
6218
Sm.SANSIGE
Sm.SANSIGE WEINERS 13
87
x
EQ-GO!
You RESING
GeLB
and x
18L€LB
RECiAL'S
M
the
and
EQ-GO! 2019
13
COUNTRY RoLL
You
swith
2019

Google

CnbUGAR
81
LBS
www
RELIANGE
70s0
Size
CK
AF
TIERTR
Sm.SruSIGE
B
COUNTRY
AHEAFO-GOARD
Jewer
RAND
u
NG
FLOUR
STORES CnbUGAR RICE 524 5 24 PRUVES FLOURE 24s 81 LBS www RELIANGE 70s0 Size LBS CK AF TIERTR CHEESE-"T PLATE PERS Sm.SruSIGE 182 B WEKERS COUNTRY ROLL AHEAFO-GOARD ELIANCE Jewer RAND u NG FLOUR EAL
STORES
RICE
524
5
24
PRUVES
FLOURE
24s
CHEESE-"T
PLATE
PERS
182
WEKERS
ROLL
ELIANCE
EAL