Human Generated Data

Title

[James Riddle] Hoffa (1913-?1975) Leads His Army with Banners
Date

1957
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.39

Human Generated Data

Title

[James Riddle] Hoffa (1913-?1975) Leads His Army with Banners

People

Artist: Unidentified Artist,

Date

1957

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.39

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Parade 99.9
Protest 99.9
Human 99.8
Person 99.8
Person 99.7
Crowd 99.1
Person 98.7
Person 96.4
Person 96.2
Person 95.4
Clothing 91.7
Apparel 91.7
Shoe 91.7
Footwear 91.7
Person 87.6
Text 86.5
Person 85.8
Word 85.1
Person 83.8
Person 82.1
Pedestrian 81.3
Person 77.1
Shoe 72.8
People 72.3
Person 67.7
Attorney 58.5
Banner 57.3
Shoe 55.9
Shoe 53.2
Shoe 52.7

Clarifai
created on 2018-03-23

people 99.5
group 97.9
many 97.7
leader 96.3
group together 93.3
administration 92.4
crowd 92.2
adult 91.8
war 91.1
education 89.6
offense 87.1
police 86.9
rally 85
military 84.8
school 82.8
man 82.1
street 79.6
woman 75.2
vehicle 71.7
teacher 70

Google
created on 2018-03-23

black and white 90.7
demonstration 89.7
crowd 85.2
monochrome photography 77.2
street 74.5
car 71.1
vehicle 71
monochrome 69.9
protest 60.6
advertising 53.9

Microsoft
created on 2018-03-23

road 99.1
outdoor 98.2
sign 96.5
person 93.1
text 88.7
group 66.6
people 62.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-55
Gender Female, 50.5%
Confused 45.7%
Disgusted 45.7%
Surprised 46.2%
Sad 49.9%
Angry 46.7%
Happy 45.7%
Calm 45.1%

AWS Rekognition

Age 35-52
Gender Male, 55%
Angry 47.2%
Calm 45.4%
Confused 45.1%
Happy 51%
Disgusted 45.4%
Surprised 45.3%
Sad 45.6%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Happy 45.3%
Sad 45.5%
Surprised 45.5%
Confused 45.2%
Calm 52.2%
Angry 45.5%
Disgusted 45.8%

AWS Rekognition

Age 60-90
Gender Male, 54.7%
Confused 45.5%
Disgusted 45.7%
Calm 45.3%
Happy 45.1%
Surprised 45.4%
Sad 45.8%
Angry 52.2%

AWS Rekognition

Age 38-57
Gender Male, 55%
Confused 45.5%
Disgusted 45.3%
Calm 46.7%
Happy 50.3%
Surprised 45.2%
Sad 46.5%
Angry 45.6%

AWS Rekognition

Age 38-57
Gender Male, 55%
Surprised 45.4%
Happy 49.7%
Sad 45.3%
Calm 48%
Angry 45.4%
Disgusted 46%
Confused 45.2%

AWS Rekognition

Age 38-57
Gender Male, 54.9%
Confused 45.2%
Sad 45.4%
Calm 48.4%
Disgusted 45.1%
Surprised 45.4%
Angry 47.8%
Happy 47.7%

AWS Rekognition

Age 48-68
Gender Male, 54.7%
Happy 52%
Confused 45.1%
Calm 47.6%
Disgusted 45.1%
Sad 45.1%
Angry 45.1%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Angry 45.6%
Confused 45.1%
Calm 53.8%
Disgusted 45%
Surprised 45.1%
Happy 45.1%
Sad 45.2%

AWS Rekognition

Age 27-44
Gender Male, 54.7%
Angry 45.9%
Disgusted 45.6%
Happy 45.1%
Calm 52.5%
Surprised 45.1%
Sad 45.3%
Confused 45.4%

AWS Rekognition

Age 57-77
Gender Female, 53.4%
Calm 48.5%
Disgusted 45.5%
Sad 47.9%
Surprised 45.7%
Angry 46.1%
Happy 45.4%
Confused 45.9%

AWS Rekognition

Age 48-68
Gender Female, 51.3%
Sad 49.5%
Happy 47.4%
Angry 46.1%
Calm 45.4%
Surprised 45.6%
Confused 45.6%
Disgusted 45.5%

AWS Rekognition

Age 38-57
Gender Male, 50.5%
Happy 49.7%
Surprised 49.5%
Angry 49.6%
Disgusted 49.5%
Confused 49.6%
Calm 50%
Sad 49.6%

AWS Rekognition

Age 9-14
Gender Male, 52.6%
Disgusted 45.4%
Sad 46.3%
Angry 47.2%
Surprised 47%
Calm 46.8%
Confused 46.8%
Happy 45.5%

AWS Rekognition

Age 35-52
Gender Female, 51.1%
Angry 45.9%
Calm 48.2%
Confused 45.9%
Surprised 45.5%
Disgusted 45.3%
Happy 46.9%
Sad 47.2%

AWS Rekognition

Age 38-59
Gender Male, 54.5%
Sad 47.4%
Calm 49%
Happy 45.5%
Confused 45.5%
Disgusted 45.6%
Angry 46.6%
Surprised 45.4%

AWS Rekognition

Age 35-52
Gender Female, 53.5%
Happy 45.4%
Confused 45.3%
Sad 48.9%
Angry 45.9%
Calm 48.7%
Disgusted 45.2%
Surprised 45.5%

AWS Rekognition

Age 10-15
Gender Female, 53.8%
Sad 54.7%
Confused 45.1%
Surprised 45%
Angry 45%
Calm 45.1%
Happy 45%
Disgusted 45%

AWS Rekognition

Age 45-66
Gender Female, 50.2%
Happy 49.5%
Sad 50.4%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Disgusted 45.5%
Confused 45.4%
Angry 46.7%
Sad 48.7%
Calm 47.9%
Happy 45.5%
Surprised 45.4%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Disgusted 45.1%
Sad 45.1%
Angry 45.1%
Surprised 45.1%
Calm 47.1%
Confused 45.1%
Happy 52.5%

AWS Rekognition

Age 38-57
Gender Male, 54.7%
Angry 45.5%
Confused 45.5%
Surprised 45.5%
Happy 46.8%
Disgusted 45.1%
Calm 50.6%
Sad 45.9%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 55
Gender Female

Microsoft Cognitive Services

Age 76
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 91.7%

Categories

Imagga

cars vehicles 99.6%
streetview architecture 0.3%
beaches seaside 0.1%

Text analysis

Amazon

HOF
HOFFA
OFFA
DELECATES
IN
IN with.. HOF
596
FOR PRESIDENT
ROLL
89
HOFF
WERE
with..
THE
MAN
FOR
CAL THE 596 MAN HOFFA ROLL WITH HOFE FOR PRESIDENT
PRESID.
HOFE
FA
KENT
407
OFFA 100 HOFFA
PRES
107
WERE FOR HOFFA HOFFA WITH HOFFA PRESID. LEONCAR DELECATES IOO COCAL' 107
HOFF HOFFA DELECATES LOCA 407 .TA HOFTA
COCAL'
HOFTA
PRES IDENV HOFFA KENT OURY Local DELECATES 89 HOFFA
WITH
IDENV
CAL
Local
.TA
LOCA
COCAl 107
IOO
100
COCAl
LEONCAR
OURY

Google

THE MAN AL 596 ORPRESIDENT DELECATES HOFFA OLL WITH N WITH OCAL 107 C户 WERE FOR HOFF DELECATES oll HOFFA RPRESIDEN DELECATES LOCA 407SS KENTUCKY FA Su PRESIDEN with.
THE
MAN
AL
596
ORPRESIDENT
DELECATES
HOFFA
OLL
WITH
N
OCAL
107
C
户
WERE
FOR
HOFF
oll
RPRESIDEN
LOCA
407SS
KENTUCKY
FA
Su
PRESIDEN
with.