Human Generated Data

Title

Feels Sure: Teamsters Union Vice President James Riddle Hoffa (1913-?1975) (right) seeking election as president during the Organizations Convention, Miami Beach, Florida
Date

1957
People

Artist: United Press, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.35

Human Generated Data

Title

Feels Sure: Teamsters Union Vice President James Riddle Hoffa (1913-?1975) (right) seeking election as president during the Organizations Convention, Miami Beach, Florida

People

Artist: United Press, American 20th century

Date

1957

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Clothing 99.9
Apparel 99.9
Person 99.7
Human 99.7
Person 99.3
Person 97.4
Suit 94
Overcoat 94
Coat 94
Helmet 92.3
Text 90.8
Accessory 87.8
Tie 87.8
Accessories 87.8
Sun Hat 84.3
Hat 82.2
Face 81.7
Hat 79.9
People 66.2
Female 62.8
Girl 57.6
Banner 56.4
Dress 55.1

Clarifai
created on 2018-03-23

people 99.9
administration 98.5
group 98.2
woman 96.8
adult 96.5
several 95.4
group together 95.1
war 93.8
leader 93.5
many 93.1
military 92.7
man 92.2
two 89.4
newspaper 85.4
four 84.7
wear 84.1
three 80.8
vehicle 80.7
five 79.3
police 79.1

Imagga
created on 2018-03-23

people 34
male 30.8
mother 30
man 28.9
happy 25.1
kin 24.8
person 23.5
portrait 23.3
parent 22.5
adult 22.1
together 21.9
senior 21.5
family 20.4
love 19.7
smiling 19.5
newspaper 19.4
couple 19.2
park 18.1
lifestyle 18.1
outdoors 17.9
smile 17.8
world 17.6
mature 16.7
child 16
home 15.9
old 15.3
elderly 15.3
product 15
sitting 14.6
happiness 14.1
pedestrian 13.8
fun 13.5
retirement 13.4
women 13.4
men 12.9
casual 12.7
attractive 12.6
aged 11.8
husband 11.7
retired 11.6
creation 11.6
outdoor 11.5
wife 11.4
face 11.4
father 11.3
pretty 11.2
leisure 10.8
married 10.5
looking 10.4
youth 10.2
day 10.2
two 10.2
teen 10.1
girls 10
daughter 9.6
boy 9.6
togetherness 9.4
outside 9.4
glasses 9.3
teenager 9.1
business 9.1
holding 9.1
fashion 9
group 8.9
reading 8.6
friends 8.5
relationship 8.4
grandma 8.3
cheerful 8.1
lady 8.1
success 8
hair 7.9
caring 7.9
ancient 7.8
dad 7.7
culture 7.7
card 7.6
head 7.6
sibling 7.5
indoor 7.3
handsome 7.1
kid 7.1
job 7.1

Google
created on 2018-03-23

photograph 96
black and white 89.5
photography 83
snapshot 81.8
vintage clothing 79.7
monochrome photography 77.9
human behavior 75.9
monochrome 71
retro style 60
history 53.9
stock photography 52.7

Microsoft
created on 2018-03-23

person 99.6
outdoor 99.4
sign 84.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 99.3%
Angry 0.9%
Happy 95.4%
Surprised 1%
Sad 0.8%
Calm 0.8%
Confused 0.7%
Disgusted 0.4%

AWS Rekognition

Age 35-52
Gender Male, 97.6%
Happy 69%
Sad 9.1%
Surprised 4.1%
Confused 2.6%
Calm 5.2%
Angry 5.4%
Disgusted 4.5%

AWS Rekognition

Age 35-55
Gender Male, 95.2%
Disgusted 1.7%
Sad 11.8%
Confused 1.7%
Angry 2.3%
Surprised 2.5%
Calm 5.6%
Happy 74.4%

AWS Rekognition

Age 35-52
Gender Male, 60.5%
Angry 1.1%
Calm 5.3%
Disgusted 0.6%
Surprised 4.4%
Sad 87.3%
Happy 0.3%
Confused 1%

AWS Rekognition

Age 45-66
Gender Female, 50.2%
Angry 49.6%
Happy 49.9%
Calm 49.6%
Surprised 49.6%
Sad 49.6%
Disgusted 49.7%
Confused 49.6%

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 37
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Suit 94%
Helmet 92.3%
Tie 87.8%
Hat 82.2%

Captions

Microsoft

a man and a woman holding a sign 86.8%
a person holding a sign 86.7%
a person holding a sign 86.6%

Text analysis

Amazon

PRESIDENT
HOFFA
For PRESIDENT
For
HEADQUARTERS
PALLADIUM
PALLADIUM R
HEADQUARTERS EdenRot
R
EdenRot

Google

For
DQUARTERS
Eden
R
For PRESIDENT HEA DQUARTERS, Eden Roc PALLADIUM R
PRESIDENT
HEA
Roc
PALLADIUM
,