Human Generated Data

Title

[James Riddle] Hoffa (1913-?1975) Makes a Few Mental Notes
Date

1957
People

Artist: Joe Migon, American? 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.41

Human Generated Data

Title

[James Riddle] Hoffa (1913-?1975) Makes a Few Mental Notes

People

Artist: Joe Migon, American? 20th century

Date

1957

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.41

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Collage 99.6
Poster 99.6
Advertisement 99.6
Human 99.5
Person 99.5
Accessories 99.1
Tie 99.1
Accessory 99.1
Person 97.6
Face 97.2
Person 95.4
Person 95.1
Clothing 92.7
Overcoat 92.7
Apparel 92.7
Suit 92.7
Coat 92.7
Tie 92.4
Tie 92.1
Suit 91.7
Suit 90.9
Head 72.2
Text 65.1
Photo Booth 63.6
Man 61.2
Photography 61
Photo 61
Portrait 61
People 58.2
Performer 58.1
Person 45.3

Clarifai
created on 2018-03-23

people 100
adult 99.2
group 98.8
administration 98.7
three 98.5
man 98
two 97.3
four 96.9
group together 95.9
leader 95.7
portrait 94.8
several 93
outfit 90.7
facial expression 90.2
sit 89.8
actor 89.6
actress 87.9
five 87.6
war 84
wear 82.3

Imagga
created on 2018-03-23

man 53.1
businessman 53
business 48
suit 46
bow tie 43.4
male 43.3
office 41
corporate 40.4
necktie 37.4
executive 37.1
people 32.9
professional 32.8
men 30.9
person 30.8
portrait 28.5
meeting 27.3
handsome 25.8
businesspeople 24.7
happy 24.4
team 24.2
confident 23.7
businesswoman 23.6
adult 22.7
communication 22.7
businessmen 22.4
teamwork 22.2
work 22
tie 21.8
garment 21.6
group 21
success 20.9
smile 19.2
partnership 19.2
successful 18.3
colleagues 17.5
building 17.4
face 16.3
formal 16.2
jacket 16
smiling 15.9
corporation 15.4
looking 15.2
modern 14.7
partner 14.5
job 14.2
company 13.9
mature 13.9
old 13.9
expression 13.6
busy 13.5
clothing 13.4
working 13.3
senior 13.1
secretary 13.1
standing 13
partners 12.6
workplace 12.4
talking 12.4
career 12.3
star 12.3
look 12.3
manager 12.1
computer 12
actor 11.8
diversity 11.5
worker 10.7
businessperson 10.7
workers 10.7
together 10.5
shirt 10.3
glasses 10.2
phone 10.1
lifestyle 10.1
occupation 10.1
guy 9.9
hand 9.9
discussing 9.8
attractive 9.8
staff 9.7
employee 9.7
desk 9.4
paper 9.4
indoor 9.1
cheerful 8.9
coworkers 8.8
males 8.8
women 8.7
performer 8.7
leadership 8.6
happiness 8.6
elegant 8.6
smart 8.5
finance 8.4
black 8.4
human 8.2
friendly 8.2
one 8.2
indoors 7.9
determination 7.8
discussion 7.8
sitting 7.7
call 7.7
talk 7.7
confidence 7.7
boss 7.7
serious 7.6
head 7.6
mobile 7.5
holding 7.4
laptop 7.3

Google
created on 2018-03-23

photograph 96.2
man 93.4
black and white 91.8
gentleman 86.3
suit 86
monochrome photography 84.2
photography 81.6
male 81.3
vintage clothing 71.5
monochrome 66.8
portrait 60.5
professional 56.2
formal wear 56.2
conversation 50.1

Microsoft
created on 2018-03-23

person 100
people 97.6
suit 93.7
text 93.4
group 90.6
posing 62.1
old 60.1
same 18

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Male, 97.5%
Confused 0.5%
Calm 0.1%
Surprised 0.3%
Happy 97.5%
Sad 0.5%
Disgusted 0.7%
Angry 0.4%

AWS Rekognition

Age 35-53
Gender Male, 93%
Calm 6.5%
Surprised 1%
Sad 3.3%
Confused 1.3%
Angry 15%
Happy 0.4%
Disgusted 72.5%

AWS Rekognition

Age 35-52
Gender Male, 99.8%
Angry 4.4%
Happy 0.5%
Calm 1.3%
Disgusted 2.2%
Sad 10%
Confused 80.1%
Surprised 1.5%

AWS Rekognition

Age 35-52
Gender Male, 93%
Confused 10%
Happy 1.5%
Disgusted 2.4%
Angry 5.3%
Surprised 2%
Sad 25.6%
Calm 53.2%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 99.1%
Suit 92.7%

Categories

Imagga

people portraits 85.3%
paintings art 14.6%
pets animals 0.1%