Human Generated Data

Title

Franklin Delano Roosevelt (1882-1945)
Date

1935
People

Artist: Henry Salem Hubbell, American 1870 - 1949
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Willard Hubbell, 1967.74

Human Generated Data

Title

Franklin Delano Roosevelt (1882-1945)

People

Artist: Henry Salem Hubbell, American 1870 - 1949

Date

1935

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.5
Person 99.5
Furniture 98.3
Table 94.6
Desk 88.4
Accessories 85.8
Tie 85.8
Accessory 85.8
Sitting 83.7
Indoors 72.7
Painting 69.4
Art 69.4
Room 65
Wood 60.3
Court 59.8
Clothing 58.9
Coat 58.9
Apparel 58.9
Overcoat 58.9
Photo 57.8
Face 57.8
Portrait 57.8
Photography 57.8
Worker 57.8
Suit 56.4
Plywood 55.6

Clarifai
created on 2018-03-16

people 99.7
adult 99.6
leader 98.6
administration 98.5
furniture 98.5
one 98.4
portrait 98.1
room 98.1
man 97.1
facial expression 94.9
chair 94.9
home 94.3
two 94.2
wear 93.8
election 89.3
business 89.3
indoors 87.4
employee 86.8
elderly 85.8
politician 85.2

Imagga
created on 2018-03-16

man 51.1
office 45.2
male 44
businessman 39.8
executive 39.7
business 37.7
director 34.8
sitting 31.8
laptop 31.4
person 30.3
professional 28.4
smiling 28.2
suit 27.3
happy 27
computer 26.6
meeting 26.4
secretary 25.9
people 25.7
working 24.8
businesswoman 24.6
adult 24.5
judge 24.4
work 24.3
table 24.3
team 22.4
desk 21.7
manager 21.4
indoors 21.1
corporate 19.8
senior 19.7
couple 19.2
talking 19
looking 18.4
businesspeople 18
colleagues 17.5
workplace 17.2
together 16.7
discussion 16.6
smile 16.4
home 16
teamwork 15.8
confident 15.5
group 15.3
communication 15.1
successful 14.7
men 14.6
handsome 14.3
tie 14.2
archive 14.2
mature 14
room 13.6
technology 13.4
cheerful 13
teacher 12.8
corporation 12.5
coworkers 11.8
notebook 11.7
scholar 11.2
women 11.1
two 11
happiness 11
horizontal 10.9
classroom 10.9
lifestyle 10.8
30s 10.6
student 10.5
glasses 10.2
worker 10
discussing 9.8
businessmen 9.8
job 9.7
portrait 9.7
mid adult 9.7
boss 9.6
paper 9.4
relaxed 9.4
coffee 9.3
black 9
intellectual 9
conference 8.8
leader 8.7
education 8.7
retirement 8.6
reading 8.6
indoor 8.2
40s 7.8
modern 7.7
partnership 7.7
notes 7.7
staff 7.7
thinking 7.6
chair 7.6
adults 7.6
one person 7.5
smart 7.5
contemporary 7.5
keyboard 7.5
lawyer 7.4
holding 7.4
generator 7.4
camera 7.4
20s 7.3
friendly 7.3
to 7.1

Google
created on 2018-03-16

portrait 87.7
painting 81.9
gentleman 76.9
diplomat 70
professional 61.3
official 59.5
art 53.3

Microsoft
created on 2018-03-16

person 98.2
indoor 96.2
man 95.7
desk 9.9
dining table 6.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-69
Gender Male, 97.2%
Disgusted 5.7%
Calm 51.6%
Confused 5.6%
Surprised 5.5%
Sad 8.7%
Happy 7.4%
Angry 15.7%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 85.8%
Painting 69.4%

Captions

Microsoft

Franklin D. Roosevelt standing in front of a table 89.9%
Franklin D. Roosevelt standing on a table 88.9%
Franklin D. Roosevelt standing on top of a table 87.3%

Text analysis

Amazon

11--11ub11