Human Generated Data

Title

Elbridge Gerry (1744-1814)
Date

c. 1845-1847
People

Artist: Nathaniel Jocelyn, American 1796 - 1881
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Louise E. Bettens Fund, 1943.1816

Human Generated Data

Title

Elbridge Gerry (1744-1814)

People

Artist: Nathaniel Jocelyn, American 1796 - 1881

Date

c. 1845-1847

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Louise E. Bettens Fund, 1943.1816

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 95.9
Person 91.5
Human 91.5
Painting 71.1

Clarifai
created on 2018-03-16

people 99.6
one 99.5
portrait 99.5
adult 97.8
man 97.1
elderly 97
leader 96.9
writer 91.4
politician 91
wear 90.8
administration 89.4
menswear 84.2
neckwear 81
facial expression 80.4
outerwear 78.9
pensive 76.9
bald 76.4
outfit 73.8
side view 73
actor 69.2

Imagga
created on 2018-03-16

executive 73.1
businessman 67.2
man 59.9
suit 57.9
baron 53.6
male 52.6
business 46.3
handsome 45.6
person 41.2
professional 38.8
judge 38
portrait 37
corporate 36.2
confident 35.6
senior 34.8
manager 33.6
men 32.7
tie 32.3
adult 31.8
mature 29.8
people 28.5
elderly 27.8
boss 27.8
office 26.6
old 25.1
looking 24.8
work 22.8
black 22.3
secretary 20.6
job 20.4
success 20.2
businesspeople 20
glasses 19.5
successful 19.3
necktie 19.2
expression 18.8
face 18.5
older 18.5
worker 17.9
smiling 17.4
standing 16.6
occupation 16.5
smile 16.4
happy 16.3
formal 16.3
one 15.7
modern 15.5
leadership 15.4
60s 14.7
businessperson 14.7
hand 14.5
serious 14.3
shirt 14
studio 13.7
hair 13.5
friendly 12.8
gray hair 12.8
lawyer 12.8
leader 12.6
working 12.4
lifestyle 12.3
one person 12.3
human 12
jacket 11.7
corporation 11.6
bow tie 11.4
smart 11.3
casual 11
40s 10.7
cheerful 10.6
confidence 10.6
desk 10.4
grandfather 10.3
company 10.3
clothing 10.2
garment 10.1
alone 10.1
laptop 10
businessmen 9.8
teacher 9.6
computer 9.6
collar 9.6
sitting 9.5
power 9.3
guy 9.2
look 8.8
couple 8.7
hands 8.7
busy 8.7
education 8.7
retirement 8.7
only 8.6
thinking 8.6
career 8.5
gray 8.1
close 8
color 7.8
mid adult 7.7
head 7.6
communication 7.6
cutout 7.4
aged 7.3

Google
created on 2018-03-16

portrait 94.1
gentleman 85.7
elder 73.6
painting 68.7
art 54.3
senior citizen 53.7
stock photography 50.3

Microsoft
created on 2018-03-16

person 99.4
man 99.2
suit 94.4
old 78.5
older 67.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 98.9%
Calm 61.4%
Sad 7%
Confused 11.6%
Happy 9.8%
Disgusted 1.1%
Angry 5.8%
Surprised 3.3%

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 91.5%
Painting 71.1%

Categories

Imagga

people portraits 99.3%
events parties 0.7%

Captions

Microsoft
created on 2018-03-16

a man wearing a suit and tie 98.8%
a man in a suit and tie 98.7%
a man wearing a suit 98.2%