Human Generated Data

Title

Captain Thomas Daggett (c. 1683-1730)
Date

c. 1720-1730
People

Artist: Unidentified Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Francis Rogers, 1958.178

Human Generated Data

Title

Captain Thomas Daggett (c. 1683-1730)

People

Artist: Unidentified Artist,

Date

c. 1720-1730

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 97.3
Human 90.5
Person 90.5
Painting 64.9

Clarifai
created on 2018-03-23

people 99.7
portrait 99.3
adult 98.5
one 98.4
wear 97.9
jacket 97.5
outerwear 95.5
necklace 93.5
lid 93.3
man 91.5
coat 89.3
musician 87.7
music 86.8
sweater 85.5
neckwear 84.3
facial expression 83.4
leader 82.5
veil 82.1
scarf 81.2
singer 77.9

Imagga
created on 2018-03-23

chain mail 53.2
person 44.4
man 44.3
body armor 42.6
portrait 37.5
armor 36.7
male 36.2
people 29.6
adult 28.6
face 24.8
senior 24.4
handsome 24.1
protective covering 22.8
black 22.2
expression 22.2
suit 21.3
businessman 18.5
hair 18.2
old 18.1
smile 16.4
covering 16.1
professional 15.8
happy 15.7
attractive 15.4
speaker 15.1
fashion 15.1
eyes 14.6
business 14.6
mature 13.9
hand 13.7
dark 13.4
model 13.2
shirt 13.1
guy 13
smiling 13
executive 12.8
one 12.7
comedian 12.5
elderly 12.4
tie 12.3
look 12.3
performer 12.1
glasses 12
looking 12
head 11.8
posing 11.5
articulator 11.5
office 11.2
clothing 11.1
ruler 11.1
beard 10.9
serious 10.5
work 10.2
lifestyle 10.1
confident 10
studio 9.9
pretty 9.8
worker 9.8
success 9.7
sexy 9.6
men 9.4
casual 9.3
gray 9
human 9
entertainer 9
lady 8.9
body 8.8
communicator 8.7
hands 8.7
elegant 8.6
successful 8.2
friendly 8.2
alone 8.2
jacket 8.2
style 8.2
aged 8.1
necktie 8
working 8
older 7.8
weapon 7.7
youth 7.7
power 7.6
closeup 7.4
occupation 7.3
sensual 7.3

Google
created on 2018-03-23

portrait 92.4
gentleman 84.3
painting 78.6
elder 60.7
facial hair 58.7
art 57.3

Microsoft
created on 2018-03-23

person 98.1
wearing 80.3
posing 45
coat 44.9
dressed 29.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 57.8%
Sad 11.4%
Disgusted 1%
Confused 3.1%
Surprised 1.8%
Calm 75.3%
Angry 6.9%
Happy 0.6%

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 90.5%
Painting 64.9%

Captions

Microsoft

a man wearing a suit and tie 91.9%
a man wearing a costume posing for the camera 79.8%
a man wearing a bow tie 79.7%

Text analysis

Google

ไ ก็
ไ
ก็