Human Generated Data

Title

Reuben Hull Booth (1771-1814)
Date

1790
People

Artist: Ralph Earl, American 1751 - 1801
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.131

Human Generated Data

Title

Reuben Hull Booth (1771-1814)

People

Artist: Ralph Earl, American 1751 - 1801

Date

1790

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.131

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Furniture 96.7
Person 96.1
Human 96.1
Art 87.9
Apparel 66.1
Clothing 66.1
Shelf 62.9
Painting 61.5

Clarifai
created on 2018-03-16

people 99.8
one 99.7
adult 99.3
portrait 98.6
wear 97.8
man 95.8
necklace 93.7
outfit 93.4
painting 93
leader 92.3
seat 91.9
royalty 91.6
facial expression 91.4
outerwear 91.2
music 90.6
jewelry 89.8
jacket 89.8
woman 88.1
veil 87.3
pants 85.3

Imagga
created on 2018-03-16

man 37
bow tie 31
adult 29.9
person 29.8
male 27.7
necktie 26.8
people 24.5
suit 24.5
couple 24.4
portrait 22.6
fashion 20.4
garment 19.5
attractive 18.9
home 17.5
old 17.4
sitting 17.2
waiter 17.2
lifestyle 16.6
love 16.6
happy 16.3
handsome 16
senior 15.9
businessman 15.9
room 15.7
face 15.6
couch 15.5
looking 14.4
interior 14.1
clothing 13.5
style 13.3
model 13.2
together 13.1
smiling 13
dining-room attendant 13
men 12.9
smile 12.8
dress 12.6
family 12.5
lady 12.2
elegant 12
vintage 11.6
elderly 11.5
retro 11.5
sexy 11.2
hair 11.1
expression 11.1
two 11
happiness 11
elegance 10.9
holding 10.7
sofa 10.6
human 10.5
loving 10.5
tie 10.4
luxury 10.3
indoor 10
cheerful 9.8
business 9.7
indoors 9.7
married 9.6
standing 9.6
armchair 9.4
employee 9.4
worker 9.4
speaker 9.4
pretty 9.1
guy 9
one 9
posing 8.9
husband 8.8
executive 8.7
women 8.7
wife 8.5
living 8.5
relationship 8.4
black 8.4
hand 8.4
chair 8.4
fun 8.2
professional 8.1
romance 8
retired 7.8
relax 7.6
passion 7.5
clothes 7.5
book 7.3
grandma 7.3
aged 7.2
stylish 7.2
body 7.2
costume 7.1
romantic 7.1
hat 7.1

Google
created on 2018-03-16

gentleman 85.5
modern art 81.8
painting 80.4
musician 79.2
portrait 78.1
string instrument 76.4
art 73.9
monarch 62.2
music 61.6
virtuoso 52.5

Microsoft
created on 2018-03-16

person 99.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-23
Gender Male, 83.2%
Sad 8.3%
Surprised 7%
Calm 16.9%
Happy 2.7%
Angry 45.9%
Disgusted 10.8%
Confused 8.3%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.1%
Painting 61.5%

Categories

Imagga

events parties 99.9%
people portraits 0.1%

Captions

Microsoft
created on 2018-03-16

a person wearing a costume 59.7%
a person wearing a costume 59.6%
a person wearing a costume 59.5%