Human Generated Data

Title

James Arnold (1781-1868) and family

Date

1837

People

Artist: Robert Scott Lauder, Scottish 1803 - 1869

Sitter: James Arnold, 1781 - 1868

Classification

Paintings

Credit Line

Harvard University Portrait Collection, Gift of Arthur Rotch, to Harvard University for the Arnold Aboretum, 1958, H574

Human Generated Data

Title

James Arnold (1781-1868) and family

People

Artist: Robert Scott Lauder, Scottish 1803 - 1869

Sitter: James Arnold, 1781 - 1868

Date

1837

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Art 99.9
Painting 99.9
Human 99.8
Person 99.8
Person 98.8
Person 98.1
Person 86.2
Photo 57.9
Photography 57.9
Portrait 57.9
Face 57.9

Clarifai
created on 2018-02-19

people 99.9
painting 99.8
adult 99.8
group 99.8
religion 99.6
woman 98.9
room 98.6
furniture 98.5
seat 98.5
art 98.4
book series 98.3
man 97.4
royalty 96.8
wear 96.5
saint 96
leader 95.9
Renaissance 95.8
gown (clothing) 95.7
Mary 95.2
veil 95

Imagga
created on 2018-02-19

metropolitan 31.5
person 23.6
dress 23.5
people 22.3
man 21.5
fashion 20.3
adult 20.3
male 18.4
costume 17.4
portrait 16.8
attractive 15.4
traditional 15
lady 14.6
face 14.2
religion 12.5
happy 12.5
color 12.2
couple 12.2
church 12
old 11.8
love 11.8
interior 11.5
groom 11.2
sitting 11.2
men 11.2
clothing 10.8
holiday 10.7
mother 10.7
bride 10.5
pretty 10.5
model 10.1
hair 9.5
art 9.4
religious 9.4
teacher 9.3
tradition 9.2
style 8.9
sexy 8.8
home 8.8
women 8.7
lifestyle 8.7
holy 8.7
faith 8.6
luxury 8.6
elegant 8.6
culture 8.5
expression 8.5
black 8.5
two 8.5
oriental 8.4
dark 8.3
wedding 8.3
indoor 8.2
gown 8.1
posing 8
indoors 7.9
cute 7.9
smile 7.8
happiness 7.8
pray 7.8
eyes 7.7
wall 7.7
father 7.7
marriage 7.6
elegance 7.6
fun 7.5
outdoors 7.5
vintage 7.4
hat 7.4
sensual 7.3
decoration 7.2
smiling 7.2
celebration 7.2
family 7.1
night 7.1

Google
created on 2018-02-19

painting 89.8
art 87.1
portrait 68.1
artwork 53.1
gentleman 52.4

Microsoft
created on 2018-02-19

person 91.7
indoor 90.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-69
Gender Male, 97.4%
Angry 4.2%
Calm 82.9%
Surprised 2.5%
Confused 2.7%
Happy 1.9%
Disgusted 0.8%
Sad 5%

AWS Rekognition

Age 26-43
Gender Female, 99.9%
Happy 2%
Calm 62.7%
Sad 23.6%
Confused 3.2%
Disgusted 1.8%
Surprised 2.6%
Angry 4.2%

AWS Rekognition

Age 26-43
Gender Female, 98.4%
Angry 4.2%
Disgusted 1.2%
Surprised 2.4%
Confused 1.9%
Happy 2.2%
Sad 10.7%
Calm 77.2%

AWS Rekognition

Age 26-43
Gender Male, 86.4%
Disgusted 5.3%
Angry 8.9%
Happy 11.2%
Calm 45.7%
Sad 17.6%
Confused 4.9%
Surprised 6.4%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 37
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.9%
Person 99.8%

Captions

Microsoft

a group of people posing for the camera 91.5%
a group of people posing for a picture 91.4%
a group of people posing for a photo 88.5%