Human Generated Data

Title

Robert Winthrop (1764-1832)

Date

1796

People

Artist: Unidentified Artist,

Sitter: Robert Winthrop, 1764 - 1832

Classification

Paintings

Credit Line

Harvard University Portrait Collection, Gift of Robert Winthrop, representing the Winthrop family, to Harvard University, 1964, H610

Human Generated Data

Title

Robert Winthrop (1764-1832)

People

Artist: Unidentified Artist,

Sitter: Robert Winthrop, 1764 - 1832

Date

1796

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-03

Art 97.9
Human 94.1
Person 94.1
Painting 89.7

Clarifai
created on 2018-03-23

people 99.4
portrait 99.3
one 99.2
adult 99
wear 96.9
illustration 96.5
art 95.9
man 95.6
woman 89.2
print 88.7
person 87.6
retro 87.5
veil 86.8
music 86.4
lid 85.8
military 84.6
fashion 84.1
desktop 84.1
face 83.8
leader 83.4

Imagga
created on 2018-03-23

hat 37.9
sombrero 34.7
shield 24.9
headdress 23.1
clothing 22.4
armor 19.9
person 19.9
covering 19.2
people 17.8
portrait 17.5
costume 17.3
adult 16.9
happy 16.9
man 16.8
protective covering 15.5
fashion 14.3
business 13.9
male 13.5
holding 13.2
smile 12.8
face 12.8
black 12.6
symbol 12.1
expression 11.9
pretty 11.9
umbrella 11.6
attractive 11.2
model 10.9
studio 10.6
businessman 10.6
one 10.4
sexy 10.4
smiling 10.1
love 9.5
happiness 9.4
lifestyle 9.4
fun 9
lady 8.9
looking 8.8
consumer goods 8.5
modern 8.4
old 8.3
human 8.2
cheerful 8.1
suit 8.1
handsome 8
hair 7.9
cute 7.9
holiday 7.9
parasol 7.8
blond 7.6
device 7.4
dollar 7.4
art 7.4
heart 7.4
percussion instrument 7.3
success 7.2

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 86.4
suit 82
wearing 77.8
dressed 26.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Male, 92.3%
Angry 2.5%
Confused 5%
Happy 2.1%
Disgusted 1.2%
Surprised 2.1%
Calm 40.1%
Sad 46.9%

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.1%
Painting 89.7%

Captions

Microsoft

a person wearing a suit and tie 85.7%
a person wearing a suit and tie 78.6%
a person wearing a suit and tie 78.5%