Human Generated Data

Title

Fitz-John Winthrop (1638-1707)

Date

c. 1694-1697

People

Artist: Unidentified Artist,

Sitter: Fitz-John Winthrop, 1638 - 1707

Classification

Paintings

Credit Line

Harvard University Portrait Collection, Gift of Robert Winthrop, representing the Winthrop family, to Harvard University, 1964, H609

Human Generated Data

Title

Fitz-John Winthrop (1638-1707)

People

Artist: Unidentified Artist,

Sitter: Fitz-John Winthrop, 1638 - 1707

Date

c. 1694-1697

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-03

Art 98.9
Painting 98.9
Human 82.2
Person 82.2

Clarifai
created on 2018-03-23

people 99.6
one 98.8
adult 96.2
portrait 96.1
man 94.1
art 92.6
religion 91.3
veil 89.5
woman 87.6
gold 87.3
no person 84.9
jewelry 84.8
face 83.8
wear 83
metalwork 79
sculpture 78.8
music 77.2
painting 74.5
facial expression 74.1
side view 73.7

Imagga
created on 2018-03-23

shield 87.7
armor 74.5
protective covering 56.1
covering 39.2
black 19.7
money 18.7
old 16
face 15.6
currency 15.2
finance 14.3
cash 13.7
close 13.7
coin 13.3
round 12.9
vintage 12.9
art 12.4
object 11.7
chimpanzee 11.2
eyes 10.3
ape 10.2
metal 9.6
coins 9.6
culture 9.4
sculpture 9.4
planet 9.3
banking 9.2
financial 8.9
man 8.7
pay 8.6
primate 8.6
dark 8.3
one 8.2
bank 8
portrait 7.8
head 7.5
historical 7.5
closeup 7.4
symbol 7.4
business 7.3
antique 7.1

Google
created on 2018-03-23

portrait 61.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 59.2%
Surprised 2.5%
Confused 1.7%
Sad 75.9%
Calm 11.9%
Angry 2.2%
Happy 2.9%
Disgusted 2.9%

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.9%
Person 82.2%

Captions

Microsoft

a close up of a bowl 46.5%
a close up of a person 46.4%
close up of a person 46.3%