Human Generated Data

Title

Captain Joseph Trevitt Pike (1785-1862)
Date

c. 1812
People

Artist: Joseph Wood, American 1778-1830
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Misses Elizabeth E. and K. G. Pike in memory of their father, Judge Robert Gordon Pike of Middletown, Connecticut, Class of 1843, 1934.142

Human Generated Data

Title

Captain Joseph Trevitt Pike (1785-1862)

People

Artist: Joseph Wood, American 1778-1830

Date

c. 1812

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 96.4
Human 96.4
Art 68.8
Painting 68.8
Window 57.2

Clarifai
created on 2018-03-16

one 99.9
people 99.9
portrait 99.8
adult 99.7
print 99.4
art 98.2
wear 98.2
illustration 97.4
painting 96.5
man 95.2
lithograph 94
woman 92.5
royalty 92
veil 92
engraving 91.3
lid 90.5
leader 87.6
chair 87.5
side view 84.4
pensive 83.3

Imagga
created on 2018-03-16

shield 83.1
armor 70.7
protective covering 51.2
covering 35.4
person 27.4
man 26.2
adult 25.9
business 21.8
portrait 20
hat 19
male 18.4
people 18.4
businessman 17.6
work 17.3
face 17
happy 16.9
one 16.4
old 15.3
smile 14.9
worker 13.4
currency 12.6
clothing 12.4
men 12
attractive 11.9
smiling 11.6
lady 11.3
success 11.3
casual 11
confident 10.9
black 10.8
strainer 10.8
handsome 10.7
job 10.6
looking 10.4
hair 10.3
expression 10.2
dollar 10.2
money 10.2
inside 10.1
hand 9.9
fun 9.7
look 9.6
standing 9.6
lifestyle 9.4
finance 9.3
suit 9.2
cash 9.1
executive 9.1
pretty 9.1
education 8.6
professional 8.6
filter 8.6
bill 8.6
model 8.5
senior 8.4
mature 8.4
service 8.3
banking 8.3
friendly 8.2
sexy 8
working 7.9
happiness 7.8
eyes 7.7
studio 7.6
head 7.6
fashion 7.5
human 7.5
outdoors 7.5
office 7.2
financial 7.1
to 7.1

Google
created on 2018-03-16

portrait 73.9

Microsoft
created on 2018-03-16

wall 98.8
indoor 97.2
person 96.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Male, 98.1%
Happy 2.3%
Confused 10.5%
Angry 4.3%
Disgusted 2.1%
Sad 8.8%
Calm 66.4%
Surprised 5.6%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.4%
Painting 68.8%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 56%
a person standing in front of a mirror posing for the camera 55.9%
a person standing in front of a mirror posing for the camera 55.8%