Human Generated Data

Title

Portrait of John Jay
Date

19th century
People

Artist: Joseph Andrews, American 1806 - 1873

Artist after: Gilbert Stuart, American 1755 - 1828
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3782

Human Generated Data

Title

Portrait of John Jay

People

Artist: Joseph Andrews, American 1806 - 1873

Artist after: Gilbert Stuart, American 1755 - 1828

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3782

Machine Generated Data

Tags

Amazon
created on 2023-10-25

Face 100
Head 100
Photography 100
Portrait 100
Person 99.5
Baby 99.5
Art 99.4
Painting 99.4
Hole 64.5
Accessories 60.1
Earring 60.1
Jewelry 60.1
People 56.8
Text 56

Clarifai
created on 2019-02-26

people 93.3
house 92.5
portrait 92.1
one 90.5
vintage 90.4
wear 90
wall 89.9
texture 89.9
door 89.8
adult 89.8
art 89.7
building 89.3
no person 88.9
retro 88.8
window 88.6
symbol 87.5
old 87.1
room 86.8
desktop 86.2
architecture 85.7

Imagga
created on 2019-02-26

wall clock 100
timepiece 100
clock 100
measuring instrument 78.5
instrument 40.6
old 33.4
antique 28.6
vintage 26.5
grunge 26.4
texture 25
dirty 23.5
retro 22.9
wall 22.2
aged 21.7
paper 18.8
ancient 16.4
pattern 15
empty 14.6
parchment 14.4
worn 14.3
design 14.1
page 13.9
time 13.7
rough 13.7
sign 13.5
material 13.4
art 13
wallpaper 12.2
detail 12.1
wooden 11.4
text 11.3
number 11.2
blank 11.1
closeup 10.8
symbol 10.8
textured 10.5
book 10.1
decorative 10
wood 10
surface 9.7
metal 9.7
decay 9.6
rust 9.6
damaged 9.5
rusty 9.5
card 9.3
document 9.3
close 9.1
business 9.1
brown 8.8
age 8.6
door 8.6
space 8.5
backdrop 8.2
technology 8.2
architecture 7.8
travel 7.7
cardboard 7.7
watch 7.7
old fashioned 7.6
weathered 7.6
grungy 7.6
canvas 7.6
frame 7.5
grain 7.4
water 7.3
digital 7.3
decoration 7.2
color 7.2

Google
created on 2019-02-26

Illustration 62.3
Drawing 60.7
Circle 56.3
Art 50.2

Microsoft
created on 2019-02-26

art 19.8
wall 9.9
black and white 8.1
monochrome 3.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Calm 98.6%
Surprised 6.4%
Fear 6%
Sad 2.2%
Confused 0.4%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 26
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Baby 99.5%

Categories

Imagga

paintings art 84.8%
food drinks 11.1%
text visuals 1.9%
interior objects 1.8%

Captions

Microsoft
created on 2019-02-26

a close up of a white wall 65.8%
close up of a white wall 60.3%