Human Generated Data

Title

Untitled (man with pointed stick through left cheek, holding a metal disk)
Date

c. 1870-c. 1890
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.66

Human Generated Data

Title

Untitled (man with pointed stick through left cheek, holding a metal disk)

People

Artist: Unidentified Artist,

Date

c. 1870-c. 1890

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 96.8
Person 96.8
Art 96.8
Painting 71.1
Architecture 62.1
Building 62.1

Clarifai
created on 2018-03-16

people 98.1
art 97.4
old 94.5
retro 94.5
one 93.9
wear 93.6
vintage 93.4
antique 93.2
portrait 90.9
no person 90.8
illustration 89.4
painting 88.7
symbol 87.4
design 86.5
man 86
adult 85.5
paper 82.7
ancient 81
religion 80.4
decoration 79.3

Imagga
created on 2018-03-16

device 39.4
clock 35.3
wall clock 30
paper 26.6
old 26.5
ventilator 25.3
fan blade 23.8
timepiece 21.1
blade 19.6
vintage 18.2
retro 16.4
money 16.1
currency 16.1
measuring instrument 16
ancient 15.6
grunge 15.3
texture 14.6
aged 14.5
rotating mechanism 14.3
mechanism 13.6
instrument 13.1
page 13
antique 13
cash 12.8
design 12.4
decoration 12.3
business 12.1
finance 11.8
wall 11.1
architecture 10.9
dirty 10.8
bank 10.7
history 10.7
financial 10.7
art 10.4
envelope 10.3
light 10
frame 10
dollar 9.3
wealth 9
brown 8.8
home 8.8
loan 8.6
close 8.6
bill 8.6
house 8.4
technology 8.2
sconce 8.1
closeup 8.1
metal 8
banknote 7.8
ornament 7.8
empty 7.7
blank 7.7
pay 7.7
wallpaper 7.7
one 7.5
banking 7.3
note 7.3
letter 7.3
investment 7.3
bell 7.3
open 7.2
book 7.2

Google
created on 2018-03-16

picture frame 63.8
clock 58.9
home accessories 58.7
artwork 52.5
still life photography 50.1

Microsoft
created on 2018-03-16

picture frame 6.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-59
Gender Male, 81.8%
Happy 3.7%
Surprised 3.7%
Disgusted 6.3%
Confused 4.2%
Angry 6.4%
Calm 53.3%
Sad 22.4%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.8%
Painting 71.1%

Captions

Microsoft

a person standing in front of a door 60.1%
a person standing in front of a door 60%
a person standing in front of a building 56%