Human Generated Data

Title

Untitled (man behind counter with cigar boxes)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4902
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man behind counter with cigar boxes)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 98.6
Person 98.6
Computer Keyboard 75.5
Hardware 75.5
Keyboard 75.5
Computer 75.5
Electronics 75.5
Computer Hardware 75.5
Arcade Game Machine 74.4
Interior Design 71.3
Indoors 71.3
Text 65
Photo 55
Portrait 55
Photography 55
Face 55

Imagga
created on 2022-01-23

product 47.5
computer 43
laptop 38.8
newspaper 37.2
creation 37
office 36.6
work 35.5
man 34.3
business 34
male 31.9
book 30.4
negative 30
people 29
person 26.4
businessman 25.6
working 24.7
technology 24.5
film 23.6
adult 20.2
indoors 19.3
corporate 18.9
smiling 18.8
job 18.6
student 18.3
photographic paper 18.3
sitting 18
keyboard 18
professional 17.4
hand 16.7
businesswoman 16.4
success 16.1
paper 15.7
happy 15.7
portrait 15.5
learning 14.1
smile 13.5
desk 13.4
education 13
men 12.9
home 12.8
suit 12.6
worker 12.5
retirement 12.5
senior 12.2
photographic equipment 12.2
shop 11.9
money 11.9
women 11.9
finance 11.8
communication 11.7
financial 11.6
elderly 11.5
screen 11.5
looking 11.2
successful 11
daily 10.8
typing 10.7
studying 10.5
table 10.5
old 10.4
businesspeople 10.4
learn 10.4
meeting 10.4
one person 10.4
study 10.3
manager 10.2
company 10.2
casual 10.2
monitor 10.2
executive 10.1
occupation 10.1
team 9.8
attractive 9.8
one 9.7
using 9.6
exam 9.6
workplace 9.5
reading 9.5
college 9.5
building 9.5
career 9.5
notebook 9.3
mature 9.3
teamwork 9.3
face 9.2
school 9
retired 8.7
lifestyle 8.7
wireless 8.6
modern 8.4
library 8.3
camera 8.3
holding 8.3
human 8.2
alone 8.2
handsome 8
room 8
homework 7.8
expression 7.7
notes 7.7
smart 7.5
writing 7.5
shirt 7.5
document 7.4
banking 7.3
cash 7.3
confident 7.3
group 7.2
growth 7
together 7

Google
created on 2022-01-23

Photograph 94.3
White 92.2
Black 89.7
Eyewear 82.6
Line 81.7
Snapshot 74.3
Monochrome 73.8
Monochrome photography 73
Cooking 72.4
Machine 67.7
Electronic instrument 63.2
T-shirt 61.8
Font 61.8
Artist 56.8
Photography 52.1
Office equipment 51.5

Microsoft
created on 2022-01-23

text 99.9
indoor 92.4
laptop 88
person 87.3
piano 78.7
black and white 76.1
book 64.2
human face 51.1
man 50.6
posing 39

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 91.3%
Happy 94.2%
Confused 1.7%
Calm 1.5%
Surprised 1.4%
Disgusted 0.4%
Sad 0.3%
Fear 0.3%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Computer Keyboard 75.5%

Captions

Microsoft

a person sitting at a desk with a laptop and smiling at the camera 82.7%
a person sitting at a table with a laptop and smiling at the camera 77%
a person sitting at a desk in front of a laptop 76.9%

Text analysis

Amazon

BLACKSTONE
LAPEL
NEW
18145
135
LAPEL WATCH
WATCH
TIPS
PUNCTURED
LADY
JUNIOR
LADY CHURCHILL
CKSTONE
MONARCH
CHURCHILL
POINT
GOLD
SUPPLY
MOUNTINGS
LADY CHURCHII
PLETE
by
65
VISIBLE
CHURCHII
THE NEW
THEM by
TH?
THEM
SOLID
165
ACTION
CCURACY
WAITS
CKET
THE
RSE
BLACKSTONE ؟5
TUMS
Camel Pen
VILLER
1.00
5
NC SUPPLY
Extres
ATAN
LAWLES
؟5
25
CAVALIER
LAK
-
54
DOUBE ACTION
WAITS 480WD
LOOK VILLER
5€
- e
NC
119
ATAN EXCIRCOS
6
e
keeping
O 6
STI
OOTH W
M.I.I
- keeping Regit milk
ИАМТЗАД
O
LOOK
.Sh181
Regit
milk
VERANSHY
Bany
YT77AB
480WD
DOUBE
...
FRONCE
EXCIRCOS
the

Google

PUER
BLACKSTONE
5
LADY
CISTTRO
25
18145.
co
65
JUNIOR
enly
MAMANTERDACEMAANA
FLETE
LAwn co 35 BLACKSTONE MOUNTINGS LAPEL WATCH 65 THE NEW 165 JUNION MAMANTERDACEMAANA PUER BLACKSTONE CAALE 00 BLACKSTONE 5 JUNIOR JT MONARCH Hadnednd enly LADY CHURCHILL CURACY LADY CISTTRO FLETE RSE 25 18145. 18145.
MOUNTINGS
THE
CAALE
MONARCH
Hadnednd
RSE
LAwn
35
LAPEL
WATCH
NEW
165
JUNION
00
JT
CHURCHILL
CURACY