Human Generated Data

Title

Untitled (young child with bowl and spoon at table)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4411
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (young child with bowl and spoon at table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.2
Computer Keyboard 97.6
Electronics 97.6
Computer 97.6
Hardware 97.6
Keyboard 97.6
Computer Hardware 97.6
Person 93.1
Text 92.3
Game 85.2
Furniture 75.4
Table 74.5
Newspaper 68.2
Portrait 64.5
Photography 64.5
Face 64.5
Photo 64.5
Female 64
Word 60.5
Drawing 58.5
Art 58.5
Alphabet 55.5

Imagga
created on 2022-01-23

map 48.4
representation 39
design 35
drawing 32.9
paper 31.7
sketch 25.1
business 24.3
plan 20.8
art 20.6
icon 20.6
set 17.8
symbol 17.5
sign 16.6
creation 16.2
graphic 16.1
idea 16
creative 15.9
document 15.8
construction 15.4
pen 15.1
decorative 15.1
pencil 15
office 14.5
magazine 14.3
retro 14
drafting 13.8
line 13.7
blueprint 13.7
technology 13.4
architecture 13.3
element 13.3
pattern 13
product 12.9
frame 12.9
doodle 12.8
collection 12.6
engineer 12.5
engineering 12.4
button 12.3
structure 12.2
computer 12
web 11.9
designer 11.6
ink 11.6
ideas 11.3
style 11.1
decoration 11.1
banner 11
data 11
home 10.9
vintage 10.8
architect 10.6
equipment 10.6
modern 10.5
draw 10.5
site 10.3
shape 10.3
building 10.3
money 10.2
book 10.2
mine 10.1
house 10
ruler 9.8
menu 9.8
information 9.8
antique 9.6
project 9.6
facility 9.6
diagram 9.6
education 9.5
arrow 9.5
icons 9.3
bank 9
scale 8.7
graph 8.7
tracing 8.6
blank 8.6
industry 8.6
print 8.5
page 8.4
elements 8.4
silhouette 8.3
ornate 8.2
excavation 8.1
new 8.1
success 8.1
cartoon 8
market 8
world 8
holiday 7.9
association 7.9
definition 7.9
black 7.8
contractor 7.8
cloud 7.8
built 7.7
measurement 7.7
card 7.7
grunge 7.7
finance 7.6
real 7.6
communication 7.6
note 7.4
template 7.4
letter 7.3
artwork 7.3
border 7.2
tool 7.2
painting 7.2
cute 7.2
activity 7.2
financial 7.1
love 7.1
work 7.1
life 7
growth 7

Google
created on 2022-01-23

Black 89.7
Style 83.8
Black-and-white 83.4
Font 83
Urban design 80.2
Monochrome photography 75.3
Recreation 75.2
Snapshot 74.3
Monochrome 71.6
Design 68.8
Pattern 65.5
Stock photography 64.2
Illustration 63.3
Suit 63
Advertising 62.9
Brand 62.2
Room 61.8
Toy 60.2
Games 58.9
Art 57.8

Microsoft
created on 2022-01-23

text 99.9
map 84.6
design 65
handwriting 54.5
drawing 54

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 58.5%
Sad 56.4%
Calm 27.7%
Confused 12.8%
Happy 0.8%
Angry 0.7%
Fear 0.6%
Disgusted 0.6%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Computer Keyboard 97.6%
Person 93.1%

Captions

Microsoft

diagram 40.3%

Text analysis

Amazon

PRUNE
AND
BEEF
APPLE
BEEF AND LIVER
PINEAP
BEETS
LIVER
EARS
CHOPP
PRUNES
APPLESAUCE
10
30
EARS AND PINEAPP
34
PINEAPP
29
43
27
VEGETABLE
PRICOTS AND APPLESAUCE
24
41
26
33
36
2
6
SPIDER
CAME
45
4
28 27 26
ALONG
YOUR
SAT
A
7
PRICOTS
TASTE
EATING
49
CUROS
28
1
17273
35
17273.
HER
UP
CREAM
MISS
58
8
so 49
94
CUROS ALONG EATING MISS SAT A SPIDER ONATUFFET OURFET AND LITTLE CAME HER SAT ДЗНМ
10 30 30 E 30 10
-
so
40
g
W
57
D 58 57
17273 I
RODY
ME
TC
OURFET
CREA
4 DO عد
D
ONATUFFET
TC 7th
LITTLE
109
E
NB
115
para 115
WARE
ДЗНМ
para
عد
7th
52
DO
TEXT
I
TEXT ME
US
SOVO
LONG

Google

CREAME CHOPP EGETABLE RICO AND APPLESAUCE EARS AND PINEAPTET, PRUNES. BEETS BEEF AND LIVER UP 17273. CHOPP PINEAP PRUNE APPLE 10 30 10 30 5O 30 10 10 30 10 43 USS SAT OUPEC EATINAA CURDS AN LONG CA E 36 34 22 29 2. rne JAC HORNER SANA CORNER ATING N CHRAS TAAS 20 13 START A SPIOED 11 PIE E PUTINS ACK ANG A PLU AND SAID WHAT GRO A COO 7273 17273-
CREAME
CHOPP
EGETABLE
RICO
AND
APPLESAUCE
EARS
PINEAPTET,
PRUNES.
BEETS
BEEF
LIVER
UP
17273.
PINEAP
PRUNE
APPLE
10
30
5O
43
USS
SAT
OUPEC
EATINAA
CURDS
AN
LONG
CA
E
36
34
22
29
2.
rne
JAC
HORNER
SANA
CORNER
ATING
N
CHRAS
TAAS
20
13
START
A
SPIOED
11
PIE
PUTINS
ACK
ANG
PLU
SAID
WHAT
GRO
COO
7273
17273-