Human Generated Data

Title

Untitled ("Mother Visits White House")
Date

1971
People

Artist: Donald Blumberg, American born 1935
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.658

Human Generated Data

Title

Untitled ("Mother Visits White House")

People

Artist: Donald Blumberg, American born 1935

Date

1971

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-14

Newspaper 99.8
Text 99.8
Person 99.3
Human 99.3
Person 99.1
Person 98.8
Person 97.6
Poster 97.1
Advertisement 97.1
Tie 97
Accessories 97
Accessory 97
Art 59.5

Imagga
created on 2022-01-14

newspaper 62.7
daily 55.6
product 49.5
currency 42.2
creation 40.3
money 40
cash 34.8
stamp 33.9
dollar 33.5
mail 31.6
postmark 30.6
finance 29.6
vintage 29
banking 28.5
paper 28.3
bank 28.3
bill 27.6
business 26.8
letter 26.6
postage 26.6
postal 26.5
wealth 25.2
financial 25
dollars 24.2
envelope 23.6
old 21.6
retro 21.3
exchange 21
savings 20.5
hundred 20.4
us 20.3
close 20
circa 19.8
printed 19.7
sketch 19.2
philately 18.8
one 18.7
drawing 18.5
investment 18.4
shows 17.7
rich 17.7
ancient 16.5
loan 16.3
post 16.2
closeup 15.5
economy 14.9
states 14.5
aged 14.5
pay 14.4
symbol 14.2
representation 14
banknotes 13.7
message 13.7
bills 13.6
card 13.6
banknote 13.6
finances 13.5
united 13.3
history 12.5
market 12.4
art 12.4
sign 12
global 11.9
stamps 11.8
franklin 11.8
funds 11.8
address 11.8
collection 11.7
profit 11.5
note 11
capital 10.5
culture 10.3
man 10.1
post office 9.9
notes 9.6
face 9.2
philatelic 8.9
economic 8.7
cutting 8.7
communications 8.6
unique 8.5
stock 8.4
black 8.4
success 8.1
office 8
concepts 8
1967 7.9
currencies 7.9
twenty 7.9
wages 7.9
portrait 7.8
payment 7.7
grunge 7.7
fine 7.6
commerce 7.5

Google
created on 2022-01-14

Facial expression 93.3
Coat 90.8
Smile 90.3
Rectangle 87.9
Picture frame 86.5
Gesture 85.3
Font 83.9
Style 83.8
Tie 80
Suit 79.6
Art 79.2
Blazer 76.2
Monochrome photography 75.3
Monochrome 73.2
Photo caption 71.6
Event 70.4
White-collar worker 70.1
Pattern 69.5
Formal wear 69.5
Vintage clothing 66.9

Microsoft
created on 2022-01-14

text 99.1
drawing 96.9
human face 95.1
sketch 95.1
person 83.6
man 81.9
cartoon 74.8
art 60.3
old 41.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Female, 100%
Disgusted 36.1%
Angry 24.1%
Sad 20.7%
Confused 6%
Calm 4.5%
Happy 4.2%
Fear 2.4%
Surprised 1.9%

AWS Rekognition

Age 31-41
Gender Male, 76.5%
Happy 99.3%
Calm 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%
Surprised 0%

AWS Rekognition

Age 48-56
Gender Male, 98.2%
Angry 62.4%
Disgusted 12.1%
Happy 11%
Confused 6.1%
Fear 2.7%
Surprised 2.3%
Calm 2%
Sad 1.4%

AWS Rekognition

Age 45-51
Gender Female, 98.7%
Happy 90.4%
Confused 2.5%
Surprised 2.2%
Fear 1.4%
Sad 1%
Disgusted 1%
Angry 0.8%
Calm 0.7%

AWS Rekognition

Age 40-48
Gender Female, 100%
Happy 94%
Calm 2.1%
Surprised 1.4%
Fear 0.9%
Angry 0.6%
Sad 0.4%
Disgusted 0.3%
Confused 0.2%

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 71
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Poster 97.1%
Tie 97%

Captions

Microsoft

graphical user interface 29.2%

Text analysis

Amazon

House
White House
Visit
White
Star
Mothers Visit
killed
were
Mothers
Four Gold Star Mothers
sons
Four
Gold
whose sons were killed in
whose
in
an
ite
by
the
pro
les
be
nd
n't by
ile
We
or
Bu
ld- be
A
n't
ter
to
ld-
er
fre
vie ter ed nd
stu
ars
m-
fait
ed
dor
ne-
sy. by
ch
GIs
it. We
re
this
vie
tha
pe
blve m- n't les ile the
en
sy.
S
it.
sci
to B
fee
bro
tec
se
've
ow
#:3 WS- ne- ars ch
he
ms
elo
NE (e. ad re er he
B
ke
IE
WS-
sob
ad
fez
(e.
is
like
NE
فقة
#:3
blve

Google

Mothers Visit White House Four Gold Star Mothers
Mothers
Visit
White
House
Four
Gold
Star