Human Generated Data

Title

Untitled (portrait of a seated man)

Date

1967

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2893

Human Generated Data

Title

Untitled (portrait of a seated man)

People

Artist: Unidentified Artist,

Date

1967

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.5
Human 99.5
Person 99.4
Text 89.3
Passport 69.2
Document 69.2
Page 69.2
Id Cards 67.4
Book 65.7
Comics 58.7
Poster 57.8
Advertisement 57.8
Head 57.5

Imagga
created on 2022-01-08

newspaper 100
product 95
creation 75.1
business 34.7
daily 33
paper 30.6
money 28.1
dollar 25.1
currency 24.3
design 23.7
magazine 22.4
web site 21.1
template 19.3
wealth 18.9
cash 18.3
finance 17.8
banking 17.5
bill 17.1
dollars 16.4
bank 16.3
financial 16.1
creative 15.9
letter 15.6
collection 15.3
us 14.5
menu 14.2
savings 14
retro 13.9
graphic 13.9
close 13.7
calendar 13.6
hundred 13.6
exchange 13.4
modern 13.3
art 13.3
vintage 13.3
office 12.9
sign 12.8
new 12.2
symbol 12.1
banner 12
layout 11.7
element 11.6
number 11.2
note 11
communication 10.9
journal 10.8
month 10.8
idea 10.7
stamp 10.7
mail 10.5
date 10.5
drawing 10.4
education 10.4
blank 10.3
page 10.2
document 10.2
investment 10.1
year 10
decorative 10
week 9.8
old 9.8
diary 9.8
tax 9.7
bills 9.7
pattern 9.6
icon 9.5
cloud 9.5
stock 9.4
card 9.4
economy 9.3
global 9.1
market 8.9
postmark 8.9
monthly 8.9
world 8.9
franklin 8.9
success 8.9
wages 8.8
definition 8.8
organizer 8.8
day 8.6
loan 8.6
international 8.6
web 8.5
future 8.4
data 8.2
weekly 7.9
calender 7.9
association 7.9
planner 7.9
text 7.9
rate 7.8
paying 7.8
grunge 7.7
one 7.5
company 7.5
elements 7.4
cover 7.4
artwork 7.3
information 7.1

Google
created on 2022-01-08

Jaw 87.6
Font 83.3
Suit 68.3
History 66.2
Pattern 65.7
Paper 64.7
Paper product 61.3
Collar 61
Publication 60
Signature 58.4
Illustration 55.1
Blazer 52.7
Terrestrial animal 52.2
Newsprint 51.9
Document 51.9

Microsoft
created on 2022-01-08

text 100
human face 94.2
newspaper 90.7
person 81.8
man 66.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 89.8%
Confused 4.5%
Angry 2.5%
Sad 1.7%
Disgusted 0.6%
Surprised 0.5%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 99.3%
Confused 0.3%
Sad 0.2%
Angry 0.1%
Surprised 0.1%
Fear 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 47
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Passport 69.2%
Id Cards 67.4%

Captions

Microsoft

a close up of a newspaper 78.1%
a close up of a newspaper article 75.4%
close up of a newspaper 75.3%

Text analysis

Amazon

FBI
1967
BY
WANTED BY FBI
narcotics
DONALD
WANTED
DONALD JACKSON
truck
tip
Ronald
JACKSON
reportedly
ROBBERY
Ray
BANK ROBBERY
pounds
BANK
ring
taken
Photographs taken 1967
steel
right
under
mill
Newberry
RACE:
CRIMINAL
brown
scar
operation
AGE:
1937,
10-26-67
Jackson,
AND
DESCRIPTION
left
145
WEIGHT:
REMARKS: reportedly uses narcotics
RACE: Negro
March
round
OCCUPATIONS:
near
born
MARKS:
145 to 150 pounds
Campbell,
Ohio
EYES: brown
BUILD:
Photographs
Negro
HEIGHT:
SCARS
216,495
outer
30
4138
American
HAIR:
abdomen
150
AGE: 30 born March 12, 1937, Campbell, Ohio
No.
driver
BUILD: medium
mole
balding
forearm
uses
22
wrist,
eye,
medium
EYES:
REMARKS:
to
OCCUPATIONS: laborer, steel mill worker, truck driver
NATIONALITY: American
on
2
worker,
scar left forearm near wrist, scar tip right ring finger, operation scar on
Donald
NATIONALITY:
J.
5'
COMPLEXION:
SCARS AND MARKS: mole under left eye, round scar outer right shoulder,
ALIASES: Donald Ronald Jackson, Ray J. Newberry
5'9"
22 M1U 2
12,
COMPLEXION: light
finger,
light
5'9" to 5' 10"
FBI No. 216,495 C
laborer,
I.0. 4138
M1U
HAIR: black balding
Donald Jackson
L 1 Ta
I.0.
10"
ALIASES:
black
C
Jackson
shoulder,

Google

4138
216,495
U
Newberry
5'9"
black,
worker,
AND
under
left
eye,
scar
outer
right
near
EYES:
WHO
IS
FOR
A
on
California,
Jackson
with
18,
2113a
CONCERNING
THIS
PLEASE
CONTACT
NUMBERS
Director
C
2
Ta
ALIASES:
Jackson,
J.
taken
Jucksor
AGE:
born
12,
5'
WEIGHT:
steel
mill
MARKS:
ring
finger,
narcotics
COMPLEXION:
NATIONALĪTY:
American
CRIMINAL
convicted
of
CAUTION
DANGEROUS.
Federal
June
at
Angeles,
U.
OFFICE.
ALL
FBI
BACK.
atooven
Federal Burgau of Investigation BANK ROBBERY WANTED BY FBI 1.0. 4138 10-26-67 DONALD JACKSON FBI No. 216,495 C 22 M 1 U 2 L1 Ta ALIASES: Donald Ronald Jackson, Ray J. Newberry Photographs taken 1967 Donald Jucksor DESCRIPTION AGE: 30, born March 12, 1937, Campbell, Ohio HEIGHT: 5'9" to 5' 10" WEIGHT: 145 to 150 pounds BUIL D: medium HAIR: black, balding OCCUPATIONS: laborer, steel mill worker, truck driver SCARS AND MARKS: mole under left eye, round scar outer right shoulder, scar left forearm near wrist, scar tip right ring finger, operation scar on abdomen REMARKS: reportedly uses narcotics EYES: brown COMPLEXION: light RACE: Negro NATIONALĪTY: American CRIMINAL RECORD Jackson has been convicted of burglary and robbery. CAUTION JACKSON, WHO MAY BE ARMED WITH A REVOLVER AND A KNIFE IS BEING SOUGHT FOR A BANK ROBBERY IN WHICH A BANK TELLER WAS SHOT. CON SIDER ARMED AND DANGEROUS. A Federal warrant was issued on June 12, 1967, at Los Angeles, California, charging Jackson with bank robbery (Title 18, U. S. Code, Sections 2113a and 2113d). IF YOU HAVE INFORMATION CONCERNING THIS PERSON, PLEASE CONTACT YOUR LOCAL FBI OFFICE. TELEPHONE NUMBERS AND ADDRESSES OF ALL FBI OFFICES LISTED ON BACK. atooven Director Identi fication Order 4138 October 26, 1967 Washington, D. C. 20535
BANK
WANTED
1.0.
No.
L1
Ronald
Photographs
Donald
30,
March
Campbell,
10"
D:
medium
HAIR:
SCARS
round
tip
operation
REMARKS:
brown
RACE:
Negro
RECORD
been
and
REVOLVER
KNIFE
ROBBERY
WAS
SHOT.
warrant
1967,
Los
charging
bank
Sections
HAVE
LOCAL
OFFICES
ON
1967
Washington,
C.
BY
22
1
1937,
Ohio
150
pounds
balding
OCCUPATIONS:
laborer,
shoulder,
wrist,
abdomen
reportedly
uses
light
robbery.
JACKSON,
MAY
BE
ARMED
BEING
IN
TELLER
CON
SIDER
robbery
(Title
S.
Code,
INFORMATION
PERSON,
ADDRESSES
26,
D.
20535
Burgau
Investigation
10-26-67
DONALD
JACKSON
M
Ray
DESCRIPTION
HEIGHT:
to
145
BUIL
truck
driver
mole
forearm
has
burglary
WITH
SOUGHT
WHICH
was
issued
2113d).
IF
YOU
YOUR
TELEPHONE
OF
LISTED
Identi
fication
Order
October