Human Generated Data

Title

Untitled (portrait of a seated man)

Date

1967

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2893

Human Generated Data

Title

Untitled (portrait of a seated man)

People

Artist: Unidentified Artist,

Date

1967

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2893

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.5
Human 99.5
Person 99.4
Text 89.3
Passport 69.2
Document 69.2
Page 69.2
Id Cards 67.4
Book 65.7
Comics 58.7
Poster 57.8
Advertisement 57.8
Head 57.5

Clarifai
created on 2023-10-25

people 99.7
adult 98.1
portrait 97.1
text 95.7
one 95.1
group 95.1
administration 95
man 93.4
print 92.4
two 91.9
woman 91.4
leader 90.4
presentation 89.5
newspaper 89.4
paper 87.4
information 87.3
illustration 85.5
magazine 84.6
business 83.2
bill 83.1

Imagga
created on 2022-01-08

newspaper 100
product 95
creation 75.1
business 34.7
daily 33
paper 30.6
money 28.1
dollar 25.1
currency 24.3
design 23.7
magazine 22.4
web site 21.1
template 19.3
wealth 18.9
cash 18.3
finance 17.8
banking 17.5
bill 17.1
dollars 16.4
bank 16.3
financial 16.1
creative 15.9
letter 15.6
collection 15.3
us 14.5
menu 14.2
savings 14
retro 13.9
graphic 13.9
close 13.7
calendar 13.6
hundred 13.6
exchange 13.4
modern 13.3
art 13.3
vintage 13.3
office 12.9
sign 12.8
new 12.2
symbol 12.1
banner 12
layout 11.7
element 11.6
number 11.2
note 11
communication 10.9
journal 10.8
month 10.8
idea 10.7
stamp 10.7
mail 10.5
date 10.5
drawing 10.4
education 10.4
blank 10.3
page 10.2
document 10.2
investment 10.1
year 10
decorative 10
week 9.8
old 9.8
diary 9.8
tax 9.7
bills 9.7
pattern 9.6
icon 9.5
cloud 9.5
stock 9.4
card 9.4
economy 9.3
global 9.1
market 8.9
postmark 8.9
monthly 8.9
world 8.9
franklin 8.9
success 8.9
wages 8.8
definition 8.8
organizer 8.8
day 8.6
loan 8.6
international 8.6
web 8.5
future 8.4
data 8.2
weekly 7.9
calender 7.9
association 7.9
planner 7.9
text 7.9
rate 7.8
paying 7.8
grunge 7.7
one 7.5
company 7.5
elements 7.4
cover 7.4
artwork 7.3
information 7.1

Google
created on 2022-01-08

Jaw 87.6
Font 83.3
Suit 68.3
History 66.2
Pattern 65.7
Paper 64.7
Paper product 61.3
Collar 61
Publication 60
Signature 58.4
Illustration 55.1
Blazer 52.7
Terrestrial animal 52.2
Newsprint 51.9
Document 51.9

Microsoft
created on 2022-01-08

text 100
human face 94.2
newspaper 90.7
person 81.8
man 66.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 89.8%
Confused 4.5%
Angry 2.5%
Sad 1.7%
Disgusted 0.6%
Surprised 0.5%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 99.3%
Confused 0.3%
Sad 0.2%
Angry 0.1%
Surprised 0.1%
Fear 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Passport 69.2%
Id Cards 67.4%

Categories

Imagga

text visuals 99.9%

Captions

Text analysis

Amazon

BY
FBI
1967
WANTED BY FBI
narcotics
DONALD
WANTED
DONALD JACKSON
truck
tip
Ronald
JACKSON
reportedly
ROBBERY
Ray
BANK ROBBERY
pounds
BANK
ring
taken
Photographs taken 1967
steel
right
under
mill
Newberry
RACE:
CRIMINAL
brown
scar
operation
AGE:
1937,
10-26-67
Jackson,
AND
DESCRIPTION
left
145
WEIGHT:
REMARKS: reportedly uses narcotics
RACE: Negro
March
round
OCCUPATIONS:
near
born
MARKS:
145 to 150 pounds
Campbell,
Ohio
EYES: brown
BUILD:
Photographs
Negro
HEIGHT:
SCARS
216,495
outer
30
4138
American
HAIR:
abdomen
150
AGE: 30 born March 12, 1937, Campbell, Ohio
No.
driver
BUILD: medium
mole
balding
forearm
uses
22
wrist,
eye,
medium
EYES:
REMARKS:
to
OCCUPATIONS: laborer, steel mill worker, truck driver
NATIONALITY: American
on
2
worker,
scar left forearm near wrist, scar tip right ring finger, operation scar on
Donald
NATIONALITY:
J.
5'
COMPLEXION:
SCARS AND MARKS: mole under left eye, round scar outer right shoulder,
ALIASES: Donald Ronald Jackson, Ray J. Newberry
5'9"
22 M1U 2
12,
COMPLEXION: light
finger,
light
5'9" to 5' 10"
FBI No. 216,495 C
laborer,
I.0. 4138
M1U
HAIR: black balding
Donald Jackson
L 1 Ta
I.0.
10"
ALIASES:
black
C
Jackson
shoulder,

Google

Federal Burgau of Investigation BANK ROBBERY WANTED BY FBI 1.0. 4138 10-26-67 DONALD JACKSON FBI No. 216,495 C 22 M 1 U 2 L1 Ta ALIASES: Donald Ronald Jackson, Ray J. Newberry Photographs taken 1967 Donald Jucksor DESCRIPTION AGE: 30, born March 12, 1937, Campbell, Ohio HEIGHT: 5'9" to 5' 10" WEIGHT: 145 to 150 pounds BUIL D: medium HAIR: black, balding OCCUPATIONS: laborer, steel mill worker, truck driver SCARS AND MARKS: mole under left eye, round scar outer right shoulder, scar left forearm near wrist, scar tip right ring finger, operation scar on abdomen REMARKS: reportedly uses narcotics EYES: brown COMPLEXION: light RACE: Negro NATIONALĪTY: American CRIMINAL RECORD Jackson has been convicted of burglary and robbery. CAUTION JACKSON, WHO MAY BE ARMED WITH A REVOLVER AND A KNIFE IS BEING SOUGHT FOR A BANK ROBBERY IN WHICH A BANK TELLER WAS SHOT. CON SIDER ARMED AND DANGEROUS. A Federal warrant was issued on June 12, 1967, at Los Angeles, California, charging Jackson with bank robbery (Title 18, U. S. Code, Sections 2113a and 2113d). IF YOU HAVE INFORMATION CONCERNING THIS PERSON, PLEASE CONTACT YOUR LOCAL FBI OFFICE. TELEPHONE NUMBERS AND ADDRESSES OF ALL FBI OFFICES LISTED ON BACK. atooven Director Identi fication Order 4138 October 26, 1967 Washington, D. C. 20535
Federal
Investigation
BANK
FBI
1.0.
4138
10-26-67
DONALD
JACKSON
No.
216,495
C
22
M
1
U
2
L1
Ray
J.
Newberry
Photographs
DESCRIPTION
March
1937,
Ohio
5'9"
to
5'
WEIGHT:
145
150
pounds
medium
HAIR:
balding
left
eye,
scar
right
shoulder,
near
wrist,
tip
ring
finger,
abdomen
RACE:
convicted
burglary
robbery.
CAUTION
JACKSON,
WHO
MAY
BE
ARMED
WITH
A
IS
BEING
FOR
WHICH
Burgau
of
ROBBERY
WANTED
BY
Ta
ALIASES:
Donald
Ronald
Jackson,
taken
1967
Jucksor
AGE:
30,
born
12,
Campbell,
HEIGHT:
10"
BUIL
D:
black,
OCCUPATIONS:
laborer,
steel
mill
worker,
truck
driver
SCARS
AND
MARKS:
mole
under
round
outer
forearm
operation
on
REMARKS:
reportedly
uses
narcotics
EYES:
brown
COMPLEXION:
light
Negro
NATIONALĪTY:
American
CRIMINAL
RECORD
Jackson
has
been
and
REVOLVER
KNIFE
SOUGHT
IN
TELLER
WAS
SHOT.
CON
SIDER
DANGEROUS.
warrant
was
issued
June
1967,
at
Los
Angeles,
California,
charging
with
bank
robbery
(Title
18,
U.
S.
Code,
Sections
2113a
2113d).
IF
YOU
HAVE
INFORMATION
CONCERNING
THIS
PERSON,
PLEASE
CONTACT
YOUR
LOCAL
OFFICE.
TELEPHONE
NUMBERS
ADDRESSES
OF
ALL
OFFICES
LISTED
ON
BACK.
atooven
Director
Identi
fication
Order
October
26,
Washington,
D.
C.
20535