Human Generated Data

Title

Untitled (Jonathan Shahn and his sculpture of Franklin Delanor Roosevelt, Roosevelt, New Jersey)
Date

1960
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4273.2

Human Generated Data

Title

Untitled (Jonathan Shahn and his sculpture of Franklin Delanor Roosevelt, Roosevelt, New Jersey)

People

Artist: Unidentified Artist,

Date

1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4273.2

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Body Part 99.8
Finger 99.8
Hand 99.8
Art 99.4
Person 99.1
Adult 99.1
Male 99.1
Man 99.1
Face 98.6
Head 98.6
Photography 98.6
Portrait 98.6
Person 81.6
Adult 81.6
Bride 81.6
Female 81.6
Wedding 81.6
Woman 81.6
Outdoors 79.1
Painting 76.8
Accessories 71.6
Bag 71.6
Handbag 71.6
Coat 71.2
Jeans 66.5
Pants 66.5
Drawing 65.8
Nature 65.2
Carpenter 56.7
Collage 56.4
Archaeology 56.2
Sculpture 56.2
Shirt 56.1
Torso 55.3

Clarifai
created on 2018-05-10

people 99.7
adult 98.6
one 98.6
man 95
portrait 93.9
two 91.7
woman 91.4
wear 90.8
light 89.2
group 87.8
indoors 87.8
monochrome 87.7
shadow 86.5
furniture 86.1
room 83.9
art 79.8
music 79.6
sculpture 77.5
administration 76.5
chair 76.1

Imagga
created on 2023-10-07

room 21.4
furniture 19.5
man 19.5
device 19.3
home 18.3
interior 16.8
house 15.9
person 15.8
light 15.4
chair 14.9
people 14.5
male 14.2
window 13.9
old 13.2
instrument of execution 12.6
guillotine 12.2
black 12
adult 11.6
seat 11.3
toilet 11.3
cell 11.2
one 11.2
equipment 11.2
vintage 10.7
incubator 10.5
work 10.2
instrument 10.1
support 10.1
fashion 9.8
portrait 9.7
apparatus 9.5
refrigerator 9.5
inside 9.2
wood 9.2
antique 8.6
ancient 8.6
human 8.2
furnishing 8.1
dress 8.1
steel 8
white goods 7.9
face 7.8
modern 7.7
home appliance 7.6
floor 7.4
alone 7.3
lady 7.3
building 7.3
hair 7.1
sofa 7.1
worker 7.1
architecture 7
indoors 7

Google
created on 2018-05-10

white 96
black 95.9
photograph 95.6
black and white 94.8
monochrome photography 92.1
photography 84.1
light 82.9
darkness 82.5
snapshot 81.8
monochrome 78.5
phenomenon 75.5
still life photography 74.3
visual arts 58.5
shadow 55.6
stock photography 55.1
film noir 53.9
art 51.5

Microsoft
created on 2018-05-10

indoor 92

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Sad 31.8%
Calm 20.6%
Fear 18.5%
Disgusted 16%
Surprised 7.7%
Confused 7.3%
Happy 6.6%
Angry 6.3%

Feature analysis

Amazon

Person
Adult
Male
Man
Bride
Female
Woman
Handbag
Coat
Jeans
Person 99.1%
Person 81.6%
Adult 99.1%
Adult 81.6%
Male 99.1%
Man 99.1%
Bride 81.6%
Female 81.6%
Woman 81.6%
Handbag 71.6%
Coat 71.2%
Jeans 66.5%

Captions

Microsoft
created on 2018-05-10

a black and white photo of a man 68%
a man in a white room 67.9%
a man standing in a room 67.8%

Text analysis

Amazon

Art
University
Fellows
College
of
(Harvard
Harvard
and
President and Fellows of Harvard College (Harvard University Art Museums)
Museums)
President
P1970.4273.0002

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4273.0002
President
Harvard
College
P1970.4273.0002
O
and
Fellows
of
(Harvard
University
Art
Museums)