Human Generated Data

Title

Untitled (full length portrait of man, standing, left hand in pocket, hat in right hand)
Date

1861-1873
People

Artist: Mathew B. Brady & Studio, American active 1844 - 1895

Artist: Brady's National Portrait Gallery, American 1860-1894
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4071

Human Generated Data

Title

Untitled (full length portrait of man, standing, left hand in pocket, hat in right hand)

People

Artist: Mathew B. Brady & Studio, American active 1844 - 1895

Artist: Brady's National Portrait Gallery, American 1860-1894

Date

1861-1873

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Apparel 99.7
Clothing 99.7
Coat 99.7
Human 95
Person 94.1
Door 71
Home Decor 69.4
Overcoat 69.3
Linen 68.9
Photography 66.4
Photo 66.4
Face 66.4
Portrait 66.4
Suit 65.8
Man 62.7
Standing 60.8
Khaki 57.2
Mannequin 56.2

Clarifai
created on 2019-11-10

people 99.8
portrait 96.8
one 96.1
adult 96
man 95.6
wear 94
retro 93.4
leader 88.7
administration 86.9
art 84.6
outfit 84.5
military 82.2
music 79.6
vintage 78.4
woman 77.9
chair 71.6
nostalgia 71.5
actor 71
two 70.4
group 69

Imagga
created on 2019-11-10

ruler 69.4
statue 68.1
sculpture 50.4
art 28.2
ancient 27.7
religion 24.2
monument 23.4
architecture 21.9
old 20.2
history 19.7
marble 19.7
stone 19.4
antique 19.3
carving 17.5
historical 16.9
religious 16.9
culture 16.2
travel 16.2
column 16.1
catholic 15.6
god 14.4
tourism 14
figure 13.2
famous 13
city 12.5
detail 12.1
historic 11.9
building 11.9
saint 11.5
man 11.4
church 11.1
roman 10.7
holy 10.6
spirituality 10.6
tourist 10
face 9.9
landmark 9.9
temple 9.6
decoration 9.2
vintage 9.1
black 9
symbol 8.8
person 8.7
dress 8.1
artistic 7.8
angel 7.8
people 7.8
portrait 7.8
prayer 7.7
faith 7.7
body 7.2

Google
created on 2019-11-10

Photograph 95.5
Standing 88.1
Gentleman 85.1
Snapshot 83.6
Vintage clothing 69.4
Art 50.2

Microsoft
created on 2019-11-10

text 97.8
clothing 96.1
wall 95.9
person 91.7
posing 91.7
standing 90
old 89.5
gallery 73.6
boy 73.2
man 70.7
suit 67
white 63.8
uniform 52.2
room 49.5
picture frame 18.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-42
Gender Male, 98.2%
Disgusted 0%
Calm 91.6%
Happy 0.1%
Confused 0.5%
Angry 0.5%
Surprised 0%
Fear 0%
Sad 7.3%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Coat 99.7%
Person 94.1%

Captions

Microsoft

a vintage photo of John S. Mosby standing in front of a door 84.3%
a vintage photo of John S. Mosby 84.2%
a vintage photo of John S. Mosby in a suit and tie 84.1%

Text analysis

Amazon

BRADY.
NEW
BRADY. PHOTO. NEW YORK.
PHOTO.
YORK.
5G

Google

BRADY, PHOTO. NEW YORK
BRADY,
PHOTO.
NEW
YORK