Human Generated Data

Title

Andrew Carnegie (U.S. delegate)
Date

1889-1890
People

Artist: Mathew B. Brady, American 1823 - 1896
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert Drapkin, P1998.89.25

Human Generated Data

Title

Andrew Carnegie (U.S. delegate)

People

Artist: Mathew B. Brady, American 1823 - 1896

Date

1889-1890

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Person 96.6
Human 96.6
Furniture 96.4
Art 93.8
Sitting 74.5
Wood 67.9
Painting 61.7

Clarifai
created on 2019-03-01

people 99.7
one 98.6
portrait 98.1
adult 97.7
leader 97.4
man 94
art 92
administration 91.4
wear 89.8
print 86.9
chair 86.8
painting 82.3
retro 81
writer 77.1
side view 75.8
sit 73.8
profile 73.2
outfit 71.7
furniture 70.9
engraving 70.3

Imagga
created on 2019-03-01

bow tie 88.5
necktie 71.9
man 39.6
garment 36.7
male 35.7
person 32.2
portrait 29.8
adult 27.2
suit 25.7
clothing 24.6
business 24.3
people 24
businessman 22.9
professional 19.5
call 18.1
executive 16.5
casual 15.2
handsome 15.1
couple 14.8
black 14.8
office 14.5
lifestyle 14.5
happy 14.4
fashion 14.3
job 14.2
looking 13.6
face 13.5
one 13.4
attractive 13.3
tie 13.3
model 13.2
success 12.9
human 12.7
smiling 12.3
smile 12.1
modern 11.9
alone 11.9
old 11.8
love 11.8
serious 11.4
manager 11.2
expression 11.1
room 11.1
work 11
guy 10.4
home 10.4
indoor 10
romantic 9.8
interior 9.7
corporate 9.4
men 9.4
elegant 9.4
successful 9.1
confident 9.1
holding 9.1
dress 9
style 8.9
look 8.8
standing 8.7
confidence 8.6
formal 8.6
sitting 8.6
senior 8.4
mature 8.4
hand 8.4
vintage 8.3
occupation 8.2
sexy 8
vertical 7.9
color 7.8
youth 7.7
boss 7.6
only 7.6
two 7.6
businesspeople 7.6
phone 7.4
sculpture 7.4
cheerful 7.3
lady 7.3
computer 7.2
mother 7.2
building 7.1
hair 7.1
family 7.1
happiness 7.1
together 7

Google
created on 2019-03-01

Photograph 96.3
Gentleman 87.1
Picture frame 85.3
Portrait 73.5
Sitting 72
Vintage clothing 70.3
Art 62.5
Painting 51.9

Microsoft
created on 2019-03-01

text 98.9
book 96.5
wall 95.7
person 93.3
old 89.2
older 41
museum 41
portrait 10.8
victorian 7.1
art 5.7
domain 3.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 98.1%
Sad 4.8%
Angry 1%
Disgusted 0.2%
Calm 92.6%
Surprised 0.3%
Happy 0.2%
Confused 0.9%

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.6%
Painting 61.7%

Captions

Microsoft

a vintage photo of Andrew Carnegie holding a book 76.1%
an old photo of Andrew Carnegie holding a book 76%
Andrew Carnegie holding a book 73.6%

Text analysis

Amazon

bamiegid
Ma bamiegid
Ma