Human Generated Data

Title

Colonel Hamblin (and unidentified man)
Date

1861-1865
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 2010.83

Human Generated Data

Title

Colonel Hamblin (and unidentified man)

People

Artist: Unidentified Artist,

Date

1861-1865

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-19

Clothing 99.8
Apparel 99.8
Person 99.5
Human 99.5
Person 95.6
Sitting 87.8
Sleeve 81.5
Art 80.8
Long Sleeve 77
Footwear 73
Boot 73
Home Decor 65.7
Overcoat 63
Coat 63
Advertisement 62.7
Portrait 60.6
Photo 60.6
Face 60.6
Photography 60.6
Poster 59.3
Painting 57.3
Text 55.8

Imagga
created on 2022-02-19

person 35.4
people 31.8
man 31.6
happy 28.8
male 28.6
home 25.5
smiling 23.9
automaton 23.6
adult 23.1
professional 19.5
lifestyle 18.8
smile 18.5
job 17.7
work 17.3
portrait 16.2
clothing 15.8
holding 15.7
repair 15.3
women 15
occupation 14.7
business 14.6
worker 14.3
happiness 14.1
senior 13.1
couple 13.1
men 12.9
builder 12.6
attractive 12.6
tools 12.4
together 12.3
standing 12.2
mature 12.1
carpenter 12.1
construction 12
modern 11.9
contractor 11.7
cheerful 11.4
lady 11.4
industry 11.1
kimono 11
foreman 11
hardhat 10.8
businessman 10.6
collar 10.5
indoors 10.5
jeans 10.5
brunette 10.5
safety 10.1
model 10.1
electrician 9.9
handyman 9.8
handsome 9.8
mother 9.7
building 9.7
office 9.6
electrical 9.6
profession 9.6
hair 9.5
child 9.4
casual 9.3
two 9.3
businesswoman 9.1
fashion 9
engineer 9
robe 8.9
journeyman 8.9
looking 8.8
fix 8.8
improvement 8.7
garment 8.7
shirt 8.6
enjoying 8.5
youth 8.5
life 8.4
fun 8.2
technology 8.2
husband 8
active 8
computer 8
family 8
to 8
plumber 7.9
labor 7.8
full length 7.8
retired 7.8
corporate 7.7
blond 7.7
wife 7.6
build 7.6
human 7.5
leisure 7.5
uniform 7.4
friendly 7.3
laptop 7.3
protection 7.3
industrial 7.3
group 7.3
body 7.2
repairman 7.2
cute 7.2
face 7.1
working 7.1
equipment 7

Google
created on 2022-02-19

Furniture 95.2
Chair 91.4
Coat 88.5
Table 88.1
Art 86.8
Suit 78.7
Painting 78.6
Vintage clothing 75.8
Bottle 72
Illustration 71.4
Poster 69
Sitting 68.9
Visual arts 68.6
Conversation 66.3
Rectangle 65.9
Formal wear 64.8
Room 64
Font 62.3
Recreation 58.5
Vintage advertisement 58.3

Microsoft
created on 2022-02-19

text 99.1
clothing 97.1
painting 90.6
person 85.1
man 80
drawing 70.3
cartoon 54.8

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Calm 71%
Sad 23.6%
Confused 2.6%
Angry 0.7%
Disgusted 0.6%
Happy 0.5%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 43-51
Gender Male, 96%
Disgusted 38.6%
Calm 25.5%
Angry 8.2%
Surprised 7.4%
Confused 6.4%
Happy 5.7%
Sad 5.2%
Fear 3.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Poster 59.3%

Captions

Microsoft

a man and woman posing for a photo 33.5%
a man and a woman posing for a photo 33.4%
an old photo of a man 33.3%