Human Generated Data

Title

Photo Album
Date

c. 1857 - c. 1874
People
Classification

Photographs
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.68

Human Generated Data

Title

Photo Album

People
Date

c. 1857 - c. 1874

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.2
Human 99.2
Clothing 97.6
Apparel 97.6
Basket 95.5
Painting 65.2
Art 65.2
Wood 56.3
Sleeve 55.9

Imagga
created on 2022-01-09

swab 23
cleaning implement 21.7
old 17.4
tool 16.7
industrial 15.4
person 13.7
industry 13.6
building 13.5
people 13.4
adult 12.9
wall 12.8
device 12.8
man 12.8
work 11.5
architecture 10.9
male 10.7
factory 10.6
interior 10.6
fashion 10.5
urban 10.5
grunge 10.2
lady 9.7
steel 9.7
shovel 9.7
room 9.4
light 9.3
cleaner 9.3
human 9
metal 8.8
lawn mower 8.6
basket 8.3
dirty 8.1
posing 8
fire extinguisher 7.9
ancient 7.8
rust 7.7
concrete 7.6
dark 7.5
one 7.5
vintage 7.4
holding 7.4
container 7.4
lifestyle 7.2
mother 7

Google
created on 2022-01-09

Hairstyle 95.1
Standing 86.4
Vintage clothing 77.4
Tints and shades 77.2
Monochrome 70
Room 69.5
Hat 67.6
Classic 67.5
Stock photography 64.5
Suit 64.5
Art 62.7
Visual arts 60.4
Retro style 57.3
History 56.5
Uniform 51.5
Rectangle 50.8
Antique 50.2

Microsoft
created on 2022-01-09

clothing 97.9
person 97.6
old 96.1
wall 95.5
man 93.7
standing 89.1
text 80.2
photograph 72.6
boy 64.3
white 60.6
vintage 32.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 47-53
Gender Female, 65.1%
Confused 84.4%
Calm 10.4%
Disgusted 1.7%
Sad 1.2%
Angry 1.1%
Fear 0.7%
Surprised 0.3%
Happy 0.3%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 65.2%

Captions

Microsoft

a vintage photo of a man standing in front of a car 74.9%
a vintage photo of an old man standing in front of a car 74.1%
a man standing in front of a car 74%