Human Generated Data

Title

Photo Album
Date

c. 1857 - c. 1874
People
Classification

Photographs
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.54

Human Generated Data

Title

Photo Album

People
Date

c. 1857 - c. 1874

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 97.8
Chair 95.2
Furniture 95.2
Person 94.9
Sitting 88.1
Shoe 83.2
Clothing 83.2
Footwear 83.2
Apparel 83.2
Shoe 80.5
Portrait 61.7
Photography 61.7
Face 61.7
Photo 61.7
Chef 58.7
Flooring 58.3

Imagga
created on 2022-01-09

man 39.6
male 31.5
person 30.3
uniform 25.7
home 25.5
clothing 24.5
adult 24.1
people 24
happy 18.2
portrait 18.1
smile 17.8
senior 17.8
indoors 17.6
lifestyle 16.6
military uniform 16.2
casual 14.4
medical 14.1
grandfather 13.9
looking 13.6
elderly 13.4
handsome 13.4
family 13.3
happiness 13.3
health 13.2
boy 13
smiling 13
child 13
kitchen 12.7
face 12.1
coat 12.1
sitting 12
professional 11.4
hand 11.4
shirt 11.3
work 11.2
hospital 10.9
room 10.8
interior 10.6
one 10.4
business 10.3
jacket 10.3
mature 10.2
trench coat 10.1
patient 10.1
human 9.7
couple 9.6
standing 9.6
men 9.4
camera 9.2
house 9.2
nurse 9.2
friendly 9.1
alone 9.1
indoor 9.1
black 9.1
holding 9.1
suit 8.9
wife 8.5
expression 8.5
guy 8.5
clothes 8.4
care 8.2
confident 8.2
raincoat 8.1
office 8
domestic 7.9
eye contact 7.8
garment 7.7
old 7.7
mother 7.6
husband 7.6
equipment 7.6
fashion 7.5
doctor 7.5
life 7.5
inside 7.4
cheerful 7.3
lady 7.3
consumer goods 7.1
women 7.1
love 7.1
kid 7.1
job 7.1
working 7.1
modern 7

Google
created on 2022-01-09

Chair 86.1
Sleeve 80.8
Collar 77
Vintage clothing 74.4
Cabinetry 68.8
Sitting 67.2
Classic 66.3
Art 64.9
Drawer 63.5
History 62
Monochrome 59.3
Uniform 59
Room 58.6
Hat 58.1
Cupboard 58.1
Chest of drawers 55.3
Retro style 55.2

Microsoft
created on 2022-01-09

clothing 95.5
person 92.9
old 92.6
man 84.6
text 78.1
black 77.8
photograph 69.1
posing 53.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 44.8%
Confused 40.3%
Disgusted 4.5%
Angry 3.9%
Surprised 2.5%
Fear 1.5%
Happy 1.4%
Sad 1.1%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.9%
Shoe 83.2%

Captions

Microsoft

a vintage photo of Li Hongzhang 93.8%
an old photo of Li Hongzhang 93.7%
old photo of Li Hongzhang 93.1%