Human Generated Data

Title

Photo Album
Date

c. 1857 - c. 1874
People
Classification

Photographs
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.67

Human Generated Data

Title

Photo Album

People
Date

c. 1857 - c. 1874

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.4
Person 99.4
Person 98.6
Painting 93.6
Art 93.6
Person 92
Apparel 86.1
Clothing 86.1
Hat 74.3
Hat 71.3
Toy 58
Hula 57.4
Building 57

Imagga
created on 2022-01-09

hat 27.7
person 24.6
umbrella 22
people 20.1
adult 19.7
man 18.8
wind instrument 17.4
costume 16.4
canopy 16.3
attractive 16.1
fashion 15.8
portrait 15.5
face 14.2
dark 13.3
shelter 13.3
happy 13.1
musical instrument 12.9
brass 12.9
hair 12.7
pretty 12.6
black 12.4
lady 12.2
male 12
sexy 12
old 11.8
posing 11.5
style 11.1
summer 10.9
model 10.9
witch 10.8
evil 10.7
smile 10.7
horror 10.7
human 10.5
wall 10.3
happiness 10.2
holiday 10
scary 9.7
protective covering 9.7
magic 9.5
trombone 9.5
clothing 9.3
joy 9.2
traditional 9.1
dress 9
one 8.9
outdoors 8.9
performer 8.9
fear 8.7
covering 8.5
make 8.2
cheerful 8.1
smiling 7.9
women 7.9
parasol 7.7
mystery 7.7
seller 7.2
lifestyle 7.2
fantasy 7.2
hay 7.2
farm 7.1
cowboy 7
country 7

Google
created on 2022-01-09

Vertebrate 92.3
Hat 91.8
Art 87.2
Standing 86.4
Headgear 82.5
Painting 80.8
Collar 77.2
Vintage clothing 77.1
Illustration 72.6
Visual arts 70.3
Drawing 68.1
Plant 64.6
History 63.3
Stock photography 62.5
Vintage advertisement 61
Victorian fashion 58.7
Antique 58.1
Uniform 57.6
Wood 55.1
Fashion accessory 54.8

Microsoft
created on 2022-01-09

outdoor 97.9
hat 81.6
old 80.9
person 77.5
clothing 75.5
drawing 68.6
people 60.8
sketch 59.3
rain 40.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 82%
Confused 9.3%
Sad 6.5%
Angry 1%
Fear 0.4%
Happy 0.3%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 26-36
Gender Female, 60.2%
Calm 85.5%
Surprised 12.1%
Angry 0.9%
Happy 0.7%
Sad 0.4%
Disgusted 0.3%
Fear 0.1%
Confused 0.1%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 93.6%
Hat 74.3%

Captions

Microsoft

a group of people standing in the rain holding an umbrella 78.1%
a group of people that are standing in the rain holding an umbrella 74.1%
a group of people standing in the rain with an umbrella 74%