Human Generated Data

Title

Photo Album
Date

c. 1857 - c. 1874
People
Classification

Photographs
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.77

Human Generated Data

Title

Photo Album

People
Date

c. 1857 - c. 1874

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Family 99.7
People 99.7
Human 99.7
Person 99.4
Person 98.8
Person 98.1
Person 97.6
Person 96.9
Person 94.3
Painting 90.6
Art 90.6
Clothing 57.3
Apparel 57.3

Imagga
created on 2022-01-09

military uniform 41.4
uniform 38.5
helmet 35
clothing 31.3
man 26.8
armor plate 23.2
male 22.7
statue 19.9
person 18.4
people 18.4
old 18.1
consumer goods 16.7
sculpture 16.4
religion 15.2
monument 14.9
art 13.7
black 13.3
plate 13.2
culture 12.8
adult 11.7
soldier 11.7
dark 11.7
portrait 11.6
history 11.6
weapon 11.5
kin 11.3
religious 11.2
military 10.6
war 10.6
ancient 10.4
church 10.2
model 10.1
historic 10.1
protection 10
covering 10
pray 9.7
holy 9.6
faith 9.6
god 9.6
mask 9.3
face 9.2
traditional 9.1
sport 9
posing 8.9
warrior 8.8
catholic 8.7
antique 8.6
historical 8.5
city 8.3
shield 7.9
battle 7.8
architecture 7.8
travel 7.7
prayer 7.7
commodity 7.7
spiritual 7.7
serious 7.6
power 7.5
one 7.5
gun 7.4
famous 7.4
dress 7.2
sexy 7.2
landmark 7.2
suit 7.2

Google
created on 2022-01-09

Vintage clothing 73.7
Classic 71.4
Event 71.2
Uniform 69.5
Team 66
History 65.9
Crew 58.7
Collar 57.9
Retro style 54.4
Family 52.5

Microsoft
created on 2022-01-09

person 99.7
clothing 97.8
military uniform 97.7
text 91.3
posing 90.2
old 89.9
standing 88.3
man 86.8
group 85.3
black 84.8
white 81.9
player 71
photograph 64.8
child 56.7
team 34

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Female, 93.7%
Calm 99.8%
Sad 0.2%
Confused 0%
Fear 0%
Angry 0%
Surprised 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 98.9%
Sad 0.5%
Angry 0.3%
Confused 0.1%
Fear 0.1%
Surprised 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 4-12
Gender Female, 96.1%
Calm 70.6%
Sad 17.7%
Angry 5.5%
Surprised 1.8%
Confused 1.6%
Fear 1.1%
Happy 0.9%
Disgusted 0.9%

AWS Rekognition

Age 16-22
Gender Female, 99.9%
Calm 74.8%
Angry 9.3%
Sad 6.3%
Fear 3.7%
Confused 2.4%
Surprised 2.4%
Happy 0.6%
Disgusted 0.6%

AWS Rekognition

Age 23-31
Gender Female, 60%
Calm 93.8%
Confused 5%
Sad 0.5%
Angry 0.3%
Surprised 0.1%
Fear 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 18-24
Gender Female, 99.7%
Calm 98.9%
Sad 0.4%
Confused 0.4%
Surprised 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 90.6%

Captions

Microsoft

a group of people in uniform posing for a photo 97.3%
a vintage photo of a group of people posing for the camera 95.7%
a group of people posing for a photo 95.6%