Human Generated Data

Title

Photo Album

Date

c. 1857 - c. 1874

People
Classification

Photographs

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.71

Human Generated Data

Title

Photo Album

People
Date

c. 1857 - c. 1874

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.4
Person 99.4
Person 99
Person 98.7
Person 98.6
People 98
Person 98
Person 97.9
Family 97.2
Person 93.1

Imagga
created on 2022-01-09

kin 76.2
nurse 47.1
man 38.3
doctor 33.8
hospital 32
person 31.8
medical 31.7
male 29.1
professional 27
adult 26.7
people 25.1
team 25.1
happy 24.4
medicine 23.7
stethoscope 23.2
health 21.5
smile 20.6
care 20.5
coat 20.4
uniform 19.4
staff 18.4
men 18
smiling 17.3
portrait 16.8
mature 15.8
standing 15.6
clinic 15.3
teamwork 14.8
friendly 14.6
business 14.6
group 14.5
happiness 14.1
doctors 13.7
confident 12.7
practitioner 12.7
handsome 12.5
student 12.3
black 12
camera 12
worker 11.8
surgeon 11.7
physician 11.7
colleagues 11.6
job 11.5
businessman 11.5
working 10.6
30s 10.6
profession 10.5
couple 10.4
looking 10.4
occupation 10.1
teacher 9.8
clinical 9.8
old 9.7
patient 9.7
indoors 9.7
confidence 9.6
lab coat 9.5
healthy 8.8
women 8.7
work 8.6
elderly 8.6
two 8.5
senior 8.4
golfer 8.4
inside 8.3
cheerful 8.1
religion 8.1
success 8
clothing 8
hair 7.9
surgical 7.9
40s 7.8
middle aged 7.8
lab 7.8
health care 7.8
expertise 7.8
child 7.7
laboratory 7.7
attractive 7.7
partnership 7.7
religious 7.5
one 7.5
20s 7.3
successful 7.3
office 7.2
lifestyle 7.2
school 7.2
home 7.2
family 7.1
day 7.1
player 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 100
old 98.8
clothing 97.8
standing 97.3
posing 97.1
black 91.6
group 90.7
man 90.7
player 87.7
smile 87
white 84.6
text 67.9
team 63.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-6
Gender Female, 97%
Calm 94.2%
Surprised 4%
Confused 0.7%
Sad 0.3%
Angry 0.2%
Disgusted 0.2%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 4-10
Gender Female, 60.3%
Calm 95.9%
Confused 1.9%
Sad 1.2%
Angry 0.5%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 6-16
Gender Female, 92.5%
Calm 59.4%
Confused 29.2%
Sad 6.9%
Angry 2%
Fear 0.7%
Surprised 0.7%
Happy 0.6%
Disgusted 0.5%

AWS Rekognition

Age 2-10
Gender Male, 100%
Calm 61.7%
Surprised 15.1%
Sad 7.2%
Fear 6.8%
Angry 3.6%
Happy 2.8%
Confused 1.6%
Disgusted 1.2%

AWS Rekognition

Age 53-61
Gender Male, 100%
Calm 57.1%
Disgusted 29.6%
Confused 4%
Angry 3.1%
Happy 2.6%
Surprised 2.4%
Fear 0.7%
Sad 0.5%

AWS Rekognition

Age 4-12
Gender Female, 99.7%
Calm 99.8%
Confused 0.1%
Sad 0%
Angry 0%
Disgusted 0%
Happy 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 99.6%
Angry 80.3%
Calm 14.2%
Sad 3.9%
Confused 0.6%
Fear 0.4%
Surprised 0.3%
Happy 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 9
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people posing for a photo 98.2%
a vintage photo of a group of people posing for the camera 97.3%
a vintage photo of a group of people posing for a picture 97.2%

Text analysis

Google

000
000