Human Generated Data

Title

Untitled (two photographs: studio portrait of nun seated in habit, wearing glasses; studio portrait of nun surrounded by family)
Date

c. 1935, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6098

Human Generated Data

Title

Untitled (two photographs: studio portrait of nun seated in habit, wearing glasses; studio portrait of nun surrounded by family)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Clothing 99.9
Apparel 99.9
Human 98.4
Person 98.4
Person 98.2
Person 98.2
Person 97.8
Person 96.8
Person 91.8
Person 91.8
Fashion 90.3
Cloak 90.3
People 67
Suit 62.3
Coat 62.3
Overcoat 62.3

Clarifai
created on 2019-11-16

people 99.8
group 99.1
woman 97.4
adult 96.4
portrait 96
wear 94.7
man 94
three 90.9
leader 90.2
child 88.7
facial expression 88.7
actress 88.6
group together 88.6
four 87.9
music 87.7
singer 87.4
musician 86.9
outfit 86.3
many 85
administration 84

Imagga
created on 2019-11-16

robe 100
garment 100
clothing 79
covering 38
black 37.8
consumer goods 36.2
portrait 30.4
face 27.7
adult 27.2
person 25
dark 24.2
man 24.2
people 22.9
fashion 21.9
male 20.6
model 20.2
mask 19.7
attractive 19.6
eyes 16.4
lady 15.4
evil 14.6
clothes 14.1
sexy 13.7
dress 13.6
style 13.4
expression 12.8
crime 12.7
head 12.6
pretty 12.6
business 12.2
looking 12
human 12
hair 11.9
danger 11.8
criminal 11.7
studio 11.4
lips 11.1
religion 10.8
scary 10.7
one 10.5
elegance 10.1
make 10
pose 10
robber 9.9
thief 9.9
bad 9.7
horror 9.7
mystery 9.6
costume 9.6
dangerous 9.5
adults 9.5
corporate 9.5
smile 9.3
disguise 9.1
modern 9.1
art 9.1
eye 8.9
posing 8.9
steal 8.9
theft 8.9
illegal 8.9
businessman 8.8
computer 8.8
look 8.8
brunette 8.7
women 8.7
religious 8.4
security 8.3
close 8
lifestyle 8
bandit 7.9
burglar 7.9
gangster 7.9
darkness 7.8
sad 7.7
coat 7.7
laptop 7.3
confident 7.3
sensuality 7.3
gorgeous 7.3
fantasy 7.2
body 7.2
handsome 7.1

Google
created on 2019-11-16

Photograph 94.8
Black-and-white 78.1
Photography 62.4
Picture frame 58.8
Art 58.1

Microsoft
created on 2019-11-16

person 98.5
text 97.5
clothing 96.3
smile 95.7
human face 92.8
black and white 86.6
man 83.2
standing 75.2
posing 63.1
woman 62.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-49
Gender Female, 68.5%
Happy 97%
Angry 0.2%
Confused 0.2%
Calm 1.5%
Disgusted 0.3%
Fear 0.4%
Surprised 0.2%
Sad 0.2%

AWS Rekognition

Age 47-65
Gender Male, 54.4%
Sad 45%
Calm 45.1%
Angry 45%
Fear 45%
Happy 54.9%
Confused 45%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 13-25
Gender Male, 54.1%
Surprised 45%
Calm 45.3%
Happy 54.7%
Angry 45%
Fear 45%
Sad 45%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 17-29
Gender Male, 54.4%
Angry 45.1%
Sad 45%
Confused 45.1%
Surprised 45.3%
Happy 51.2%
Disgusted 45.1%
Calm 48.1%
Fear 45.1%

AWS Rekognition

Age 19-31
Gender Female, 53.2%
Fear 45.1%
Happy 53.6%
Calm 45.4%
Sad 45.7%
Angry 45.1%
Surprised 45%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 23-35
Gender Female, 54.9%
Sad 45%
Angry 45%
Calm 45%
Happy 55%
Surprised 45%
Confused 45%
Disgusted 45%
Fear 45%

AWS Rekognition

Age 26-42
Gender Female, 51.4%
Sad 45%
Disgusted 45%
Confused 45%
Surprised 45%
Angry 45%
Calm 45.4%
Happy 54.5%
Fear 45%

Microsoft Cognitive Services

Age 43
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Suit 62.3%

Captions

Microsoft

a group of people posing for a photo 94.2%
a group of people posing for a picture 94.1%
a group of people posing for the camera 94%