Human Generated Data

Title

Untitled (girl sitting on chair with telephone next to crouching man)

Date

c. 1905

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3921

Human Generated Data

Title

Untitled (girl sitting on chair with telephone next to crouching man)

People

Artist: Durette Studio, American 20th century

Date

c. 1905

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Furniture 99.2
Human 97.9
Person 97.9
Chair 97.5
Person 95.6
Apparel 89.7
Clothing 89.7
Table 87.2
Face 86.2
Shorts 79.8
Electronics 72.1
Screen 72.1
Female 71.5
Sitting 70.7
Display 70.2
Monitor 70.2
Photo 65.3
Photography 65.3
Portrait 65.3
Desk 65.1
People 63.5
Girl 63.2
LCD Screen 61.7
Computer 59.1
Indoors 58
Pc 55.4

Clarifai
created on 2019-06-01

people 99.9
adult 99.6
group together 98.1
group 98.1
man 98
woman 97.5
one 96.4
furniture 95.9
wear 94.9
sitting 94
two 93.5
facial expression 93.4
several 93.4
monochrome 92.5
three 90.2
indoors 88.2
sit 86.3
four 85.2
five 85
many 84.7

Imagga
created on 2019-06-01

people 28.4
person 25.2
sketch 24.1
man 22.8
drawing 21.2
fashion 17.3
human 15.7
representation 14.7
work 14.1
male 13.5
working 13.2
medical 13.2
adult 13.1
professional 13
worker 12.6
mask 12.1
men 12
team 11.6
medicine 11.4
black 11.4
portrait 11
science 10.7
sexy 10.4
health 10.4
hand 9.9
businessman 9.7
clinic 9.6
happy 9.4
coat 9.2
modern 9.1
office 8.9
test 8.7
instrument 8.6
art 8.6
clothing 8.5
doctor 8.5
equipment 8.3
table 8.2
life 8.2
one 8.2
technology 8.2
body 8
home 8
costume 7.9
business 7.9
urban 7.9
scientist 7.8
lab 7.8
scientific 7.7
chemistry 7.7
laboratory 7.7
research 7.6
biology 7.6
fun 7.5
leisure 7.5
hospital 7.4
room 7.4
style 7.4
event 7.4
bass 7.4
student 7.2
stylish 7.2
lifestyle 7.2
dress 7.2
suit 7.2
hair 7.1
smile 7.1
women 7.1
indoors 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

sketch 87.1
clothing 87.1
person 86.5
old 80.8
black and white 77.4
drawing 75.8
footwear 74.1
woman 72.9
cartoon 71.5
human face 68.9
smile 60.1
posing 50.8

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 82%
Angry 6.1%
Surprised 4.5%
Disgusted 17%
Sad 32.5%
Calm 19.1%
Happy 13.4%
Confused 7.4%

AWS Rekognition

Age 16-27
Gender Female, 72%
Sad 10.8%
Angry 2.3%
Calm 75.1%
Confused 3.8%
Disgusted 2.1%
Happy 3.8%
Surprised 2.2%

AWS Rekognition

Age 23-38
Gender Female, 70.3%
Surprised 2.2%
Confused 1.4%
Disgusted 1.4%
Happy 1.5%
Sad 58.7%
Calm 32.8%
Angry 2%

Feature analysis

Amazon

Person 97.9%

Captions

Microsoft

a vintage photo of a person 94%
a vintage photo of a man and woman posing for a picture 79.6%
a vintage photo of a man and a woman posing for a picture 79.5%