Human Generated Data

Title

Untitled (studio portrait of four men with coat, gloves, and hats)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3842

Human Generated Data

Title

Untitled (studio portrait of four men with coat, gloves, and hats)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 99.8
Clothing 99.8
Human 98.6
Person 98.6
Person 97.9
Person 96
Person 87.8
Coat 83.9
Chair 83.2
Furniture 83.2
Footwear 81.5
Shoe 81.5
Shoe 72.9
Shoe 72.7
Text 68.4
People 65
Photography 64.1
Portrait 64.1
Face 64.1
Photo 64.1
Hat 62.9
Shorts 59.1

Clarifai
created on 2019-06-01

people 99.6
adult 98.3
wear 96.8
one 95.4
man 95.2
group together 94.1
woman 93.7
two 91.8
group 91
administration 90
outfit 89.4
monochrome 89.2
several 89.2
portrait 86.7
leader 86.5
many 84.9
scientist 83.3
retro 82
veil 79.7
uniform 78.9

Imagga
created on 2019-06-01

lab coat 58.6
coat 51.3
nurse 49
negative 27.9
man 26.3
male 24.1
garment 23.7
people 23.4
film 23.1
clothing 22.2
medical 20.3
person 20.2
professional 19.7
laboratory 17.4
business 17
businessman 16.8
statue 16.5
ruler 16.4
photographic paper 16.4
adult 16.3
worker 16.3
doctor 15
team 14.3
corporate 13.7
lab 13.6
medicine 13.2
office 12
work 11.8
scientist 11.8
research 11.4
businesspeople 11.4
photographic equipment 10.9
sculpture 10.8
black 10.8
happy 10.7
job 10.6
patient 10.6
health 10.4
looking 10.4
portrait 10.4
men 10.3
day 10.2
hospital 10.2
businesswoman 10
marble 9.9
working 9.7
chemistry 9.7
chemical 9.7
test 9.6
biology 9.5
historical 9.4
monument 9.3
smile 9.3
face 9.2
occupation 9.2
tourism 9.1
human 9
science 8.9
indoors 8.8
colleagues 8.7
building 8.7
scientific 8.7
profession 8.6
god 8.6
architecture 8.6
serious 8.6
art 8.6
two 8.5
teamwork 8.3
student 8.2
religion 8.1
history 8.1
clinic 8
bright 7.9
education 7.8
color 7.8
travel 7.7
old 7.7
development 7.6
technology 7.4
inside 7.4
historic 7.3
20s 7.3
tourist 7.3
smiling 7.2
dress 7.2
handsome 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

tennis 99.2
racket 96.2
person 92.3
clothing 92.2
black and white 87.6
posing 82.1
human face 77.9
player 76.8
old 62.5
man 52.8

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 73%
Sad 23.1%
Confused 6.8%
Disgusted 7.6%
Surprised 9%
Angry 8.2%
Happy 11.9%
Calm 33.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Angry 45.5%
Happy 46.8%
Sad 46.6%
Disgusted 45.2%
Confused 45.4%
Calm 50%
Surprised 45.5%

AWS Rekognition

Age 26-43
Gender Male, 87.1%
Calm 65.2%
Surprised 4.9%
Sad 10.3%
Confused 3.2%
Disgusted 5.2%
Happy 6%
Angry 5.3%

AWS Rekognition

Age 30-47
Gender Female, 52.8%
Happy 45.1%
Calm 51.7%
Angry 45.2%
Confused 45.5%
Surprised 45.2%
Sad 47.2%
Disgusted 45.1%

Feature analysis

Amazon

Person 98.6%
Shoe 81.5%

Captions

Microsoft

a group of people posing for a photo 92.6%
a group of people posing for a picture 92.5%
a group of people posing for the camera 92.4%