Human Generated Data

Title

Untitled (in-home portrait of young boy standing between elderly couple)
Date

c. 1910-1920
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3781

Human Generated Data

Title

Untitled (in-home portrait of young boy standing between elderly couple)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 98.1
Human 98.1
Person 96.3
Person 91.6
Face 76.3
People 75.6
Clothing 74.5
Apparel 74.5
Sailor Suit 57.9

Clarifai
created on 2019-06-01

people 99.9
group 99.4
adult 98.8
leader 97.7
group together 96.5
wear 95.3
man 95.3
several 95.1
administration 95
two 94.4
three 92
four 91.5
portrait 91.4
veil 88.6
facial expression 87.8
five 87.1
many 84.6
outfit 83.6
woman 83.5
military 83

Imagga
created on 2019-06-01

man 43.7
male 37.6
person 31.5
people 30.7
senior 30
adult 26.8
elderly 25.8
indoors 23.7
home 22.3
mature 22.3
portrait 21.3
business 21.3
old 20.9
doctor 20.7
professional 19.6
happy 18.2
ruler 17.8
businessman 17.7
looking 17.6
men 17.2
medical 16.8
smiling 16.6
kin 16.6
couple 16.5
patient 16.5
colleagues 16.5
businesspeople 16.1
casual 16.1
office 16.1
camera 15.7
day 15.7
40s 15.6
grandfather 15.5
aged 15.4
lifestyle 14.4
hospital 14.4
face 14.2
sitting 13.7
20s 13.7
indoor 13.7
30s 13.5
health 13.2
room 13
lab coat 12.9
inside 12.9
occupation 12.8
clothing 12.8
color 12.8
retired 12.6
horizontal 12.6
team 12.5
happiness 12.5
coat 12.4
clinic 12.3
nurse 12.3
bright 12.1
job 11.5
working 11.5
illness 11.4
together 11.4
stethoscope 11
jacket 10.9
associates 10.8
coworkers 10.8
forties 10.8
older 10.7
medicine 10.6
cheerful 10.6
retirement 10.6
group 10.5
worker 10
laptop 10
care 9.9
handsome 9.8
60s 9.8
half length 9.7
profession 9.6
uniform 9.5
desk 9.4
businesswoman 9.1
gray hair 8.9
good mood 8.8
middle aged 8.8
mid adult 8.7
work 8.6
husband 8.6
four 8.6
twenties 8.6
talking 8.6
smile 8.5
mother 8.5
meeting 8.5
human 8.2
confident 8.2
computer 8
family 8
business people 7.9
70s 7.9
discussing 7.9
casual clothing 7.8
table 7.8
father 7.8
busy 7.7
aging 7.7
staff 7.6
pensioner 7.6
one 7.5
teamwork 7.4
book jacket 7.4
specialist 7.3
alone 7.3
daily 7.3

Google
created on 2019-06-01

Photograph 96.9
Room 65.7
Stock photography 64
Photography 62.4
Family 61.4

Microsoft
created on 2019-06-01

posing 96.8
human face 95.5
wall 95.5
man 92.1
person 90.9
clothing 86.4
smile 85
old 78
white 62.8

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 97%
Calm 79.3%
Disgusted 0.7%
Confused 1.2%
Surprised 1.1%
Happy 1.2%
Sad 15.2%
Angry 1.2%

AWS Rekognition

Age 20-38
Gender Male, 69.1%
Disgusted 0.7%
Happy 1.6%
Surprised 2.4%
Sad 21%
Angry 4.1%
Confused 2.6%
Calm 67.6%

Feature analysis

Amazon

Person 98.1%

Captions

Microsoft

a group of people posing for a photo 94.1%
a group of people posing for the camera 94%
a group of people posing for a picture 93.9%