Human Generated Data

Title

Untitled (vignetted studio portrait of elderly couple)
Date

c. 1910-1920
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3843

Human Generated Data

Title

Untitled (vignetted studio portrait of elderly couple)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 99.9
Clothing 99.9
Suit 99.8
Overcoat 99.8
Coat 99.8
Person 97.1
Human 97.1
Tuxedo 95.9
Person 95.8
Shirt 91.7
Accessory 90.1
Tie 90.1
Accessories 90.1
Man 80
Face 72.2
People 71.9
Photography 63.1
Portrait 63.1
Photo 63.1
Fashion 58.2
Robe 58.2
Gown 57.7
Sleeve 57.1

Clarifai
created on 2019-06-01

people 99.6
man 99
adult 97.7
portrait 97.1
wedding 97
veil 97
wear 96.8
woman 96.2
one 94.5
bride 91.5
two 89.8
groom 89.7
love 86.4
indoors 84.1
retro 80
facial expression 76.7
monochrome 72
blur 70.6
fashion 69.9
leader 67.6

Imagga
created on 2019-06-01

groom 100
man 50.5
person 48.7
male 47.5
people 39.6
adult 38.3
businessman 37.1
professional 36.5
business 34.6
happy 33.2
portrait 30.4
smiling 27.5
office 27.3
lab coat 25.1
job 24.8
businesspeople 24.7
doctor 24.4
smile 24.2
corporate 24.1
team 23.3
coat 22.6
men 22.3
businesswoman 21.8
worker 21.8
handsome 21.4
work 21.2
medical 20.3
occupation 20.2
success 20.1
meeting 19.8
successful 19.2
looking 19.2
cheerful 18.7
mature 18.6
suit 18.2
executive 18.1
hospital 18
indoors 17.6
confident 17.3
happiness 17.2
senior 16.9
teamwork 16.7
health 16.7
care 16.5
lifestyle 15.9
face 15.6
colleagues 15.5
attractive 15.4
group 15.3
medicine 15
couple 14.8
stethoscope 14.8
indoor 14.6
patient 14.5
clinic 14.4
elderly 14.4
talking 14.3
casual 13.6
practitioner 13.5
women 13.4
working 13.3
standing 13
manager 13
home 12.8
one 12.7
profession 12.4
nurse 12.1
sitting 12
camera 12
human 12
expression 11.9
modern 11.9
40s 11.7
formal 11.5
bright 11.4
tie 11.4
building 11.1
phone 11.1
20s 11
communication 10.9
only 10.5
company 10.2
positive 10.1
specialist 10.1
friendly 10.1
horizontal 10.1
joy 10
old 9.8
together 9.6
30s 9.6
clothing 9.6
staff 9.6
uniform 9.5
color 9.5
mobile 9.4
alone 9.1
laptop 9.1
grandfather 8.9
garment 8.8
computer 8.8
mid adult 8.7
partnership 8.6
day 8.6
confidence 8.6
illness 8.6
outside 8.6
career 8.5
desk 8.5
two 8.5
shirt 8.4
employee 8.4
hand 8.4
holding 8.3
outdoors 8.2
room 8.2
light 8
look 7.9
explaining 7.9
good mood 7.8
50s 7.8
physician 7.8
consultant 7.8
examination 7.8
partners 7.8
expertise 7.8
cooperation 7.7
1 7.7
leadership 7.7
workplace 7.6
smart 7.5
guy 7.4
family 7.1
love 7.1

Google
created on 2019-06-01

Photograph 97.8
White 95.9
Snapshot 87.5
Black-and-white 82.7
Photography 78.4
Stock photography 76.2
Monochrome photography 69.6
Gentleman 63.5
Monochrome 60.1
Photographic paper 54.3
Family 52.5
Style 51

Microsoft
created on 2019-06-01

wall 99.6
human face 96.3
clothing 94.5
man 93.2
person 85.3
standing 84.2
smile 83.5
fog 57.6
suit 55.8
posing 51.8
old 46.9

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 76.2%
Confused 1.2%
Surprised 1%
Angry 2%
Calm 88.3%
Disgusted 0.6%
Sad 5.1%
Happy 1.8%

AWS Rekognition

Age 26-43
Gender Female, 60%
Angry 6.8%
Sad 18.4%
Surprised 7.2%
Happy 20.7%
Calm 38.2%
Disgusted 4.8%
Confused 3.9%

Feature analysis

Amazon

Person 97.1%
Tie 90.1%

Captions

Microsoft

a black and white photo of a man 95.1%
a group of people posing for a photo 92.7%
a man posing for a photo 92.6%