Human Generated Data

Title

Untitled (man and woman with girl holding telephone)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17087

Human Generated Data

Title

Untitled (man and woman with girl holding telephone)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.1
Apparel 99.1
Chair 99
Furniture 99
Human 98.2
Person 98.2
Person 97.7
Person 93.5
Interior Design 91.3
Indoors 91.3
Face 90
Home Decor 88.4
Couch 87.1
Female 80
Hat 76.7
Robe 75
Fashion 75
Wedding 73
Bridegroom 73
Sailor Suit 72.4
Dish 72.1
Meal 72.1
Food 72.1
Photo 71.4
Photography 71.4
Portrait 71.3
Sitting 71.1
Gown 68.3
Suit 66.3
Coat 66.3
Overcoat 66.3
Woman 63.8
Man 61
Kid 60
Child 60
Girl 59.2
Plant 58.7
Wedding Gown 57.6
Cushion 57.5
Electronics 56.7
Screen 56.7
Housing 56.3
Building 56.3
Potted Plant 56.1
Pottery 56.1
Jar 56.1
Vase 56.1
Room 55.9
Performer 55.1

Imagga
created on 2022-02-26

person 44.5
man 36.3
male 32
adult 29.8
people 29.6
patient 23.1
mask 22.3
medical 22.1
professional 21.6
portrait 20.7
doctor 20.7
nurse 19.3
face 19.2
medicine 17.6
happy 16.3
worker 16.2
hospital 16
health 16
care 14.8
surgeon 14.6
looking 14.4
clinic 14.4
love 14.2
equipment 13.9
men 13.7
human 13.5
sick person 13.4
case 13.1
senior 13.1
surgery 12.7
hat 12.7
gag 12.6
suit 12.6
work 12.6
clothing 12.3
couple 12.2
smile 12.1
uniform 11.9
science 11.6
bride 11.5
husband 11.5
old 11.1
wedding 11
happiness 11
dress 10.8
laboratory 10.6
working 10.6
emergency 10.6
elderly 10.5
profession 10.5
illness 10.5
research 10.5
one 10.5
cap 10.4
women 10.3
restraint 10.2
glasses 10.2
casual 10.2
hand 9.9
gown 9.9
veil 9.8
scientist 9.8
cheerful 9.8
job 9.7
lab 9.7
chemical 9.7
technology 9.7
home 9.6
device 9.4
lifestyle 9.4
expression 9.4
occupation 9.2
fashion 9
groom 9
costume 8.9
chemistry 8.7
father 8.4
mature 8.4
holding 8.3
alone 8.2
team 8.1
celebration 8
smiling 8
businessman 7.9
hair 7.9
disease 7.8
scientific 7.8
married 7.7
biology 7.6
instrument 7.6
wife 7.6
grandfather 7.5
specialist 7.5
20s 7.3
lady 7.3
room 7.3
business 7.3
holiday 7.2
handsome 7.1
family 7.1
modern 7

Microsoft
created on 2022-02-26

person 86.6
clothing 81.3
wedding dress 80.5
human face 79.2
bride 70
text 69.4

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Female, 78.8%
Calm 99.4%
Happy 0.3%
Sad 0.1%
Disgusted 0%
Confused 0%
Surprised 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 48-56
Gender Male, 69.3%
Calm 59.4%
Sad 29.7%
Happy 3.7%
Angry 2.4%
Confused 1.8%
Disgusted 1.4%
Fear 0.8%
Surprised 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Hat 76.7%

Captions

Microsoft

a man and a woman sitting in front of a window 59.2%
a person sitting in front of a window 59.1%
a man and woman sitting next to a window 56.4%

Text analysis

Amazon

O