Human Generated Data

Title

Untitled (people in formal attire on folding chairs)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16364

Human Generated Data

Title

Untitled (people in formal attire on folding chairs)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Apparel 99.9
Clothing 99.9
Furniture 99.1
Chair 99.1
Person 99.1
Human 99.1
Person 98.4
Person 96.6
Female 90.2
Gown 89.3
Fashion 89.3
Robe 89.2
Evening Dress 88.1
Plant 87.1
Person 86.6
Person 84
Chair 81.7
Flower 80.6
Blossom 80.6
Indoors 79.5
Wedding 76.3
Woman 75.7
Chair 74.2
Clinic 73.6
Face 71.5
Room 70.8
Dress 69.5
Overcoat 69.4
Coat 69.4
Suit 69.4
Flower Arrangement 68.6
Wedding Gown 67
Portrait 64
Photography 64
Photo 64
People 61.1
Flower Bouquet 59.4
Sleeve 58.1
Bride 55.9

Imagga
created on 2022-02-11

groom 47.2
person 38.7
man 38.3
people 32.9
male 31.3
patient 30.7
couple 29.6
adult 28.4
senior 22.5
businessman 22.1
kin 20.8
happy 20.7
sitting 20.6
office 20.1
professional 20
smiling 18.8
business 18.2
men 18
two 17.8
indoors 17.6
room 17.1
doctor 16.9
medical 16.8
lifestyle 16.6
women 16.6
case 16.6
home 16
happiness 15.7
portrait 15.5
smile 15
sick person 14.9
mature 14.9
group 14.5
family 14.2
businesspeople 14.2
hospital 14.1
nurse 13.9
world 13.8
occupation 13.8
corporate 13.8
businesswoman 13.6
looking 13.6
elderly 13.4
job 13.3
together 13.1
mother 12.9
indoor 12.8
worker 12.7
old 12.5
table 12.1
casual 11.9
love 11.8
health 11.8
color 11.7
colleagues 11.7
team 11.7
holding 11.6
30s 11.5
care 11.5
working 11.5
cheerful 11.4
meeting 11.3
work 11.1
mid adult 10.6
husband 10.6
talking 10.5
teamwork 10.2
executive 10.2
face 9.9
bride 9.8
to 9.7
life 9.5
wife 9.5
career 9.5
day 9.4
wedding 9.2
pretty 9.1
attractive 9.1
necktie 9
bow tie 8.9
medicine 8.8
two people 8.8
formal 8.6
clothing 8.5
modern 8.4
communication 8.4
horizontal 8.4
treatment 8.3
coat 8.2
dress 8.1
clinic 8.1
computer 8
coworkers 7.9
daughter 7.9
teacher 7.8
casual clothing 7.8
black 7.8
education 7.8
affectionate 7.7
illness 7.6
desk 7.6
togetherness 7.6
bouquet 7.5
enjoyment 7.5
human 7.5
company 7.4
grandfather 7.4
successful 7.3
confident 7.3
aged 7.2
handsome 7.1
interior 7.1
lab coat 7

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

wedding dress 99.3
bride 98.5
text 98.2
dress 96.5
man 92.7
woman 78.2
wedding 77.1
ceremony 75.3
clothing 71.2
white 65.6
person 64.3
marriage 60.3
groom 58.6

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 99.6%
Calm 96.3%
Sad 1.5%
Confused 0.6%
Happy 0.6%
Surprised 0.3%
Fear 0.3%
Disgusted 0.2%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.1%
Person 99.1%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 49.9%
a man and a woman standing in a room 49.8%
a man and a woman standing in front of a mirror 41.5%

Text analysis

Amazon

27
ODVR
ODVR EVEELA
aRA
EVEELA

Google

27
27