Human Generated Data

Title

Untitled (portrait of man and woman at ball)

Date

1962

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19178

Human Generated Data

Title

Untitled (portrait of man and woman at ball)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Apparel 99
Clothing 99
Human 97
Person 97
Person 95.8
Robe 95.4
Evening Dress 95.4
Fashion 95.4
Gown 95.4
Female 81.8
Overcoat 79.3
Suit 79.3
Coat 79.3
Text 75.5
Woman 69
Sleeve 67.9
Advertisement 64.7
Poster 64.7
Door 62.8
Flyer 61.3
Paper 61.3
Brochure 61.3

Imagga
created on 2022-02-25

groom 91.5
people 31.8
person 28.9
adult 28.2
man 27.6
happy 27.6
couple 27
dress 22.6
portrait 22
attractive 21.7
male 21.5
smiling 20.3
bride 19.6
pretty 19.6
professional 19
smile 17.8
business 17.6
clothing 17.5
holding 17.3
happiness 17.2
two 16.9
fashion 15.8
wedding 15.6
businessman 15
child 14.2
standing 13.9
cheerful 13.8
lady 13.8
corporate 13.8
businesswoman 13.6
life 13.4
family 13.3
office 12.9
women 12.7
room 12.3
love 11.8
work 11.8
executive 11.7
suit 11.6
new 11.3
lifestyle 10.8
interior 10.6
brunette 10.5
home 10.4
mother 10.3
model 10.1
indoor 10
bouquet 9.7
together 9.6
men 9.4
style 8.9
posing 8.9
job 8.8
looking 8.8
full length 8.7
flowers 8.7
tie 8.5
elegance 8.4
old 8.4
hand 8.4
sexy 8
color 7.8
ethnic 7.6
marriage 7.6
businesspeople 7.6
career 7.6
communication 7.6
doctor 7.5
human 7.5
clothes 7.5
feminine 7.5
worker 7.4
friendly 7.3
children 7.3
confident 7.3
group 7.3
gown 7.2
cute 7.2
hair 7.1
medical 7.1

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

text 99.9
dress 97.8
wedding dress 96.8
bride 94.6
standing 91.4
gallery 91.3
person 90.5
room 85.9
posing 84.2
clothing 82.8
wedding 80.2
woman 78.4
scene 73.1
suit 66.5
sign 63.2
marriage 52.6
smile 50.9
picture frame 29.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Happy 98.8%
Angry 0.5%
Calm 0.2%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Sad 0%

AWS Rekognition

Age 20-28
Gender Female, 56.7%
Happy 46%
Disgusted 20.3%
Angry 14.9%
Fear 10.6%
Surprised 4.1%
Calm 1.8%
Confused 1.5%
Sad 0.8%

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97%
Suit 79.3%

Captions

Microsoft

a person standing in front of a sign posing for the camera 86.8%
a person standing in front of a door 86.7%
a person standing in front of a mirror posing for the camera 79.9%

Text analysis

Amazon

DEC
62
53
129 53
129

Google

29
DEC 29
DEC