Human Generated Data

Title

Untitled (man and woman walking into ballroom)

Date

1962

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19173

Human Generated Data

Title

Untitled (man and woman walking into ballroom)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.9
Apparel 99.9
Overcoat 99.4
Coat 99.4
Person 97.9
Human 97.9
Person 96.5
Dress 96.1
Evening Dress 94.6
Fashion 94.6
Gown 94.6
Robe 94.6
Tuxedo 94.3
Female 92.3
Woman 80.7
Sleeve 78.4
Suit 68
Petal 61
Blossom 61
Plant 61
Flower 61
Teen 60
Girl 60
Child 60
Blonde 60
Kid 60
Shirt 56.7
Man 56.5

Imagga
created on 2022-03-05

man 38.8
male 34.8
person 33.2
people 32.9
professional 30.6
adult 30.5
happy 28.2
suit 26.8
job 24.8
portrait 24.6
couple 24.4
business 24.3
groom 24
executive 23.9
businessman 23.8
standing 23.5
smiling 23.2
corporate 22.4
team 21.5
office 20.9
clothing 19.1
work 18.1
smile 17.1
group 16.9
secretary 16.8
teamwork 16.7
businesswoman 16.4
men 16.3
attractive 16.1
women 15.8
mature 15.8
bride 15.6
manager 14.9
looking 14.4
senior 14.1
worker 13.8
successful 13.7
success 13.7
confident 13.7
fashion 13.6
dress 13.6
love 13.4
happiness 13.3
career 13.3
medical 13.3
doctor 13.2
together 13.2
handsome 12.5
businesspeople 12.3
garment 12.3
meeting 12.3
occupation 11.9
friendly 11.9
health 11.8
lifestyle 11.6
boss 11.5
cheerful 11.4
lady 11.4
hospital 11.3
building 11.1
wedding 11
kin 11
holding 10.7
family 10.7
human 10.5
pretty 10.5
old 10.5
day 10.2
two 10.2
stethoscope 9.8
black 9.8
medicine 9.7
indoors 9.7
partnership 9.6
elderly 9.6
staff 9.6
nurse 9.6
tie 9.5
adults 9.5
casual 9.3
company 9.3
blond 9.3
one 9
colleagues 8.7
uniform 8.7
partner 8.7
diversity 8.7
clinic 8.6
profession 8.6
marriage 8.6
camera 8.3
20s 8.3
bow tie 8.1
40s 7.8
corporation 7.7
mid adult 7.7
modern 7.7
confidence 7.7
bouquet 7.5
care 7.4
posing 7.1
working 7.1
model 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 98.7
dress 93.4
suit 91.6
wedding dress 89.9
posing 88.1
standing 86.7
bride 83.6
clothing 80.9
old 73.5
black and white 70.6
woman 67.1
person 66.1
white 65.6
black 65.5
smile 63.5

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 97.6%
Sad 95.5%
Happy 2.2%
Calm 0.6%
Fear 0.5%
Surprised 0.5%
Angry 0.3%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 54-62
Gender Male, 99.9%
Sad 87.7%
Calm 2.3%
Confused 2.1%
Disgusted 2.1%
Happy 1.9%
Surprised 1.4%
Angry 1.4%
Fear 1.1%

AWS Rekognition

Age 20-28
Gender Female, 94.7%
Happy 53.1%
Surprised 15.7%
Calm 11.3%
Sad 7%
Fear 4.9%
Confused 4.2%
Disgusted 1.9%
Angry 1.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.9%
Suit 68%

Captions

Microsoft

a vintage photo of a man 94.4%
a vintage photo of a man and a woman posing for a picture 84.4%
a vintage photo of a man and woman posing for a picture 81.7%

Text analysis

Amazon

KODAK
KODAK 201 EETA ETTR
201
EETA ETTR

Google

M
KODYK
NAGON
M NAGON KODYK OE
OE