Human Generated Data

Title

Untitled (couple dancing at ball)

Date

1965

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19296

Human Generated Data

Title

Untitled (couple dancing at ball)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 100
Apparel 100
Dress 99.2
Accessories 99.1
Accessory 99.1
Tie 99.1
Human 99
Person 99
Person 98.6
Person 97.9
Person 97.6
Female 96.8
Face 94.9
Wedding 91.9
Bridegroom 91.9
Fashion 91.7
Gown 91.7
Robe 91.4
Woman 89.6
Clock Tower 85.4
Building 85.4
Tower 85.4
Architecture 85.4
Home Decor 83.9
Coat 83.4
Suit 83.4
Overcoat 83.4
Plant 80.5
Wedding Gown 78.6
Person 76.5
Blossom 76
Flower 76
Door 75.9
Bride 73.2
Costume 72.6
Photo 70.4
Portrait 70.4
Photography 70.4
Girl 67.8
Evening Dress 65.3
Floor 60.7
Pants 59.7
Long Sleeve 59.1
Sleeve 59.1
Flower Bouquet 58.6
Flower Arrangement 58.6
Tuxedo 58.4
Hug 58.2
Veil 56.6
Man 56.4
Jar 55.5
Vase 55.5
Potted Plant 55.5
Pottery 55.5
Person 43.1

Imagga
created on 2022-03-05

person 39.4
adult 31.4
man 30.9
people 29.6
groom 29.5
male 27.7
couple 26.1
clothing 23.6
teacher 23.5
nurse 21.6
bride 20.1
happiness 19.6
shower cap 19.4
professional 18.4
portrait 18.1
cap 17.9
happy 17.5
wedding 17.5
life 17.2
educator 16.9
love 16.6
human 15.7
two 15.2
senior 15
dress 14.5
lifestyle 14.5
looking 14.4
women 14.2
medical 14.1
patient 14.1
worker 13.9
men 13.7
married 13.4
family 13.3
headdress 13.3
bouquet 13.2
health 12.5
fashion 12.1
handsome 11.6
care 11.5
surgeon 11.2
old 11.1
casual 11
room 10.9
cheerful 10.6
elderly 10.5
uniform 10.5
standing 10.4
adults 10.4
smile 10
hand 9.9
business 9.7
home 9.6
hair 9.5
smiling 9.4
model 9.3
face 9.2
occupation 9.2
hospital 8.8
husband 8.8
profession 8.6
marriage 8.5
gown 8.5
white 8.5
doctor 8.5
clothes 8.4
attractive 8.4
elegance 8.4
pretty 8.4
emotion 8.3
window 8.2
romance 8
romantic 8
to 8
businessman 7.9
indoors 7.9
together 7.9
work 7.9
day 7.8
flowers 7.8
embrace 7.8
ceremony 7.8
loving 7.6
joy 7.5
one 7.5
outdoors 7.5
future 7.4
20s 7.3
aged 7.2
celebration 7.2
cute 7.2
summer 7.1
medicine 7
fan 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

wedding dress 94.7
person 93.5
man 92.9
text 90.8
bride 87.6
black and white 86.6
clothing 80.9
standing 80.5
woman 76.9
dress 63.5
wedding 50.4
posing 37.6

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 99.5%
Surprised 39.6%
Confused 35.9%
Happy 14.9%
Disgusted 6.5%
Sad 1%
Calm 1%
Fear 0.7%
Angry 0.4%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Calm 93.5%
Happy 2.2%
Confused 1.5%
Surprised 1.2%
Sad 0.6%
Angry 0.4%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 36-44
Gender Male, 86.5%
Surprised 49.4%
Calm 25.4%
Happy 7.5%
Disgusted 7.1%
Fear 4.7%
Confused 3.6%
Sad 1.6%
Angry 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.1%
Person 99%
Clock Tower 85.4%

Captions

Microsoft

a person standing posing for the camera 84.9%
a man and a woman standing in a room 75.3%
a man standing in a room 75.2%

Text analysis

Amazon

11
G 10
MAOOX
MAGOX
A°2 MAOOX
N
MAGOX 2.VEETA I N
A°2
I
2.VEETA

Google

KODYK
KODYK O KODYK G 10 11
O
G
11
10