Human Generated Data

Title

Untitled (people in costume at Beaux Arts Ball)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15659

Human Generated Data

Title

Untitled (people in costume at Beaux Arts Ball)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Clothing 100
Apparel 100
Human 97.9
Person 97.9
Hat 95.8
Party Hat 95.8
Person 93.1
Person 89.4
Painting 81.7
Art 81.7
Costume 64
Person 60.9

Imagga
created on 2022-02-05

shower curtain 85.3
curtain 72.9
blind 55.5
furnishing 52.6
protective covering 39.2
chandelier 28.3
covering 22.2
room 20.8
lighting fixture 18.7
celebration 18.3
interior 17.7
home 17.5
wedding 17.5
bride 17.3
dress 16.3
house 15
fixture 15
love 14.2
decoration 14.2
people 13.4
furniture 13.3
pretty 13.3
luxury 12.9
marriage 12.3
window 12.1
happy 11.9
bouquet 11.7
ceremony 11.6
flower 11.5
adult 11.4
design 11.3
church 11.1
person 10.9
wood 10.8
holiday 10.7
decor 10.6
flowers 10.4
table 10.4
candle 9.8
cheerful 9.8
portrait 9.7
style 9.6
hotel 9.5
elegance 9.2
bedroom 9.2
attractive 9.1
clothing 9.1
old 9.1
gold 9
indoors 8.8
day 8.6
married 8.6
happiness 8.6
clothes 8.4
rose 8.4
fashion 8.3
one 8.2
hair 7.9
wooden 7.9
cute 7.9
lamp 7.8
smile 7.8
party 7.7
modern 7.7
tree 7.7
wall 7.6
comfortable 7.6
light 7.5
holding 7.4
event 7.4
business 7.3
yellow 7.3
paper 7.2
window shade 7.1
face 7.1
pillow 7.1

Google
created on 2022-02-05

Lighting 86.2
Tints and shades 77.3
Art 75.9
Hat 74.5
Event 71.4
Magenta 71.2
Visual arts 67.7
Room 66.9
Peach 65.8
Rectangle 65.3
Fun 64.9
Stock photography 63
Happy 60.4
Vintage clothing 54.9
Square 51.5

Microsoft
created on 2022-02-05

wedding 95.7
dance 82.4
clothing 71.6
person 67.7
text 60.9
woman 59.6
bride 55.5
wedding dress 50.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-41
Gender Male, 100%
Happy 100%
Calm 0%
Disgusted 0%
Confused 0%
Sad 0%
Fear 0%
Angry 0%
Surprised 0%

AWS Rekognition

Age 24-34
Gender Female, 79.7%
Happy 40.9%
Angry 38.3%
Calm 8%
Fear 3.8%
Disgusted 2.7%
Surprised 2.4%
Sad 2%
Confused 2%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.9%
Painting 81.7%

Captions

Microsoft

a stuffed animal on a table 28.2%
a close up of a stuffed animal 28.1%
a stuffed animal 28%

Text analysis

Google

200
200