Human Generated Data

Title

Untitled (man and woman in costume at Beaux Arts Ball)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15655.1

Human Generated Data

Title

Untitled (man and woman in costume at Beaux Arts Ball)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Clothing 99.5
Apparel 99.5
Human 95
Person 95
Furniture 92.6
Sitting 86.4
Face 80.2
Hat 79.2
Female 70.7
Creme 68.9
Food 68.9
Cake 68.9
Dessert 68.9
Icing 68.9
Cream 68.9
Photography 67.1
Portrait 67.1
Photo 67.1
Girl 65.3
Crib 61.9
Wood 60
Chair 56.5
Bonnet 56.4
Cap 55.2

Imagga
created on 2022-02-05

art 20.8
interior 19.4
religion 18.8
room 18.4
home 18.3
church 16.6
adult 16.6
man 16.1
old 15.3
sculpture 15.2
house 15
faith 14.3
god 13.4
furniture 13.3
religious 13.1
indoors 12.3
luxury 12
people 11.7
window 11.3
indoor 11
bible 10.8
statue 10.7
holy 10.6
antique 10.4
table 10.2
chair 10.1
male 10
color 10
dress 9.9
person 9.8
style 9.6
saint 9.6
culture 9.4
lifestyle 9.4
face 9.2
wood 9.2
traditional 9.1
fashion 9
book 8.7
prayer 8.7
comfortable 8.6
clothing 8.6
design 8.6
portrait 8.4
monument 8.4
human 8.2
covering 8.1
sexy 8
light 8
wall 7.9
catholic 7.8
pray 7.8
worship 7.7
couch 7.7
modern 7.7
pretty 7.7
spirituality 7.7
spiritual 7.7
happy 7.5
sofa 7.5
care 7.4
paint 7.2
history 7.2
architecture 7

Google
created on 2022-02-05

Hat 89.4
Chair 85
Tints and shades 77.4
Rectangle 75
Vintage clothing 74
Sun hat 71.6
Font 70.8
Sitting 69.9
Classic 67.6
Visual arts 67.4
Room 65.9
Art 65.6
Stock photography 61.9
Retro style 56.4
Fedora 55.7
Square 54.7
Photographic paper 53.6
History 51.8
Oval 50.7

Microsoft
created on 2022-02-05

clothing 95
person 94.7
text 93.4
human face 84.3
woman 78.3
smile 70.5
white 68.4
fashion accessory 67.9
old 62.9
hat 59.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Male, 69.9%
Calm 69.8%
Happy 14.1%
Confused 6.6%
Sad 6.5%
Disgusted 1.1%
Angry 0.7%
Fear 0.7%
Surprised 0.4%

AWS Rekognition

Age 27-37
Gender Female, 99.7%
Calm 70.7%
Angry 5.8%
Happy 4.8%
Sad 4.4%
Confused 3.9%
Surprised 3.8%
Disgusted 3.5%
Fear 3.1%

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95%
Crib 61.9%
Chair 56.5%

Captions

Microsoft

a vintage photo of a person 93.2%
a vintage photo of a person sitting on a table 88.3%
a vintage photo of a person sitting at a table 88.2%