Human Generated Data

Title

Untitled (elderly women wearing hats at DAR meeting, woman standing)

Date

1948

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15638.1

Human Generated Data

Title

Untitled (elderly women wearing hats at DAR meeting, woman standing)

People

Artist: Jack Gould, American

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Apparel 99.7
Clothing 99.7
Hat 99.1
Person 98.5
Human 98.5
Person 96.9
Bonnet 96
Sunglasses 82.9
Accessories 82.9
Accessory 82.9
Person 76.7
Person 68.6
Face 60.3
Food 57.6
Cream 57.6
Cake 57.6
Icing 57.6
Dessert 57.6
Creme 57.6
Costume 56
Room 55.9
Indoors 55.9
Person 51.8

Imagga
created on 2022-02-05

table 30.2
case 27.6
glass 27
interior 26.5
home 21.5
wedding 21.1
room 19.6
dinner 18.7
furniture 18.5
luxury 18
decor 17.7
house 16.7
party 16.3
celebration 15.9
drink 15.9
restaurant 15.7
decoration 15.5
setting 15.4
china 15.4
dining 15.2
food 14.7
reception 14.7
service 13.9
elegant 13.7
bride 13.6
window 13.6
flower 13.1
plate 13
bouquet 12.9
people 12.8
wed 12.8
marriage 12.3
wine 12
style 11.9
romance 11.6
person 11.6
flowers 11.3
event 11.1
banquet 10.8
napkin 10.7
indoors 10.5
chair 10.5
clothing 10.3
design 10.1
man 10.1
indoor 10
china cabinet 10
catering 9.8
black 9.6
knife 9.6
fork 9.6
hotel 9.5
cabinet 9.5
container 9.3
glasses 9.3
elegance 9.2
eat 9.2
modern 9.1
dish 9
vase 8.9
love 8.7
comfortable 8.6
fine 8.6
lunch 8.6
floral 8.5
rose 8.4
adult 8.4
meal 8.4
porcelain 8.3
fashion 8.3
happy 8.1
romantic 8
silverware 8
cup 7.9
domestic 7.9
tablecloth 7.8
dine 7.8
serve 7.8
male 7.8
bridal 7.8
portrait 7.8
perfume 7.7
formal 7.6
set 7.6
vessel 7.5
furnishing 7.5
place 7.4
groom 7.4
shop 7.4
shower cap 7.4
arrangement 7.1
smile 7.1
face 7.1

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

text 94.3
black and white 80
vase 57.2

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 94.1%
Calm 97.8%
Surprised 1.5%
Sad 0.2%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 41-49
Gender Female, 99.2%
Calm 79.7%
Surprised 9.6%
Sad 4.2%
Confused 3.5%
Angry 1.2%
Disgusted 0.9%
Fear 0.4%
Happy 0.4%

AWS Rekognition

Age 49-57
Gender Male, 99.3%
Calm 93.1%
Surprised 6.5%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.1%
Person 98.5%
Sunglasses 82.9%

Captions

Microsoft

a vase with flowers in front of a mirror posing for the camera 44.6%
a vase with flowers in it 44.5%
a person with a vase of flowers 44.4%