Human Generated Data

Title

Untitled (people in Hawaiian attire at Luau)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16436

Human Generated Data

Title

Untitled (people in Hawaiian attire at Luau)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Clothing 99.8
Apparel 99.8
Person 99.4
Human 99.4
Person 98.9
Person 98.7
Person 96.9
Fashion 87.9
Gown 87.9
Robe 87.2
Person 87.1
Meal 86.8
Food 86.8
People 82.5
Face 80
Female 76.5
Wedding 76.1
Person 74.2
Dress 71.7
Dish 71.4
Wedding Gown 69.2
Creme 67.3
Cake 67.3
Dessert 67.3
Icing 67.3
Cream 67.3
Photography 64.3
Photo 64.3
Portrait 62.3
Woman 60.6
Dining Table 59.3
Furniture 59.3
Table 59.3
Bride 55.7
Person 51.4
Person 44.8

Imagga
created on 2022-02-11

negative 45.2
film 37.4
photographic paper 28.2
people 21.2
person 20.7
wedding 20.2
bride 19.3
photographic equipment 18.8
man 15.5
flower 15.4
fashion 15.1
party 14.6
adult 14.6
decoration 14.3
table 14
celebration 13.6
medical 13.2
groom 13.2
glass 13
event 12.9
love 12.6
bouquet 12.5
health 12.5
marriage 12.3
medicine 12.3
lady 12.2
male 12.1
hair 11.9
flowers 11.3
human 11.2
sexy 11.2
elegant 11.1
dress 10.8
holiday 10.7
romance 10.7
care 10.7
bridal 10.7
science 10.7
happy 10.6
biology 10.4
portrait 10.3
black 10.2
happiness 10.2
professional 10
clothing 10
romantic 9.8
working 9.7
laboratory 9.6
setting 9.6
work 9.6
test 9.6
doctor 9.4
floral 9.4
retro 9
suit 9
technology 8.9
instrument 8.8
lab 8.7
chemical 8.7
scientific 8.7
couple 8.7
chemistry 8.7
gift 8.6
research 8.6
face 8.5
cosmetics 8.4
elegance 8.4
wine 8.3
clinic 8.3
gold 8.2
style 8.2
coat 8.1
worker 8.1
interior 8
decor 8
wed 7.9
education 7.8
equipment 7.8
pretty 7.7
attractive 7.7
hand 7.6
drink 7.5
cheerful 7.3
sensual 7.3
body 7.2
cute 7.2
team 7.2
cap 7.1
perfume 7.1
look 7

Google
created on 2022-02-11

Photograph 94.2
Black 89.5
Black-and-white 84
Style 83.9
Art 83
Snapshot 74.3
Monochrome photography 72.7
Monochrome 71.9
Pattern 68.1
Chair 68.1
Visual arts 66.7
Painting 65.4
Event 64.7
Picture frame 64.5
Font 64.3
Stock photography 63.8
Vintage clothing 63
Room 62.7
Plant 62.1
Illustration 61.6

Microsoft
created on 2022-02-11

text 99
person 98.3
drawing 96.1
sketch 89.2
indoor 86.3
window 84.2

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 100%
Angry 66.8%
Sad 8.3%
Surprised 7.1%
Calm 4.4%
Disgusted 4.2%
Fear 4.1%
Happy 2.6%
Confused 2.4%

AWS Rekognition

Age 45-53
Gender Male, 98.4%
Happy 94.1%
Surprised 1.3%
Disgusted 1.1%
Calm 1.1%
Angry 1%
Sad 0.9%
Fear 0.4%
Confused 0.3%

AWS Rekognition

Age 51-59
Gender Male, 85.7%
Happy 98.9%
Surprised 0.4%
Confused 0.4%
Calm 0.2%
Angry 0.1%
Sad 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Male, 97.2%
Calm 99.8%
Disgusted 0%
Surprised 0%
Confused 0%
Sad 0%
Happy 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Dining Table 59.3%

Captions

Microsoft

a group of people sitting at a table 72.3%
a group of people sitting around a table 71.7%
a group of people looking at a book 48.7%

Text analysis

Amazon

KODAK--1TW

Google

MJI7--YT3A2--AGOX
MJI7--YT3A2--AGOX