Human Generated Data

Title

Untitled (bride and groom)

Date

1920-1930

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3265

Human Generated Data

Title

Untitled (bride and groom)

People

Artist: Unidentified Artist,

Date

1920-1930

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3265

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Apparel 99.8
Clothing 99.8
Overcoat 98.7
Coat 98.7
Person 97.8
Human 97.8
Person 91.6
Tuxedo 89.4
Furniture 79.8
Painting 76.6
Art 76.6
Plant 70.7
Blossom 70.7
Flower 70.7
Suit 64.5
People 63.2
Flower Bouquet 61
Flower Arrangement 61
Photo 60.5
Photography 60.5
Face 59.9
Blazer 59.8
Jacket 59.8
Fashion 59.4
Robe 59.4
Man 57.9
Couch 57.9
Gown 56.8
Sailor Suit 55.5
Chair 54

Clarifai
created on 2019-11-10

people 99.7
wear 95.3
woman 94.3
adult 94
man 93.6
group 93.4
child 92.8
two 92.5
retro 91.1
administration 88.5
outfit 87.9
leader 87.4
actress 86.7
portrait 86.4
elderly 86.2
three 85.2
family 83.7
one 83
actor 82.1
furniture 81.4

Imagga
created on 2019-11-10

sculpture 62.9
statue 62.6
art 36.2
ruler 34.9
religion 34.1
history 29.5
ancient 29.4
architecture 26.6
culture 26.5
old 26.5
monument 26.2
stone 25.3
carving 23.4
travel 23.3
tourism 20.6
religious 20.6
temple 19.2
historic 18.4
historical 17
antique 16.9
building 16.7
marble 16.5
god 16.3
decoration 16.1
figure 16
famous 15.8
city 15.8
column 15.8
landmark 15.4
detail 13.7
tourist 13.6
holy 13.5
structure 13
church 13
catholic 12.7
traditional 12.5
heritage 11.6
prayer 11.6
meditation 11.5
artistic 11.3
memorial 11.3
museum 11.2
golden 11.2
plastic art 11
helmet 10.7
worship 10.6
spirituality 10.6
faith 10.5
fountain 10.4
peace 10.1
pray 9.7
spiritual 9.6
capital 9.5
face 9.2
statues 8.9
roman 8.8
sacred 8.8
palace 8.7
gold 8.2
carved 7.8
world 7.7
armor plate 7.6
head 7.6
decorative 7.5
bust 7.5
exterior 7.4
china 7.2

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

clothing 98
text 95.5
person 94.2
hat 87
smile 83.8
human face 82.4
man 73.5
fashion accessory 71.7
vintage clothing 59.7
posing 52.9
retro style 51.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 54.8%
Disgusted 45%
Confused 45%
Angry 45%
Calm 55%
Sad 45%
Happy 45%
Fear 45%
Surprised 45%

AWS Rekognition

Age 4-12
Gender Female, 50.8%
Calm 54.9%
Happy 45%
Sad 45%
Disgusted 45%
Angry 45%
Surprised 45%
Confused 45%
Fear 45%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Painting 76.6%
Suit 64.5%
Chair 54%

Categories