Human Generated Data

Title

Untitled (portrait of couple looking at dog looking back)
Date

c. 1940
People

Artist: Paul Gittings, American 1900 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12661

Human Generated Data

Title

Untitled (portrait of couple looking at dog looking back)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-04

Apparel 100
Clothing 100
Human 99.1
Person 99.1
Person 98.3
Fashion 97
Gown 97
Robe 96.3
Wedding 95.8
Wedding Gown 94.4
Bride 94.4
Female 89.8
Kid 84
Child 84
Blonde 84
Teen 84
Woman 84
Girl 84
Animal 78
Mammal 78
Cat 78
Pet 78
Bridegroom 74.7
Canine 73.1
Dog 73.1
Face 70.8
Photo 63.2
Photography 63.2
Portrait 61.7
Sleeve 58
Suit 56.6
Overcoat 56.6
Coat 56.6
Screen 56
Electronics 56
Monitor 55.8
Display 55.8

Imagga
created on 2022-02-04

groom 100
couple 45.3
bride 43.9
man 39
wedding 38.6
male 35.5
happiness 33.7
person 32.6
happy 31.3
love 30.8
people 30.7
adult 29.8
dress 28.9
marriage 28.5
married 26.9
bouquet 26.4
handsome 24.1
two 22.9
suit 20.7
portrait 20.1
smile 20
flowers 19.1
husband 19.1
smiling 18.8
senior 18.7
businessman 18.5
wife 18
romance 17.9
looking 17.6
sitting 17.2
men 17.2
veil 16.7
together 16.7
gown 16.6
celebration 16
business 15.8
family 15.1
wed 14.7
old 14.6
relationship 14.1
attractive 14
mature 13.9
lifestyle 13.7
formal 13.4
executive 13
office 12.9
newly 12.8
women 12.7
day 12.6
romantic 12.5
elderly 12.4
cheerful 12.2
holding 11.6
flower 11.5
newlywed 11.4
face 11.4
outdoors 11.2
corporate 11.2
hair 11.1
indoor 11
matrimony 10.8
commitment 10.8
bridal 10.7
indoors 10.5
pretty 10.5
hands 10.4
pair 10.4
professional 10.2
hand 9.9
kiss 9.8
human 9.7
older 9.7
ceremony 9.7
engagement 9.7
black 9.6
computer 9.6
meeting 9.4
clothing 9.4
casual 9.3
event 9.2
new 8.9
color 8.9
tie 8.5
businesspeople 8.5
manager 8.4
worker 8.2
lady 8.1
bridegroom 7.9
table 7.8
mid adult 7.7
modern 7.7
youth 7.7
communication 7.6
togetherness 7.6
joy 7.5
one 7.5
life 7.5
group 7.3
aged 7.2
holiday 7.2
job 7.1

Google
created on 2022-02-04

Picture frame 91.1
Black 89.7
Flash photography 86.9
Style 83.9
Black-and-white 83.6
Hat 79.4
Art 78.7
Happy 75.4
Monochrome photography 75.4
Monochrome 75.4
Snapshot 74.3
Event 72.1
Vintage clothing 70.1
Stock photography 66.9
Photo caption 64.4
Sitting 64.2
Classic 63.8
Room 59.1
Font 58
Portrait photography 55.7

Microsoft
created on 2022-02-04

text 99.7
man 94.4
clothing 86
person 85.3
human face 83.4
woman 62.2
statue 55
old 45

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Female, 67.8%
Calm 93.4%
Happy 3.2%
Sad 2.1%
Confused 0.4%
Disgusted 0.3%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 95.2%
Calm 99.7%
Sad 0.2%
Disgusted 0%
Surprised 0%
Angry 0%
Happy 0%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Cat 78%
Dog 73.1%

Captions

Microsoft

a man holding a cat 78.3%
a screen shot of a man holding a cat 78.2%
a screen shot of a man with a cat 78.1%

Text analysis

Amazon

3
2
DAL
DAL 3 8 2
8