Human Generated Data

Title

Untitled (portrait of a couple)

Date

1866-1899

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3260

Human Generated Data

Title

Untitled (portrait of a couple)

People

Artist: Unidentified Artist,

Date

1866-1899

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Clothing 99.8
Apparel 99.8
Human 98.7
Person 98.7
Person 98.3
Overcoat 93.6
Art 65.6
Photography 63.1
Photo 63.1
Face 63.1
Portrait 63.1
Suit 56.6
Cloak 55.5
Fashion 55.5
Coat 54.5

Clarifai
created on 2019-11-10

people 99.7
retro 96
two 94.8
wear 94.1
man 93.6
adult 93
leader 89
group 87.8
woman 85.4
nostalgia 84.8
administration 83.6
elderly 82.1
military 79.9
three 79.2
one 77.9
portrait 77
outfit 72.6
art 70.7
child 69.6
four 68.9

Imagga
created on 2019-11-10

kin 66.3
groom 33.9
military uniform 27.4
people 25.7
couple 25.3
man 24.9
clothing 22.2
portrait 21.4
uniform 21
person 20.3
bride 20.3
dress 19
wedding 18.4
adult 18.2
love 18.1
old 16.7
happy 16.3
religion 16.1
male 15.7
statue 15.4
suit 15.2
happiness 14.1
two 13.6
family 13.3
business 12.7
marriage 12.3
smile 12.1
ancient 12.1
covering 12.1
men 12
consumer goods 11.7
smiling 11.6
sculpture 11.5
married 11.5
fashion 11.3
monument 11.2
businessman 10.6
cheerful 10.6
antique 10.4
bouquet 10.4
celebration 10.4
church 10.2
architecture 10.2
world 9.9
human 9.7
office 9.6
culture 9.4
religious 9.4
stone 9.3
vintage 9.1
holding 9.1
wed 8.8
black 8.8
veil 8.8
gown 8.7
women 8.7
wife 8.5
face 8.5
art 8.5
senior 8.4
executive 8.4
mother 8.4
park 8.2
outdoors 8.2
new 8.1
history 8.1
romantic 8
posing 8
building 7.9
hair 7.9
bridal 7.8
sepia 7.8
attractive 7.7
expression 7.7
youth 7.7
formal 7.6
historical 7.5
one 7.5
closeup 7.4
symbol 7.4
aged 7.2
decoration 7.2
catholic 7.2
work 7.1
together 7
modern 7

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

text 97.7
clothing 97.2
person 92.9
old 90.2
dress 78.1
smile 76
vintage clothing 73
suit 68.3
photograph 61.4
retro style 57.5
posing 52.4
man 51.5
vintage 33.5
picture frame 6.1

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 98%
Happy 0.2%
Sad 2.1%
Fear 0%
Confused 0.3%
Angry 0.5%
Calm 96.7%
Surprised 0%
Disgusted 0.1%

AWS Rekognition

Age 15-27
Gender Female, 54.2%
Fear 45%
Angry 45.1%
Confused 45%
Surprised 45%
Disgusted 45%
Happy 45.1%
Calm 54.1%
Sad 45.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Suit 56.6%
Coat 54.5%

Captions

Microsoft

a vintage photo of a person 88.8%
a vintage photo of a man and a woman posing for a picture 73%
a vintage photo of a person in a suit and tie 72.9%