Human Generated Data

Title

Untitled (bride and groom)

Date

1880s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3398

Human Generated Data

Title

Untitled (bride and groom)

People

Artist: Unidentified Artist,

Date

1880s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 98.8
Human 98.8
Clothing 93
Apparel 93
Person 92.9
Painting 79.9
Art 79.9
Overcoat 69.1
Coat 69.1
Wood 62.4
Sitting 60.2
Floor 56.3

Imagga
created on 2022-01-09

statue 44.1
ruler 33.8
sculpture 33.7
ancient 25.9
old 25.8
religion 25.1
architecture 22.7
art 22.5
monument 22.4
stone 22
kin 21.8
history 21.5
travel 21.1
historical 17.9
temple 17.4
tourism 17.3
culture 17.1
religious 16.9
famous 16.7
historic 16.5
building 15.1
throne 14.6
city 14.1
groom 12.8
landmark 12.6
chair of state 11.7
god 11.5
chair 11.2
tourist 11
antique 11
traditional 10.8
uniform 10.7
marble 10.7
people 10.6
golden 10.3
military uniform 10.2
clothing 9.9
dress 9.9
soldier 9.8
catholic 9.7
heritage 9.7
palace 9.6
vintage 9.1
detail 8.8
sacred 8.8
man 8.7
pray 8.7
worship 8.7
spiritual 8.6
face 8.5
figure 8.4
color 8.3
world 8.3
decoration 8
army 7.8
prayer 7.7
spirituality 7.7
church 7.4
lady 7.3
person 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

clothing 97
text 95.4
person 90.6
old 85.9
dress 69.3
photograph 61.2
woman 60.4
man 54.4
posing 52.1
vintage 28

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 65.4%
Calm 99.1%
Confused 0.3%
Sad 0.3%
Angry 0.2%
Happy 0.1%
Surprised 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 99.3%
Confused 0.2%
Sad 0.1%
Angry 0.1%
Surprised 0.1%
Happy 0.1%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Painting 79.9%

Captions

Microsoft

a vintage photo of a man and woman posing for a picture 77%
a vintage photo of a person 76.9%
a vintage photo of a man and a woman posing for a picture 76.8%

Text analysis

Amazon

and