Human Generated Data

Title

Untitled (hermaphrodites)
Date

1862-1863
People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.24

Human Generated Data

Title

Untitled (hermaphrodites)

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Date

1862-1863

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.3
Human 99.3
Person 98.3
Person 97.8
Clothing 97.7
Apparel 97.7
Person 97.3
Person 97.2
Painting 87.4
Art 87.4
Sari 84.8
Silk 84.8
People 83.8
Archaeology 77.7
Architecture 67.1
Building 67.1
Sitting 57.3
Turban 56.5
Hat 56.5
Headband 56.5

Imagga
created on 2022-01-23

architecture 49.9
altar 41.9
ruler 40.8
monument 38.3
sculpture 36
old 34.9
structure 34.2
building 34.1
tourism 33.9
ancient 33.8
religion 32.3
history 31.3
stone 30.7
statue 29.8
travel 28.2
landmark 27.1
church 25.9
historical 24.5
historic 23.9
art 23.3
city 23.3
temple 22.8
famous 22.4
arch 22
culture 20.5
column 20.5
tourist 19.3
cathedral 17.9
religious 16.9
marble 15.5
palace 14.6
holy 12.5
spirituality 12.5
facade 12.5
god 12.5
attraction 12.4
monastery 12.2
catholic 12.1
exterior 12
metropolitan 11.2
prayer 10.6
antique 10.4
place 10.3
traditional 10
worship 9.7
heritage 9.7
town 9.3
fountain 9.2
statues 8.9
detail 8.9
interior 8.9
columns 8.8
roman 8.8
pray 8.7
spiritual 8.6
faith 8.6
carving 8.6
door 8.6
vacation 8.2
prayer rug 8
scene 7.8
ruin 7.8
past 7.8
architectural 7.7
house 7.5
vintage 7.5
gold 7.4
inside 7.4
color 7.2

Google
created on 2022-01-23

Adaptation 79.4
Tints and shades 77.4
Vintage clothing 75.5
Room 70
Visual arts 68.1
History 67.2
Holy places 65.3
Arch 64.3
Classic 63.9
Event 62.5
Stock photography 61.8
Monochrome 58.1
Art 57.9
Ancient history 52.5

Microsoft
created on 2022-01-23

clothing 99.2
building 99.1
person 98.2
outdoor 96.1
old 95.4
woman 82.8
white 69.7
vintage 53.2
colonnade 17.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Female, 65.9%
Calm 81.4%
Confused 7.3%
Surprised 2.8%
Happy 2.5%
Sad 1.8%
Angry 1.8%
Disgusted 1.4%
Fear 1.1%

AWS Rekognition

Age 22-30
Gender Female, 82.5%
Calm 97.3%
Sad 2.1%
Fear 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0%

AWS Rekognition

Age 29-39
Gender Male, 99.1%
Calm 99%
Angry 0.3%
Sad 0.2%
Surprised 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 18-24
Gender Female, 100%
Sad 89.8%
Fear 4.2%
Calm 3.2%
Angry 1%
Surprised 0.6%
Disgusted 0.5%
Confused 0.4%
Happy 0.2%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 25
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.3%
Painting 87.4%

Captions

Microsoft

a vintage photo of a group of people standing in front of a building 84.3%
a vintage photo of an old building 84.2%
a vintage photo of some people that are standing in front of a building 81.3%