Human Generated Data

Title

Untitled (group photograph at Cumberland Lodge, c. 1868, sitters include Lady Mary Filmer; the Prince and Princess of Wales; Viscount and Viscountess Bridport; verso: three photos; Prince of Wales, George, Duke of Cambridge; Duke of Mecklenburgh)
Date

1862-1888
People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Artist: W. & D. Downey, British active 1860s-1914

Artist: Maull & Polyblank, British active 1850-1860s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.72

Human Generated Data

Title

Untitled (group photograph at Cumberland Lodge, c. 1868, sitters include Lady Mary Filmer; the Prince and Princess of Wales; Viscount and Viscountess Bridport; verso: three photos; Prince of Wales, George, Duke of Cambridge; Duke of Mecklenburgh)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Artist: W. & D. Downey, British active 1860s-1914

Artist: Maull & Polyblank, British active 1850-1860s

Date

1862-1888

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Person 98.7
Human 98.7
Person 98.6
Person 97.7
Art 97.4
Painting 97.4
Person 96.9
Person 96.7
Person 96.5
Person 95.7
Architecture 84.4
Building 84.4
Person 83.7
Person 80.5
People 76
Porch 61
Clothing 55.8
Apparel 55.8

Clarifai
created on 2018-04-19

people 99.7
adult 97
painting 96.5
group 95.9
art 94.2
one 93.3
two 92.1
wood 90.3
woman 89.8
man 89.6
wear 89.4
illustration 86.1
portrait 85.6
no person 84.6
print 83
child 82.6
religion 80.9
retro 80.7
music 80.4
leader 80.2

Imagga
created on 2018-04-19

structure 41.6
brass 39.7
memorial 35.5
architecture 33.2
old 28.5
building 27
religion 26
door 24.8
wall 23.6
art 21.4
entrance 21.2
antique 20.4
tray 20.4
historic 20.2
ancient 19.9
history 19.7
container 19.6
church 19.4
sculpture 18.9
stone 18.5
religious 16.8
window 16.8
receptacle 16.5
house 15
screen 14.4
cathedral 14.4
travel 14.1
vintage 14
tourism 14
exterior 13.8
wood 13.3
palanquin 12.8
arch 12.8
landmark 12.6
frame 12.5
decoration 12.3
protective covering 12.1
carving 12
culture 12
city 11.6
wooden 11.4
fire screen 11.3
facade 11.3
monument 11.2
traditional 10.8
saint 10.6
altar 10.5
statue 10.5
device 10.4
style 10.4
historical 10.3
litter 10.2
design 10.1
marble 10.1
box 9.8
detail 9.7
holy 9.6
god 9.6
temple 9.5
texture 9
retro 9
brown 8.8
sacred 8.8
architectural 8.6
ornament 8.6
ornate 8.2
symbol 8.1
metal 8
covering 8
conveyance 8
interior 8
doorway 7.9
catholic 7.8
glass 7.8
gate 7.8
sky 7.6
brick 7.5
pattern 7.5
balcony 7.4
famous 7.4
gold 7.4
framework 7.2

Google
created on 2018-04-19

picture frame 82
history 72.3
antique 62.8
collection 50.9

Microsoft
created on 2018-04-19

old 92.5
window 86.2
black 83.2
posing 54.2
fireplace 29.1

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 35-52
Gender Female, 54%
Surprised 45.2%
Happy 45.8%
Sad 46.5%
Confused 45.2%
Disgusted 45.1%
Angry 45.5%
Calm 51.6%

AWS Rekognition

Age 20-38
Gender Female, 53.7%
Happy 45.2%
Surprised 45.6%
Sad 45.8%
Angry 45.6%
Calm 46.4%
Disgusted 51.3%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Male, 53.4%
Surprised 45%
Happy 45.3%
Sad 45.4%
Confused 45%
Disgusted 53.6%
Angry 45.3%
Calm 45.3%

AWS Rekognition

Age 38-59
Gender Male, 54.2%
Angry 45.5%
Calm 46.9%
Sad 51.5%
Disgusted 45.6%
Surprised 45.1%
Confused 45.2%
Happy 45.2%

AWS Rekognition

Age 38-59
Gender Female, 54.7%
Calm 45%
Angry 45%
Confused 45%
Sad 45.1%
Disgusted 54.8%
Surprised 45%
Happy 45.1%

AWS Rekognition

Age 17-27
Gender Female, 53.6%
Calm 48.1%
Angry 45.4%
Disgusted 51.2%
Confused 45%
Happy 45.1%
Sad 45.1%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.4%
Angry 45.6%
Surprised 45.1%
Calm 46.7%
Sad 52.5%
Happy 45%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 30-47
Gender Male, 54.1%
Disgusted 45.1%
Confused 45.1%
Calm 51.1%
Happy 45.1%
Sad 45.5%
Surprised 45.2%
Angry 47.9%

AWS Rekognition

Age 11-18
Gender Female, 51%
Angry 45.1%
Calm 54.4%
Disgusted 45.1%
Sad 45.1%
Surprised 45.1%
Confused 45.1%
Happy 45.1%

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Surprised 45.4%
Calm 45.8%
Happy 45.3%
Sad 49.1%
Confused 45.2%
Angry 46.8%
Disgusted 47.5%

Microsoft Cognitive Services

Age 66
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 46
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 11
Gender Male

Microsoft Cognitive Services

Age 16
Gender Male

Feature analysis

Amazon

Person 98.7%
Painting 97.4%

Captions

Microsoft

a person sitting on a bench in front of a window 73.2%
a person sitting on a bench in front of a window 73.1%
a vintage photo of a person sitting on a bench 73%