Human Generated Data

Title

Untitled (native servants Kans-amah and Khidmutgar)
Date

1862-1863
People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.27

Human Generated Data

Title

Untitled (native servants Kans-amah and Khidmutgar)

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Date

1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.27

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 100
Apparel 100
Person 99.3
Human 99.3
Person 98.1
Female 93.7
Turban 93.7
Headband 93.7
Hat 93.7
Woman 81.1
People 77.9
Sleeve 73.7
Face 73
Dress 71.1
Portrait 68.7
Photography 68.7
Photo 68.7
Costume 67.7
Evening Dress 61.1
Fashion 61.1
Gown 61.1
Robe 61.1
Girl 61
Linen 55.8
Home Decor 55.8
Wood 55.8

Clarifai
created on 2023-10-26

people 99.9
two 99.3
woman 98.8
portrait 98.4
three 98.4
child 98
wear 97.5
lid 96.8
family 96.3
man 95.1
adult 94.9
four 94.7
retro 94
son 92.3
sibling 92
offspring 88.4
documentary 87.6
facial expression 87.5
veil 87.3
group 86.9

Imagga
created on 2022-01-23

bride 39.3
wedding 33.1
dress 31.6
people 27.9
person 27.7
adult 27.5
happiness 27.4
happy 25.1
bouquet 25
couple 24.4
love 23.7
groom 21.4
portrait 21.3
gown 20.3
male 20
man 19.5
married 19.2
marriage 18
rustic 17.7
clothing 17.3
life 17.3
smile 16.4
mother 16
fashion 15.8
human 15.7
lady 15.4
attractive 15.4
women 15
smiling 14.5
two 14.4
elegance 14.3
celebration 13.6
flowers 13
veil 12.7
bridal 12.6
standing 12.2
ceremony 11.6
lifestyle 11.6
parent 11.5
clothes 11.2
pretty 11.2
men 11.2
holding 10.7
family 10.7
face 10.7
hand 10.6
engagement 10.6
cheerful 10.6
together 10.5
wife 10.4
outfit 10.3
husband 10.3
fan 10
flower 10
old 9.8
health 9.7
nurse 9.7
sexy 9.6
looking 9.6
day 9.4
senior 9.4
model 9.3
church 9.2
care 9
romantic 8.9
wed 8.8
healthy 8.8
home 8.8
hair 8.7
summer 8.4
joy 8.3
20s 8.2
follower 8.1
romance 8
interior 8
holiday 7.9
brunette 7.8
hands 7.8
pair 7.6
traditional 7.5
tradition 7.4
room 7.4
indoor 7.3
blond 7.2
lovely 7.1
posing 7.1

Google
created on 2022-01-23

Outerwear 95.2
Hairstyle 95.1
Sleeve 87.2
Headgear 81.1
One-piece garment 77
Vintage clothing 76.3
Classic 69.8
Uniform 66.3
Stock photography 65.3
History 63.1
Pattern 62.5
Hat 60.3
Fashion design 58.1
Day dress 58
Retro style 56.8
Art 56.3
Paper product 56.1
Monochrome 55.2
A-line 53.1
Family 51.5

Microsoft
created on 2022-01-23

person 99.9
dress 99.2
clothing 98.1
text 96.5
old 95.7
outdoor 95.2
woman 95.1
smile 89.5
vintage clothing 82.7
fashion 82.3
standing 81.8
skirt 77.3
retro style 77
white 75.3
black 72.2
posing 71.9
footwear 62.5
human face 55.1
vintage 41.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 99.5%
Calm 97.8%
Fear 1.4%
Confused 0.2%
Angry 0.2%
Sad 0.1%
Surprised 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 34-42
Gender Male, 99.7%
Calm 98.3%
Surprised 0.4%
Fear 0.3%
Angry 0.3%
Sad 0.2%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Categories

Imagga

people portraits 96.7%
paintings art 3.1%