Human Generated Data

Title

Untitled (portrait of woman and boy)

Date

1862-1863

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.32

Human Generated Data

Title

Untitled (portrait of woman and boy)

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Date

1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.32

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.7
Apparel 99.7
Person 98.6
Human 98.6
Person 97.9
Coat 74.8
Overcoat 70.2
Standing 70.2
Face 65.1
Stick 64.1
Portrait 64
Photography 64
Photo 64
Turban 63.6
Headband 63.6
Linen 60
Home Decor 60
Priest 55.8
Hat 51.4

Clarifai
created on 2023-10-27

people 99.9
child 98
two 97.9
wear 97.1
three 97
adult 96.7
woman 96.4
group 94.1
four 93.6
man 93.5
medical practitioner 92.7
gown (clothing) 91.9
retro 91.5
portrait 87.8
five 87.4
uniform 85.3
sibling 84.7
family 84.6
lid 84.4
facial expression 84.1

Imagga
created on 2022-01-23

bride 34.5
dress 34.3
couple 31.4
wedding 30.4
groom 29.7
person 29.2
happiness 27.4
people 27.3
happy 26.9
man 26.9
married 24.9
adult 24.6
love 24.5
male 22
marriage 21.8
bouquet 20.9
smile 20
life 19.4
flowers 17.4
portrait 16.2
celebration 15.9
fashion 15.1
gown 15
day 14.9
veil 14.7
clothing 14.6
two 14.4
face 14.2
outdoors 14.2
ceremony 13.6
white 13.3
hand 12.9
attractive 12.6
joy 12.5
romance 12.5
family 12.5
nurse 12.4
wife 12.3
smiling 12.3
cheerful 12.2
senior 12.2
church 12
human 12
women 11.9
bridal 11.7
lifestyle 11.6
together 11.4
lady 11.4
clothes 11.2
men 11.2
elegance 10.9
husband 10.9
outside 10.3
wed 9.8
looking 9.6
hair 9.5
traditional 9.1
pretty 9.1
summer 9
new 8.9
romantic 8.9
posing 8.9
kiss 8.8
model 8.6
professional 8.5
outdoor 8.4
old 8.4
park 8.2
fun 8.2
patient 8
businessman 7.9
standing 7.8
engagement 7.7
flower 7.7
youth 7.7
health 7.6
healthy 7.6
tradition 7.4
suit 7.3
blond 7.2
active 7.2
religion 7.2
bright 7.1
handsome 7.1
cool 7.1
uniform 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 99.9
clothing 99
outdoor 93.5
dress 91
text 88.6
old 85.9
woman 79.5
human face 77.6
standing 76.4
vintage clothing 63.5
smile 60.6
posing 57.6
photograph 50.6
dressed 29.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-19
Gender Female, 99.7%
Sad 94.2%
Calm 3%
Confused 2.2%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%
Happy 0%

AWS Rekognition

Age 45-51
Gender Male, 87.9%
Calm 98.5%
Sad 0.6%
Surprised 0.3%
Fear 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Happy 0%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Hat 51.4%

Categories

Imagga

paintings art 94.5%
people portraits 4.5%