Human Generated Data

Title

Sarah Stevenson Harrison (wife of Gabriel Harrison) and her children
Date

c. 1857
People

Artist: Mathew B. Brady & Studio, American active 1844 - 1895
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 2010.43

Human Generated Data

Title

Sarah Stevenson Harrison (wife of Gabriel Harrison) and her children

People

Artist: Mathew B. Brady & Studio, American active 1844 - 1895

Date

c. 1857

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 98.6
Human 98.6
Person 98.3
Person 94.7
Person 94.5
Clothing 92.2
Apparel 92.2
Texture 90.2
Performer 85.5
Painting 84.9
Art 84.9
Dress 79.8
People 74.3
Female 71.8
Portrait 64.8
Photography 64.8
Photo 64.8
Face 64.8
Leisure Activities 62.6
Polka Dot 59.4
Costume 58.9
Dance 56.6
Woman 56.1
Dance Pose 55

Imagga
created on 2022-01-09

dress 55.1
kin 47.8
groom 38
bride 35.5
wedding 29.4
couple 28.7
fashion 27.1
portrait 26.5
people 26.2
love 24.4
clothing 23.6
adult 23.5
costume 23.4
person 23.1
happiness 22.7
attractive 21.7
happy 20.7
face 20.6
bouquet 19.8
marriage 19
man 18.8
elegance 16.8
black 16.5
married 16.3
lady 15.4
gown 15.1
bridal 14.6
posing 14.2
traditional 14.1
style 14.1
clothes 14
model 14
culture 13.7
celebration 13.5
smile 13.5
flowers 13
robe 12.8
veil 12.7
romantic 12.5
garment 12.4
male 12.1
sexy 12
two 11.9
old 11.8
pose 11.8
flower 11.5
hair 11.1
kimono 11
make 10.9
pretty 10.5
art 10.2
lifestyle 10.1
holding 9.9
commitment 9.8
wed 9.8
romance 9.8
together 9.6
wife 9.5
party 9.5
smiling 9.4
church 9.2
husband 9.2
mother 9
new 8.9
family 8.9
masquerade 8.9
carnival 8.7
ceremony 8.7
standing 8.7
engagement 8.7
cute 8.6
hairstyle 8.6
luxury 8.6
performer 8.6
elegant 8.6
studio 8.4
blond 8.3
makeup 8.2
park 8.2
outdoors 8.2
dancer 8.1
women 7.9
matrimony 7.9
brunette 7.8
theater 7.8
outfit 7.7
formal 7.6
loving 7.6
fashionable 7.6
head 7.6
dark 7.5
vintage 7.4
mature 7.4
emotion 7.4
cheerful 7.3
stylish 7.2
ruler 7.1
handsome 7.1
mask 7.1
day 7.1
look 7

Google
created on 2022-01-09

Hairstyle 95.1
Photograph 94.2
Fashion 88
Sleeve 87.2
Standing 86.4
Victorian fashion 79.9
hoopskirt 78.3
Classic 77.8
One-piece garment 77.5
Vintage clothing 76
Snapshot 74.3
Formal wear 74.2
Event 71.8
Fashion design 70.9
History 65.5
Stock photography 64.4
Pattern 62.6
Retro style 58
Monochrome 56.6
Costume design 55.8

Microsoft
created on 2022-01-09

text 97.4
person 97.3
dress 93.2
clothing 92.9
sport 86.2
dance 85.4
dancer 81.4
posing 77.6
old 77.4
smile 74.2
white 73.8
woman 71.7
black 70.7
people 70.2
costume design 57.5
vintage 42.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 7-17
Gender Male, 51.9%
Calm 99.5%
Sad 0.2%
Confused 0.1%
Surprised 0.1%
Angry 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 11-19
Gender Female, 100%
Calm 97.6%
Sad 1.6%
Confused 0.3%
Angry 0.2%
Surprised 0.2%
Happy 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 12-20
Gender Female, 79.4%
Calm 93.4%
Sad 6.1%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 27-37
Gender Female, 100%
Calm 77.8%
Angry 15%
Sad 3.8%
Confused 2.2%
Surprised 0.5%
Fear 0.3%
Happy 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Painting 84.9%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 95.9%
a vintage photo of a group of people posing for a picture 95.8%
a group of people posing for a photo 95.7%

Text analysis

Google

<-DIe
<-DIe