Human Generated Data

Title

Untitled (portrait of two women)

Date

1860s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2686

Human Generated Data

Title

Untitled (portrait of two women)

People

Artist: Unidentified Artist,

Date

1860s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2686

Machine Generated Data

Tags

Amazon
created on 2023-10-23

Clothing 100
Hat 100
Adult 98.4
Male 98.4
Man 98.4
Person 98.4
Bonnet 97.9
Person 97
Face 95.6
Head 95.6
Lady 89.5
Art 76.1
Painting 76.1
Photography 68.1
Portrait 68.1
Military 61.6
Military Uniform 57.8
Coat 57.6

Clarifai
created on 2018-08-20

people 99.9
two 99.2
portrait 98.8
wear 98.7
adult 97.9
child 97.3
facial expression 97.3
woman 95.3
outfit 95.1
group 94.2
son 93.3
veil 92.6
art 92.5
actress 91.1
three 90.8
one 90.6
costume 88.7
offspring 88.4
furniture 88.1
theater 87.5

Imagga
created on 2018-08-20

man 36.3
adult 33.9
male 31.6
person 31.2
couple 29.6
people 29.6
portrait 29.1
fashion 24.9
love 22.1
mother 21.6
attractive 20.3
happy 20
dress 18.1
two 17.8
parent 17.1
happiness 16.4
face 16.3
model 15.6
sexy 15.3
adolescent 15
together 14.9
style 14.8
business 14.6
smiling 14.5
lifestyle 14.5
family 14.2
businessman 14.1
suit 14
relationship 14
pretty 14
youth 13.6
hair 13.5
handsome 13.4
romantic 13.4
brother 13.1
groom 13
juvenile 13
cute 12.9
human 12.7
black 12.7
women 12.6
child 12.6
clothing 12.3
lady 12.2
boy 12.2
looking 12
home 12
holding 11.6
posing 11.5
cheerful 11.4
men 11.2
casual 11
elegance 10.9
dark 10.9
kin 10.7
romance 10.7
smile 10.7
girlfriend 10.6
loving 10.5
fun 10.5
brunette 10.5
tie 10.4
standing 10.4
expression 10.2
husband 10
professional 9.8
hugging 9.7
success 9.7
boyfriend 9.6
executive 9.4
passion 9.4
makeup 9.1
vintage 9.1
businesswoman 9.1
retro 9
father 8.9
couch 8.7
married 8.6
sitting 8.6
elegant 8.6
dad 8.4
manager 8.4
old 8.4
studio 8.4
indoor 8.2
sensual 8.2
sensuality 8.2
pose 8.2
sibling 8.1
modern 7.7
desire 7.7
bride 7.7
adults 7.6
joy 7.5
room 7.4
wedding 7.4
son 7.2
bow tie 7.2
interior 7.1

Google
created on 2018-08-20

Microsoft
created on 2018-08-20

person 99
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Female, 100%
Calm 80.5%
Surprised 6.7%
Fear 6.2%
Sad 5.9%
Angry 3.4%
Confused 3%
Happy 2.5%
Disgusted 1.6%

AWS Rekognition

Age 16-22
Gender Female, 67%
Calm 96.1%
Surprised 6.4%
Fear 5.9%
Sad 2.9%
Confused 0.4%
Angry 0.4%
Happy 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 98.4%
Male 98.4%
Man 98.4%
Person 98.4%

Captions