Human Generated Data

Title

Untitled (seated couple in front of a paper moon)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.3

Human Generated Data

Title

Untitled (seated couple in front of a paper moon)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Person 98.5
Human 98.5
Art 95.9
Painting 93
Person 90.5

Imagga
created on 2022-05-28

person 32.8
dress 28
people 22.3
adolescent 20.1
fashion 19.6
adult 19.5
man 18.1
groom 17.6
old 17.4
juvenile 16.3
attractive 16.1
dark 15.9
outdoor 14.5
portrait 14.2
lady 13.8
male 13.5
style 13.3
model 13.2
wall 12.8
posing 12.4
body 12
love 11.8
forest 11.3
sexy 11.2
black 11
face 10.7
one 10.4
kin 10.2
light 10
sensuality 10
vintage 9.9
park 9.9
darkness 9.8
horror 9.7
fear 9.7
mother 9.4
elegance 9.2
emotion 9.2
alone 9.1
human 9
art 8.7
lifestyle 8.7
mystery 8.6
costume 8.6
tree 8.5
grunge 8.5
clothes 8.4
pretty 8.4
performer 8.3
sport 8.2
hair 7.9
demon 7.9
couple 7.8
evil 7.8
sepia 7.8
clothing 7.6
life 7.6
child 7.5
happy 7.5
outdoors 7.5
jacket 7.4
pose 7.2
fantasy 7.2
blond 7.2
religion 7.2
night 7.1
covering 7.1
dance 7.1
autumn 7
book jacket 7

Google
created on 2022-05-28

Microsoft
created on 2022-05-28

text 98
clothing 97.4
human face 95.2
person 95.2
posing 94.1
old 93.9
woman 86.4
black 83.1
standing 79.7
smile 69.3
white 65.8
retro 60.4
painting 59.1
vintage 58.4
photograph 55
clothes 19.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Female, 99.9%
Happy 40.3%
Angry 32.6%
Surprised 10.7%
Fear 7%
Calm 6.1%
Disgusted 4.6%
Sad 3.8%
Confused 2.7%

AWS Rekognition

Age 34-42
Gender Male, 99.5%
Calm 99%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.2%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Painting 93%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 94.8%
a vintage photo of a group of people posing for a picture 94.7%
a vintage photo of a man and woman posing for a picture 89.8%