Human Generated Data

Title

Untitled (full-length portrait of baby holding onto back of a small chair, standing on a textile-covered table)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.12928

Human Generated Data

Title

Untitled (full-length portrait of baby holding onto back of a small chair, standing on a textile-covered table)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Human 97.5
Person 97.5
Clothing 95.1
Apparel 95.1
Bonnet 93.1
Hat 93.1
Furniture 76.2
Painting 72.8
Art 72.8

Imagga
created on 2022-01-24

religion 18.8
old 18.1
art 16.6
person 16.3
culture 15.4
statue 14.8
device 13.1
phonograph record 13
ancient 13
portrait 12.9
male 12.8
face 12.8
man 12.8
electric chair 12.7
religious 12.2
golden 12
percussion instrument 11.3
people 10.6
antique 10.4
black 10.2
wheeled vehicle 10.2
instrument of execution 10.1
traditional 10
adult 9.8
musical instrument 9.7
prayer 9.6
god 9.6
sculpture 9.4
historical 9.4
wall 9.4
stone 9.4
head 9.2
decoration 9
retro 9
steel drum 8.9
instrument 8.8
temple 8.7
pray 8.7
architecture 8.6
travel 8.4
child 8.4
machine 8.4
vintage 8.3
holding 8.2
tourism 8.2
gramophone 8.2
aged 8.1
home 8
vehicle 7.9
vessel 7.7
spiritual 7.7
spirituality 7.7
one 7.5
dress 7.2

Google
created on 2022-01-24

Rectangle 84.4
Baby 78.9
Vintage clothing 75.9
Sleeve 74.3
Tints and shades 74.2
Art 70.4
Antique 65
Sitting 64.7
Room 63.5
Toddler 58.9
Retro style 57.3
Visual arts 56.9
Classic 54.6
Still life photography 50.8
History 50.6

Microsoft
created on 2022-01-24

text 95.5
child 93.1
person 92.2
clothing 91.4
toddler 89.7
indoor 88.4
human face 86.9
baby 84.3
boy 83.1
black 69
old 66.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 98.2%
Sad 64.7%
Calm 31.9%
Surprised 1.4%
Fear 0.5%
Angry 0.5%
Disgusted 0.4%
Happy 0.3%
Confused 0.3%

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%
Painting 72.8%

Captions

Microsoft

a vintage photo of a boy 66.5%
a vintage photo of a person 66.4%
a vintage photo of a person 66.3%