Human Generated Data

Title

Untitled (full-length portrait of boy standing in front of painted backdrop depicting flower-filled meadow)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.14040

Human Generated Data

Title

Untitled (full-length portrait of boy standing in front of painted backdrop depicting flower-filled meadow)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 99.5
Person 99.5
Art 78.8
Face 77.8
Boy 76
Painting 71.6
Photo 62.1
Portrait 62.1
Photography 62.1
Child 58.6
Kid 58.6

Imagga
created on 2022-01-28

child 71.4
bow tie 30
necktie 23.8
portrait 23.3
man 22.2
family 21.4
people 21.2
male 21.2
world 21.2
mother 20.7
happiness 20.4
happy 18.2
parent 17.8
face 17.8
person 16.8
cute 15.8
love 15.8
boy 15.7
father 15.6
adult 15.5
smiling 14.5
black 14.4
childhood 14.3
youth 13.6
kid 13.3
sibling 12.6
garment 12
outdoors 11.9
juvenile 11.9
old 11.9
dad 11.8
statue 11.4
together 11.4
couple 11.3
girls 10.9
sepia 10.7
human 10.5
baby 10.3
lifestyle 10.1
son 10
smile 10
attractive 9.8
daughter 9.8
sculpture 9.6
antique 9.5
ancient 9.5
clothing 9.3
children 9.1
blond 9.1
religion 9
lady 8.9
little 8.8
body 8.8
home 8.8
husband 8.6
culture 8.6
joy 8.4
health 8.3
holding 8.3
park 8.2
fun 8.2
one 8.2
kin 8.2
brother 8.2
cheerful 8.1
looking 8
summer 7.7
loving 7.6
casual 7.6
hand 7.6
stone 7.6
historical 7.5
dark 7.5
relationship 7.5
vintage 7.4
adorable 7.4
dress 7.2

Google
created on 2022-01-28

Plant 81.6
Tints and shades 77.3
Art 77.1
Vintage clothing 76.4
Toddler 75.4
Wood 67.3
Sleeve 66.3
Visual arts 64.8
Grass 64.7
Room 63.4
Stock photography 63.3
Picture frame 61.6
Child 59.4
Portrait 58.5
Sitting 58.1
Tree 57.6
History 57
Paper product 55.6
Rectangle 54.1
Retro style 53.7

Microsoft
created on 2022-01-28

person 99.3
posing 97.9
clothing 97.8
standing 97.4
human face 97
text 96.9
boy 96
toddler 93.3
young 92.4
little 89.8
baby 86.9
old 86.1
black 84
child 80.2
white 66.1
smile 65
girl 50.6
vintage 47.5
dressed 28.6
clothes 28.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-12
Gender Female, 100%
Calm 97.7%
Sad 1.2%
Confused 0.3%
Surprised 0.2%
Happy 0.2%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 11
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 71.6%

Captions

Microsoft

a vintage photo of a little girl posing for a picture 93.8%
a vintage photo of a little boy posing for a picture 91.7%
a vintage photo of a little girl posing for a photo 91.6%