Human Generated Data

Title

Untitled (full-length portrait of two boys seated in chairs against a painted backdrop)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.12889

Human Generated Data

Title

Untitled (full-length portrait of two boys seated in chairs against a painted backdrop)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.12889

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Clothing 99.9
Apparel 99.9
Person 98.7
Human 98.7
Person 97.9
Footwear 95
Furniture 90.4
Boot 81.2
Chair 80.4
Shoe 79
Face 75.4
People 69.1
Couch 67.9
Sitting 67.6
Painting 63.4
Art 63.4
Portrait 62.4
Photography 62.4
Photo 62.4
Kid 55.8
Child 55.8

Clarifai
created on 2023-10-27

people 100
child 99.7
portrait 99
son 98.2
group 98.1
wear 97.8
two 97
adult 95.1
art 94.9
man 94.9
outfit 93.7
offspring 92.5
retro 91.4
sit 90.8
military 90.5
three 89.8
boy 88.9
uniform 88.6
administration 87.6
family 87.5

Imagga
created on 2022-01-24

child 77.9
kin 46
family 42.7
happy 30.1
mother 29
love 27.6
kid 27.5
people 27.3
childhood 26.9
happiness 26.6
portrait 25.9
person 23.8
smiling 23.1
little 23
cute 23
plaything 22.7
baby 22
sibling 21.3
daughter 21.1
parent 21
man 20.8
father 20.1
male 20.1
face 19.9
cheerful 18.7
home 18.4
lifestyle 18.1
old 17.4
boy 17.4
children 17.3
doll 16.4
fun 15.7
casual 15.3
smile 15
together 14.9
girls 14.6
joy 14.2
clothing 13.7
teddy 13.6
loving 13.4
couple 13.1
adult 12.9
military uniform 12.9
holding 12.4
togetherness 12.3
kids 12.2
senior 12.2
adorable 12
son 11.6
park 11.5
husband 11.5
outdoors 11.2
two 11
uniform 10.8
juvenile 10.7
interior 10.6
brother 10.5
life 10.4
youth 10.2
playing 10
human 9.7
mid adult 9.7
antique 9.5
eyes 9.5
mature 9.3
innocent 9.2
dad 9.2
vintage 9.1
care 9.1
dress 9
granddaughter 8.9
group 8.9
grandmother 8.8
looking 8.8
affectionate 8.7
ancient 8.7
enjoying 8.5
laughing 8.5
one 8.2
religion 8.1
holiday 7.9
standing 7.8
newborn 7.8
gift 7.7
infant 7.7
pretty 7.7
attractive 7.7
culture 7.7
innocence 7.7
offspring 7.7
playful 7.6
head 7.6
enjoy 7.5
enjoyment 7.5
blond 7.4
indoor 7.3
color 7.2
black 7.2
lovely 7.1

Google
created on 2022-01-24

Head 97.2
Hairstyle 95.1
Chair 85.9
Vintage clothing 76.9
Toddler 70.2
Child 69.1
Classic 67.7
Boot 65.9
History 65.8
Sitting 65.1
Art 64.1
Stock photography 63.7
Uniform 63.1
Picture frame 60.4
Oval 60.4
Collar 60.1
Retro style 57.1
Baby 54.9
Family 52.4
Sibling 51.5

Microsoft
created on 2022-01-24

text 98.9
clothing 98
person 97.3
human face 92.9
boy 92.9
black 92.6
child 91.7
smile 88.7
toddler 87.4
old 87
vintage 67.7
photograph 61
white 60.2
baby 53.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-12
Gender Male, 90.4%
Calm 98.5%
Angry 1%
Confused 0.2%
Sad 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 1-7
Gender Female, 88.8%
Angry 44.5%
Sad 28%
Calm 22%
Confused 2.7%
Surprised 1.3%
Fear 0.9%
Happy 0.4%
Disgusted 0.3%

Microsoft Cognitive Services

Age 17
Gender Male

Microsoft Cognitive Services

Age 4
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 98.7%
Person 97.9%
Painting 63.4%

Categories

Imagga

people portraits 98.6%
paintings art 1.3%