Human Generated Data

Title

Untitled (two children in front of a painted backdrop depicting ocean and sailboat)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.6

Human Generated Data

Title

Untitled (two children in front of a painted backdrop depicting ocean and sailboat)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.6

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Human 99.5
Person 99.5
Person 98.5
Art 92.6
Painting 92.6

Clarifai
created on 2023-10-30

child 99.8
people 99.8
son 99.4
boy 98.5
art 98.5
portrait 97.7
baby 97.6
lid 96.5
group 95.5
family 94.7
two 94.6
wear 93.9
three 92.5
girl 90.2
veil 89.9
offspring 89.1
man 89
woman 88.4
street 86.7
sepia 86.3

Imagga
created on 2022-05-28

kin 54
sibling 39.9
man 24.2
child 22.5
portrait 22
adult 21.3
male 20.9
sexy 20.1
black 19.8
people 19.5
person 19.2
love 18.2
mother 17.2
couple 15.7
brother 14.8
attractive 14.7
fashion 14.3
family 14.2
dress 13.6
model 13.2
body 12.8
youth 12.8
parent 12.7
hair 12.7
dark 12.5
happy 11.9
pretty 11.9
happiness 11.8
romance 11.6
face 11.4
holding 10.7
posing 10.7
human 9.7
together 9.6
looking 9.6
married 9.6
brunette 9.6
two 9.3
elegance 9.2
silhouette 9.1
vintage 9.1
sensuality 9.1
old 9.1
world 9
one 9
romantic 8.9
boy 8.7
bride 8.6
relationship 8.4
hand 8.4
room 8.2
fitness 8.1
lady 8.1
women 7.9
sepia 7.8
grunge 7.7
leisure 7.5
style 7.4
sport 7.4
wedding 7.4
father 7.2
home 7.2
look 7

Google
created on 2022-05-28

Hairstyle 95.1
Picture frame 89.7
Headgear 81.1
Art 78.6
Tints and shades 77
Vintage clothing 74.4
Painting 66.2
Uniform 66
History 64.8
Visual arts 64.2
Stock photography 63.9
Illustration 63.7
Room 58.9
Antique 55.9
Retro style 55.6
Soldier 55
Monochrome 53.6
Vintage advertisement 52.7
Military person 52
Pattern 51.2

Microsoft
created on 2022-05-28

clothing 98
person 97.6
human face 94.9
child 94.6
toddler 91
baby 89.8
old 84
boy 82.4
text 67.6
smile 65.1
stone 8.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Male, 100%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 6-16
Gender Female, 94%
Angry 59.8%
Calm 24.7%
Sad 7.4%
Fear 6.7%
Surprised 6.6%
Confused 2%
Disgusted 1.1%
Happy 0.6%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 8
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 92.6%

Categories

Imagga

paintings art 42.6%
interior objects 34.2%
streetview architecture 15.8%
events parties 4.8%

Captions

Microsoft
created on 2022-05-28

an old photo of a boy 72.3%
an old photo of a person 72.2%
old photo of a boy 65.4%