Human Generated Data

Title

Untitled (portrait of boy standing in front of painted backdrop with man partly visible at right)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13839

Human Generated Data

Title

Untitled (portrait of boy standing in front of painted backdrop with man partly visible at right)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13839

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 96.2
Human 96.2
Art 87.1
Chair 84.7
Furniture 84.7
Clothing 76.6
Apparel 76.6
Painting 74.7
Shoe 71.7
Footwear 71.7
Floor 69.9
Portrait 69.3
Photography 69.3
Face 69.3
Photo 69.3
Wood 59.8
Shoe 58.8
Baby 58.3
Sitting 56.1

Clarifai
created on 2023-10-27

people 99.5
art 99.1
child 97.7
one 97.4
portrait 97.3
son 96.2
wear 94.5
painting 92.8
man 92.7
retro 91.7
boy 90.5
old 89.5
music 89.1
two 84.3
adult 84.2
vintage 83.6
woman 81.2
illustration 79.9
girl 79.4
street 79.4

Imagga
created on 2022-01-28

person 22.1
clothing 22
fashion 20.4
portrait 20.1
people 18.4
statue 17.8
child 16.6
interior 15.9
adult 15.6
dress 15.4
man 14.8
hat 14.7
sculpture 14.6
garment 13.7
family 13.4
cowboy hat 13.2
historical 13.2
lady 13
ancient 13
male 12.9
home 12.8
house 12.5
room 12.4
face 12.1
old 11.9
model 11.7
city 11.6
sexy 11.2
one 11.2
art 11.1
style 11.1
headdress 11.1
casual 11
historic 11
jean 10.9
covering 10.8
happy 10.7
attractive 10.5
boy 10.4
clothes 10.3
luxury 10.3
religion 9.9
building 9.8
posing 9.8
kid 9.8
human 9.8
mother 9.6
son 9.5
black 9.3
elegance 9.2
pretty 9.1
hair 8.7
antique 8.7
architecture 8.6
religious 8.4
monument 8.4
vintage 8.3
apparel 8.2
fun 8.2
consumer goods 8.2
history 8.1
looking 8
lifestyle 8
indoors 7.9
urban 7.9
smile 7.8
outfit 7.7
god 7.7
decoration 7.6
device 7.5
world 7.5
traditional 7.5
trouser 7.3
indoor 7.3
sensuality 7.3
make 7.3
cute 7.2
travel 7
look 7

Google
created on 2022-01-28

Table 87.3
Art 82.3
Wood 80.8
Painting 79
Tints and shades 77.2
Toddler 76.7
Rectangle 73.6
Vintage clothing 73.2
Room 69.9
Visual arts 67.3
Illustration 67.2
Drawing 65.7
Paper product 64.2
Stock photography 63.6
Pattern 57.4
Antique 54.6
History 53.2
Child 51.5
Sitting 50.2
Photographic paper 50.2

Microsoft
created on 2022-01-28

drawing 94.4
cartoon 87.5
clothing 84.9
painting 82.2
sketch 81
text 67.9
child 67.1
person 65
old 52.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 99.9%
Calm 80.7%
Angry 9.1%
Happy 3%
Sad 2.4%
Confused 1.8%
Disgusted 1.4%
Surprised 0.8%
Fear 0.7%

Microsoft Cognitive Services

Age 1
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Shoe
Person 96.2%
Painting 74.7%
Shoe 71.7%
Shoe 58.8%

Categories

Imagga

streetview architecture 61.8%
paintings art 38%