Human Generated Data

Title

Scott Sisters, Reading, Mass.

Date

1910s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2777

Human Generated Data

Title

Scott Sisters, Reading, Mass.

People

Artist: Unidentified Artist,

Date

1910s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2777

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.2
Human 99.2
Person 98.4
Person 97.2
Painting 96.2
Art 96.2
Person 86.5
People 65.6
Symbol 60.6
Person 43.2

Clarifai
created on 2023-10-25

people 99.9
portrait 98.6
group 97.9
wedding 97.7
adult 97.2
woman 96.9
two 96.8
child 96.7
man 95.8
offspring 94.7
wear 94
actress 92.7
family 91.3
son 90.6
three 89.7
art 89.4
dress 89.2
sepia 88.4
outfit 88.2
actor 88.2

Imagga
created on 2022-01-08

statue 93.7
sculpture 46.3
column 42.6
art 29.2
architecture 28.6
monument 28
religion 26
old 23.7
building 22.3
city 21.6
church 20.4
marble 20
history 19.7
catholic 19.5
god 19.2
tourism 19
landmark 19
stone 18.6
historic 18.3
ancient 17.3
saint 16.4
holy 15.4
culture 15.4
antique 15.1
detail 14.5
religious 14.1
famous 14
faith 13.4
fountain 13.3
travel 12.7
palace 12.6
tourist 11.8
dress 11.8
spiritual 11.5
attraction 11.5
symbol 11.5
capital 11.4
historical 11.3
cathedral 11.2
sky 10.9
figure 10.4
carving 10.3
museum 10.2
structure 9.9
pray 9.7
cross 9.4
roman 9.2
bronze 8.9
arch 8.7
prayer 8.7
outdoor 8.4
decoration 8.1
angel 7.8
face 7.8
king 7.8
st 7.8
facade 7.7
vintage 7.4
design 7.3

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

person 96.6
text 89.1
clothing 87.4
painting 82.4
posing 72.1
woman 50.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-20
Gender Female, 100%
Calm 92%
Angry 2.1%
Confused 2%
Sad 1.8%
Disgusted 0.7%
Surprised 0.6%
Fear 0.5%
Happy 0.3%

AWS Rekognition

Age 16-24
Gender Male, 99.7%
Calm 99.9%
Sad 0%
Confused 0%
Surprised 0%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 19-27
Gender Female, 99.9%
Calm 92.3%
Sad 3.1%
Confused 2.7%
Angry 1%
Disgusted 0.4%
Surprised 0.2%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 98.7%
Sad 0.4%
Confused 0.3%
Angry 0.2%
Happy 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 20
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 96.2%

Categories

Imagga

interior objects 82%
paintings art 16.8%