Human Generated Data

Title

Untitled (two unidentified women holding large pestles, mortar on floor)

Date

1860-1899

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.329.17

Human Generated Data

Title

Untitled (two unidentified women holding large pestles, mortar on floor)

People

Artist: Unidentified Artist,

Date

1860-1899

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 99.6
Human 99.6
Person 99.4
People 87.5
Clothing 87.3
Apparel 87.3
Shorts 85.6
Bucket 76.1
Sport 72.3
Sports 72.3
Cricket 67.6
Team 59.7
Team Sport 59.7

Imagga
created on 2022-02-25

shovel 33.2
hand tool 32.3
tool 30.7
stick 27.2
crutch 25.7
staff 21
grunge 16.2
old 16
wall 15.4
dark 14.2
black 13.2
paper 12.4
plunger 11.5
people 11.2
building 11.1
vintage 10.7
texture 10.4
body 10.4
person 10.3
concrete 9.6
antique 9.5
drumstick 9.4
water 8.7
ancient 8.6
empty 8.6
stone 8.5
structure 8.1
man 8.1
close 8
chair 7.9
art 7.9
grungy 7.6
light 7.4
retro 7.4
aged 7.2
dirty 7.2
history 7.2
male 7.1
surface 7.1
cleaning implement 7

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

text 98.7
food 91.3
person 90.7
clothing 90.1
white 82.6
black 78.6
old 76.4
posing 56.5
vintage 33.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Female, 58.4%
Calm 99.1%
Sad 0.4%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%
Happy 0%

AWS Rekognition

Age 13-21
Gender Male, 99.9%
Calm 94.3%
Sad 3.2%
Confused 0.6%
Fear 0.5%
Disgusted 0.5%
Angry 0.5%
Surprised 0.3%
Happy 0.1%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a vintage photo of a person 66.6%
a vintage photo of a person 64.8%
a vintage photo of a man and a woman posing for a picture 30.4%