Human Generated Data

Title

Untitled (in-studio full-length portrait of man, seated on tree trunk, and his dog)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13847

Human Generated Data

Title

Untitled (in-studio full-length portrait of man, seated on tree trunk, and his dog)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 99.9
Human 99.9
Dog 97.2
Mammal 97.2
Animal 97.2
Canine 97.2
Pet 97.2
Clothing 94.6
Apparel 94.6
Footwear 69.1
Painting 68.8
Art 68.8
Face 55.5
Boot 55.4

Imagga
created on 2022-01-28

dog 35.8
canine 23.5
domestic animal 18.9
person 18.5
adult 17.4
portrait 16.8
terrier 16.1
black 14.4
people 13.9
model 13.2
sport 13.2
hunting dog 12.9
pen 12.7
attractive 12.6
man 12.1
sexy 12
wall 12
fashion 11.3
fun 11.2
male 10.6
lady 10.5
one 10.4
body 10.4
pug 10.4
animals 10.2
cute 10
enclosure 10
dark 10
face 9.9
style 9.6
culture 9.4
bull 9.1
dirty 9
dress 9
farm 8.9
cool 8.9
tattoo 8.8
hair 8.7
death 8.7
skin 8.6
grunge 8.5
old 8.4
action 8.3
decoration 8.3
human 8.2
performer 8.2
dalmatian 8.2
happy 8.1
posing 8
swine 7.9
jump 7.7
head 7.6
pink 7.5
piglet 7.4
street 7.4
pet 7.3
teenager 7.3
pooch 7.3
danger 7.3
sensuality 7.3
domestic 7.2
cadaver 7.2

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 99.4
animal 96.1
dog 95.8
clothing 90
carnivore 89.8
person 88.4
mammal 64.1
old 41.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 64.6%
Angry 8.9%
Surprised 8.4%
Confused 5.9%
Disgusted 4.5%
Sad 3.9%
Fear 2%
Happy 1.8%

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Dog 97.2%
Painting 68.8%

Captions

Microsoft

a man and a dog posing for the camera 49.3%
an old photo of a man with a dog 49.2%
an old photo of a man and a dog 43.5%