Human Generated Data

Title

Untitled (boy and German shepherd)
Date

1970s
People

Artist: Bachrach Studios, founded 1868
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1034

Human Generated Data

Title

Untitled (boy and German shepherd)

People

Artist: Bachrach Studios, founded 1868

Date

1970s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.7
Apparel 99.7
Accessories 99.7
Accessory 99.7
Tie 99.7
Shoe 99.5
Footwear 99.5
Shoe 99.2
Human 99
Person 99
Pet 97.6
Animal 97.6
Canine 97.6
Dog 97.6
Mammal 97.6
Suit 84.5
Coat 84.5
Overcoat 84.5
Boot 80.7
Wood 62.8
Home Decor 57.4

Imagga
created on 2022-02-26

dog 77.9
canine 42.4
hound 33.7
pug 30.3
domestic animal 28.7
hunting dog 27.5
pet 26.6
man 24.2
male 22.4
cute 21.5
happy 19.4
person 18
portrait 17.5
adult 16.9
suit 16.7
people 16.2
puppy 15.6
pooch 15.6
couch 14.5
home 14.4
darling 14.2
standing 13.9
smiling 13.7
sitting 13.7
friend 13.3
businessman 13.2
holding 13.2
professional 12.9
child 12.9
business 12.7
domestic 12
attractive 11.9
dogs 11.8
breed 11.6
smile 11.4
tie 11.4
looking 11.2
pedigree 10.7
handsome 10.7
couple 10.4
office 10.4
boy 10.4
love 10.3
animals 10.2
happiness 10.2
casual 10.2
alone 10
face 9.9
purebred 9.7
collar 9.6
confident 9.1
pretty 9.1
bow tie 9
indoors 8.8
together 8.8
look 8.8
education 8.7
pets 8.6
jeans 8.6
nose 8.6
expression 8.5
shepherd dog 8.5
book 8.2
fun 8.2
outdoors 8.2
student 8.1
cheerful 8.1
lifestyle 7.9
hair 7.9
work 7.8
jacket 7.8
day 7.8
guy 7.8
clothing 7.8
executive 7.7
two 7.6
head 7.6
necktie 7.5
mature 7.4
adorable 7.4
successful 7.3
playing 7.3
family 7.1
kid 7.1

Google
created on 2022-02-26

Footwear 98.1
Dog 93.7
Plant 93.6
Dog breed 89
Carnivore 84.8
Picture frame 84.5
Working animal 82.9
Companion dog 81.6
Fawn 81.6
Houseplant 81.4
Knee 75.8
Happy 75.2
Art 74.9
Grass 72.9
Vintage clothing 71.6
Suit 70.7
Toddler 70.2
Tie 65.7
Photo caption 65.1
Sporting Group 64.4

Microsoft
created on 2022-02-26

indoor 99.5
wall 98.9
person 96.6
dog 94.9
carnivore 81.1
text 80.8
animal 73.2
posing 47.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Male, 100%
Happy 98.8%
Angry 0.2%
Sad 0.2%
Disgusted 0.2%
Surprised 0.2%
Calm 0.2%
Confused 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 9
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.7%
Shoe 99.5%
Person 99%
Dog 97.6%
Suit 84.5%

Captions

Microsoft

a person holding a dog posing for the camera 91.3%
a person holding a dog posing for the camera 91.2%
a person holding a dog posing for the camera 91.1%