Human Generated Data

Title

Untitled (portrait of boy with German shepherd)
Date

c. 1970
People

Artist: Bachrach Studios, founded 1868
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.539

Human Generated Data

Title

Untitled (portrait of boy with German shepherd)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Apparel 99.5
Footwear 99.5
Shoe 99.5
Clothing 99.5
Accessory 99.5
Tie 99.5
Accessories 99.5
Shoe 99.4
Person 99.2
Human 99.2
Animal 97
Dog 97
Canine 97
Pet 97
Mammal 97
Overcoat 80.5
Suit 80.5
Coat 80.5
Boot 72.5
Couch 56.6
Furniture 56.6
Wood 56.5
Girl 56
Female 56

Imagga
created on 2022-02-26

dog 53.2
hound 35.5
man 31
hunting dog 28.7
male 28.7
canine 28.6
people 24.5
professional 22.3
person 22.1
office 21.7
suit 21.3
adult 20.8
happy 20.7
business 20.6
domestic animal 19.6
businessman 19.4
couch 17.4
smile 17.1
attractive 16.8
portrait 15.5
pug 15.5
confident 15.5
home 15.1
pet 14.7
corporate 14.6
sitting 14.6
holding 14
successful 13.7
cute 13.6
casual 13.6
standing 13
book 12.8
looking 12.8
businesswoman 12.7
work 12.6
executive 12.5
job 12.4
smiling 12.3
education 12.1
alone 11.9
team 11.6
handsome 11.6
tie 11.4
meeting 11.3
manager 11.2
guy 10.8
lifestyle 10.8
darling 10.8
leadership 10.6
group 10.5
success 10.5
mature 10.2
happiness 10.2
child 10.1
student 10
pooch 9.7
interior 9.7
working 9.7
indoors 9.7
workplace 9.5
table 9.5
reading 9.5
expression 9.4
teamwork 9.3
face 9.2
room 9.2
indoor 9.1
pretty 9.1
jacket 9.1
lady 8.9
family 8.9
dogs 8.8
together 8.8
women 8.7
boy 8.7
love 8.7
men 8.6
talking 8.5
college 8.5
career 8.5
couple 7.8
puppy 7.7
necktie 7.7
jeans 7.6
clothing 7.6
school 7.5
house 7.5
senior 7.5
study 7.5
shepherd dog 7.4
occupation 7.3
friendly 7.3
kid 7.1
day 7.1
look 7

Google
created on 2022-02-26

Footwear 98
Shoe 94.6
Plant 93.8
Dog 93.1
Vertebrate 92.1
Dog breed 86.9
Mammal 85.4
Working animal 83.2
Picture frame 82.3
Companion dog 82.1
Fawn 81.5
Carnivore 81.2
Art 75.3
Knee 74.7
Happy 74.7
Houseplant 74.2
Vintage clothing 72.1
Toddler 70
Suit 68.9
Sporting Group 66.9

Microsoft
created on 2022-02-26

indoor 99.6
wall 99.3
dog 94.9
person 94.7
carnivore 83.2
text 76.3
animal 69.6
posing 45.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-12
Gender Male, 100%
Happy 98.7%
Calm 0.2%
Angry 0.2%
Sad 0.2%
Disgusted 0.2%
Surprised 0.2%
Confused 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 9
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 99.5%
Tie 99.5%
Person 99.2%
Dog 97%
Suit 80.5%

Captions

Microsoft

a person holding a dog posing for the camera 95.2%
a person holding a dog 90.4%
a person holding a dog posing for a picture 90.3%