Human Generated Data

Title

Untitled (man with dog wearing sign)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15585

Human Generated Data

Title

Untitled (man with dog wearing sign)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Human 97.6
Person 97.6
Mammal 92.9
Animal 92.9
Canine 90.5
Pet 86.7
Text 76.5
Apparel 73
Clothing 73
Drawing 71.6
Art 71.6
Puppy 70.6
Dog 70.6
Suit 65
Coat 65
Overcoat 65
Face 62.4
Floor 59.5
Photo 59.1
Photography 59.1
Pointer 58.4
Hound 58.4
Flooring 57.5

Imagga
created on 2022-02-05

musical instrument 59.7
wind instrument 48.9
accordion 46.4
keyboard instrument 37.3
people 25.1
man 24.9
brass 24.7
person 24.4
male 17.7
beach 16.8
adult 16.6
outdoors 16.4
scholar 16.2
bench 15.1
sitting 14.6
shopping cart 14.6
men 13.7
silhouette 13.2
intellectual 13
portrait 12.9
lifestyle 12.3
couple 12.2
active 11.7
sunset 11.7
outdoor 11.5
handcart 11.3
happy 11.3
sky 10.8
park 10.7
water 10.7
sit 10.4
summer 10.3
day 10.2
ocean 10
kin 9.9
sport 9.9
fun 9.7
business 9.7
landscape 9.7
sand 9.6
love 9.5
happiness 9.4
dog 9.4
wheeled vehicle 9.3
park bench 9.2
vacation 9
success 8.8
smiling 8.7
run 8.7
holiday 8.6
seat 8.4
relax 8.4
professional 8.4
holding 8.2
exercise 8.2
cheerful 8.1
suit 8.1
activity 8.1
sax 7.9
sea 7.8
play 7.7
chair 7.7
attractive 7.7
old 7.7
walking 7.6
relaxation 7.5
hill 7.5
leisure 7.5
snow 7.4
laptop 7.3
device 7.3
muzzle 7.2
black 7.2
looking 7.2
romantic 7.1
family 7.1
grass 7.1
women 7.1
working 7.1
businessman 7.1
modern 7

Google
created on 2022-02-05

Black-and-white 85
Style 83.9
Font 79.6
Carnivore 79.5
Adaptation 79.4
Street fashion 77.8
Art 77.6
Companion dog 76.8
Monochrome 76
Monochrome photography 75.9
Dog breed 74.2
Suit 71
Fur 66.9
Sidewalk 66.6
Pattern 66.5
Photo caption 66.2
Visual arts 65.3
Advertising 64.1
Sporting Group 64
Illustration 63.3

Microsoft
created on 2022-02-05

dog 93.9
text 87.6
black and white 74.6
carnivore 65.1
street 59.4

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 90.7%
Happy 89.7%
Calm 8%
Confused 0.9%
Surprised 0.6%
Angry 0.4%
Disgusted 0.2%
Sad 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%

Captions

Microsoft

a person standing in front of a window 62%
a person standing in front of a window 61.9%
a person standing next to a window 54.1%

Text analysis

Amazon

MAKE
FOR
ROOM
TO MAKE ROOM FOR
FROM
PLOESER
EVICTED
TO
DOG
HOUSE
AMALGAMA
EVICTED FROM ED DOG HOUSE
AMALGAMA MASCP
MASCP
ED

Google

FOR
DOG
MAKE
ROOM
FROM
EVICTED
TO
PLOESER
EVICTED FROM DOG HOUSE TO MAKE ROOM FOR PLOESER
HOUSE