Human Generated Data

Title

Untitled (woman at display for J.J. Moreau & Son's pet store)
Date

c. 1937, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5812

Human Generated Data

Title

Untitled (woman at display for J.J. Moreau & Son's pet store)

People

Artist: Durette Studio, American 20th century

Date

c. 1937, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 98.3
Person 98.3
Clothing 95.5
Apparel 95.5
Indoors 86.4
Interior Design 86.4
Advertisement 85
Shop 76.8
Poster 73.8
Sleeve 72.1
Long Sleeve 68.8
Architecture 65
Clock Tower 65
Tower 65
Building 65
Billboard 63.5
Word 59.2
Window Display 58.4
Shorts 56.9

Clarifai
created on 2019-11-16

people 99.9
adult 99.4
monochrome 98
vehicle 97.9
movie 96.6
man 96.5
music 96.3
group 95.6
woman 95.4
group together 94.1
wear 93.6
transportation system 92.8
indoors 91.7
musician 91.2
outfit 90.1
two 87.5
one 86.5
street 86.1
portrait 85.1
furniture 85

Imagga
created on 2019-11-16

television 37.4
shop 24
barbershop 20.3
broadcasting 18.1
black 18
device 17.3
vending machine 16.5
pump 15.9
telecommunication 15.4
machine 15.4
digital 15.4
mercantile establishment 15.3
business 15.2
technology 14.8
building 14.4
slot machine 13.9
board 13.4
computer 12.9
sign 12.8
gas pump 12.7
signboard 12.5
electronic equipment 12.2
equipment 11.6
design 11.2
telephone 11.2
old 11.1
communication 10.9
information 10.6
button 10.6
place of business 10.2
case 10.1
scoreboard 9.7
telecommunication system 9.2
security 9.2
office 9.1
medium 9
restaurant 8.8
screen 8.7
pay-phone 8.4
power 8.4
dark 8.3
data 8.2
retro 8.2
symbol 8.1
monitor 8
structure 7.9
vintage 7.8
work 7.8
entrance 7.7
display 7.7
mechanical device 7.6
entertainment 7.4
architecture 7
modern 7

Google
created on 2019-11-16

Photograph 94.8
Black-and-white 80.7
Room 71.4
Display case 69
Photography 67.8
Picture frame 57.9
Display window 53.6
Art 50.2

Microsoft
created on 2019-11-16

text 99.9
person 98.9
clothing 98.5
man 95.1
black and white 83.9
black 69.2
white 67.6
concert 57.8
store 53.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-33
Gender Female, 54.6%
Fear 45%
Surprised 45%
Angry 45%
Sad 45%
Disgusted 45%
Happy 45.1%
Calm 54.8%
Confused 45%

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Clock Tower 65%

Captions

Microsoft

a black and white photo of a store 82.9%
a black sign with white letters above a store 82.8%
a person standing in front of a store 71.6%

Text analysis

Amazon

FREE
SAMPLES
PEDIGREED
MOREAU&
FOODS
MOREAU& SON
MILLERS FOODS
SON
DOG
MILLERS
KENNEL
FREE Tese KENNEL
ee
O
Rased
DOG BoOKS ee Rased O
J.J.
WSIDE
Tese
BoOKS
puPS
CE MLABVIE

Google

J.J.MOREAU & SON ADA ese KENNEL FREE SAMPLES ORIES PEDIGREED PUPS ene Raised on MILLERS FOODS DOG BOOKS NSIDE
J.J.MOREAU
&
SON
ADA
ese
KENNEL
FREE
SAMPLES
ORIES
PEDIGREED
PUPS
ene
Raised
on
MILLERS
FOODS
DOG
BOOKS
NSIDE