Human Generated Data

Title

Untitled (Washington, D.C.)

Date

1962

People

Artist: Lee Friedlander, American born 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, National Endowment for the Arts Grant, P1972.137

Copyright

© Lee Friedlander

Human Generated Data

Title

Untitled (Washington, D.C.)

People

Artist: Lee Friedlander, American born 1934

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-29

Person 99.4
Human 99.4
Person 98.4
Person 91.6
Advertisement 86.7
Text 85.2
Person 84.5
Apparel 84
Clothing 84
Poster 83.7
Person 82.4
Plant 78.8
Person 78.8
Female 76.3
Face 75.3
Dress 70.6
Collage 70.5
Blossom 68.6
Flower 68.6
Crowd 62.7
Art 62.2
Girl 62.2
Portrait 61.9
Photography 61.9
Photo 61.9
People 61.8
Woman 57.7

Clarifai
created on 2018-02-09

people 99.9
adult 98.8
group 98.5
one 96.1
group together 95.7
woman 95.6
man 95.4
two 95
administration 92.5
wear 91.6
many 91.2
furniture 91
child 90.3
three 88.7
several 88.4
four 87.2
monochrome 86.6
leader 85.9
war 85.7
portrait 84.3

Imagga
created on 2018-02-09

shop 57.2
barbershop 32.8
old 23.7
architecture 19.7
art 18.8
building 18.4
history 17
vintage 16.5
city 15.8
historic 15.6
window 15.2
antique 14.8
ancient 14.7
travel 14.1
tourism 14
stall 13.8
establishment 13.6
religion 12.5
culture 12
temple 11.4
sculpture 11
sign 10.5
business 10.3
monument 10.3
wall 10.3
house 10
landmark 9.9
black 9.6
urban 9.6
structure 9.5
historical 9.4
famous 9.3
man 9.3
finance 9.3
stone 9.2
office 8.7
god 8.6
grunge 8.5
frame 8.3
traditional 8.3
retro 8.2
dirty 8.1
home 8
paper 7.8
color 7.8
glass 7.8
statue 7.7
decoration 7.7
facade 7.5
religious 7.5
destination 7.5
style 7.4
symbol 7.4
design 7.4
light 7.3
aged 7.2
detail 7.2
currency 7.2

Google
created on 2018-02-09

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 96.4%
Happy 2%
Disgusted 5.6%
Calm 43.1%
Angry 6.9%
Sad 36.1%
Confused 3.9%
Surprised 2.4%

AWS Rekognition

Age 23-38
Gender Female, 99.6%
Surprised 2.1%
Angry 2.2%
Disgusted 2%
Confused 2.8%
Happy 6.6%
Sad 2.6%
Calm 81.7%

Microsoft Cognitive Services

Age 34
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

Jacqueline Kennedy holding a sign 55.7%
Jacqueline Kennedy holding a sign 42.6%
Jacqueline Kennedy standing in front of a store 42.4%

Text analysis

Amazon

CARRY
CARRY OUT
ORDE
OUT
BERTY
AIL

Google

Ty CARRY OUT
Ty
CARRY
OUT