Human Generated Data

Title

Me and Gene: Two Guys in White Hats

Date

1984

People

Artist: Rodger Kingston, American born 1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.906

Copyright

© Rodger P. Kingston

Human Generated Data

Title

Me and Gene: Two Guys in White Hats

People

Artist: Rodger Kingston, American born 1941

Date

1984

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 96.5
Human 96.5
Shop 90.4
Person 88.7
LCD Screen 74
Display 74
Electronics 74
Monitor 74
Screen 74
Helmet 67.7
Apparel 67.7
Clothing 67.7
Text 66.8
Shelf 61.6
Advertisement 61.2
Furniture 60.5
Cabinet 60
Window Display 57.5
Poster 56.7

Imagga
created on 2022-02-26

shop 62.8
mercantile establishment 45.3
tobacco shop 42.3
place of business 30.2
case 26.1
man 17.5
religion 17
comic book 16.9
old 16.7
establishment 15.1
art 15.1
church 14.8
call 14.2
building 14.1
window 13.4
interior 13.3
vintage 13.2
indoors 12.3
religious 12.2
black 12
home 12
shoe shop 10.4
hat 10.3
work 10.2
faith 9.6
antique 9.5
restaurant 9.5
people 9.5
wall 9.4
architecture 9.4
person 8.9
equipment 8.7
holy 8.7
saint 8.6
glass 8.6
repair 8.6
colorful 8.6
culture 8.5
house 8.3
barbershop 8.3
indoor 8.2
paint 8.1
adult 7.8
god 7.6
style 7.4
design 7.4
business 7.3
detail 7.2
metal 7.2
color 7.2
worker 7.1
male 7.1

Google
created on 2022-02-26

Picture frame 92.3
Hat 89
Window 85.7
Beard 84.6
Art 82.1
Fedora 76.7
Wood 75.6
Font 75
Smile 72.7
Poster 72.4
Sun hat 72
Facial hair 69.9
Advertising 68.6
Goggles 67.4
Visual arts 67.3
Facade 64.1
Cowboy hat 64
Moustache 63.3
Illustration 56
Painting 55.5

Microsoft
created on 2022-02-26

human face 97.7
hat 95.1
poster 93.7
person 93
text 92.5
clothing 90.2
art 89.1
fashion accessory 86.5
painting 84.6
smile 82.5
man 77.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-47
Gender Female, 88.2%
Happy 99.7%
Surprised 0.1%
Calm 0.1%
Angry 0%
Disgusted 0%
Fear 0%
Sad 0%
Confused 0%

AWS Rekognition

Age 22-30
Gender Male, 99.7%
Happy 68.8%
Calm 24%
Angry 2%
Disgusted 1.3%
Sad 1.3%
Surprised 1%
Confused 0.9%
Fear 0.7%

AWS Rekognition

Age 29-39
Gender Male, 100%
Sad 50.7%
Fear 19.8%
Disgusted 8.9%
Calm 8.6%
Confused 4.6%
Angry 3.7%
Surprised 2%
Happy 1.8%

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 47
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 96.5%
Helmet 67.7%
Poster 56.7%

Captions

Microsoft

Gene Autry standing next to a glass display case 33.7%
a glass display case 33.1%
Gene Autry sitting in a display case 25.4%

Text analysis

Amazon

R
MILE
EXPRESS
BUDDY MILE
BUDDY
Capitol
EWORLD
mercury
E
STEREO
WILD
NWHO
THE BEA
STEREO SK 41328
OR
41328
SK

Google

EWORLD
STEREO SR eraan NWIO EWORLD mercury WILD Camitol BUDDY MILES EXPRESS ORS
STEREO
NWIO
mercury
WILD
Camitol
BUDDY
EXPRESS
SR
eraan
MILES
ORS