Human Generated Data

Title

Untitled (grocery store employee with glasses posing smiling while holding box of Cheerios)

Date

1968-1971

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10123

Human Generated Data

Title

Untitled (grocery store employee with glasses posing smiling while holding box of Cheerios)

People

Artist: Martin Schweig, American 20th century

Date

1968-1971

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 98.2
Human 98.2
Sunglasses 97.7
Accessories 97.7
Accessory 97.7
Apparel 92.5
Clothing 92.5
Sleeve 88.7
Long Sleeve 71.8
Finger 64.4
Face 60.6
Photo 60.6
Photography 60.6
Portrait 60.6
Man 55.9
Overcoat 55.7
Coat 55.7
Suit 55.6
Glass 55

Imagga
created on 2022-01-28

man 49.8
male 46.1
mask 42
person 37.4
portrait 35.6
adult 31.1
black 30.8
people 28.5
suit 27.8
businessman 26.5
covering 26.1
business 22.5
professional 22.1
face 20.6
guy 20.4
clothing 19.6
handsome 18.7
jacket 18
model 17.9
looking 17.6
disguise 16.6
men 16.3
attractive 16.1
studio 16
one 15.7
mug shot 15.7
corporate 15.5
expression 15.4
fashion 15.1
garment 15.1
human 15
smile 15
casual 14.4
shirt 14.3
tie 14.2
dark 14.2
glasses 13.9
office 13.7
comedian 13.4
eyes 12.9
executive 12.9
hair 12.7
performer 12.4
ski mask 12.2
photograph 12.2
friendly 11.9
confident 11.8
work 11.8
head 11.8
necktie 11.5
standing 11.3
success 11.3
protective covering 11
danger 10.9
hand 10.6
bow tie 10.6
worker 10.2
alone 10.1
sweatshirt 9.9
mafia 9.9
modern 9.8
face mask 9.8
job 9.7
representation 9.3
occupation 9.2
style 8.9
posing 8.9
gangster 8.9
sexy 8.8
crime 8.8
smiling 8.7
entertainer 8.6
youth 8.5
emotion 8.3
attire 8.3
single 8.2
closeup 8.1
sunglasses 8.1
pullover 7.9
look 7.9
criminal 7.8
thinking 7.6
manager 7.5
holding 7.4
student 7.4
hat 7.4
successful 7.3
pose 7.3
dress 7.2
beard 7.1
mustache 7.1

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 99.2
clothing 92.6
person 91.4
human face 85.8
black and white 81.8
glasses 75
man 68.4

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Female, 96.8%
Happy 71.8%
Calm 17.3%
Surprised 2.5%
Fear 2.3%
Angry 2%
Confused 1.6%
Disgusted 1.5%
Sad 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Sunglasses 97.7%

Captions

Microsoft

a man standing in front of a window 66.5%
a man that is standing in front of a window 60.3%
a man standing in front of a mirror posing for the camera 38.9%

Text analysis

Amazon

KODAK
Cheerios
MINI
FREE MINI
FREE
6
FILM
WHIZ
RING
General
FROM
KODAK SAFETY
INSIDE
AND
Mills
WITH
SAFETY
FORTIFIED
VITAMINS
MADE
TOASTED
PROTEIN
AND в VITAMINS WITH FROM
MADE FROM Dr. CRAIN MISHEST 19 PROTEIN
TOASTED DAS GEREAL
CRAIN
GEREAL
DAS
MISHEST
в
19
Dr.
MEMES

Google

MADE Genera Mills AND DAOTE Cheerios HORESTIN PN FREE MINI WHIZ RING KODAK S'AFETY FI LM KODAK S'AFETY FILM
AND
KODAK
LM
Genera
DAOTE
Cheerios
PN
MINI
FILM
FREE
RING
FI
S'AFETY
Mills
MADE
HORESTIN
WHIZ