Human Generated Data

Title

Untitled (grocery store employee holding piece of beef)
Date

1968-1971, printed later
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10319

Human Generated Data

Title

Untitled (grocery store employee holding piece of beef)

People

Artist: Martin Schweig, American 20th century

Date

1968-1971, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10319

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99
Person 99
Person 99
Person 98.2
Person 98.1
Person 98
Person 97.8
Apparel 97.7
Clothing 97.7
Person 97.3
Chef 95.2
Collage 91
Poster 91
Advertisement 91
Person 77.5
Shorts 63.7
Sleeve 63.6

Clarifai
created on 2019-11-16

people 99.9
group 99.4
man 99.1
television 98.6
adult 98
monochrome 97.9
woman 96
two 95.5
three 93.3
group together 93.1
portrait 90.5
four 88.9
several 88
leader 87.3
hospital 87.3
medical practitioner 87
uniform 86.9
music 85.3
collage 85.2
screen 84.2

Imagga
created on 2019-11-16

newspaper 31.3
product 25.9
creation 25.9
man 20.1
people 20.1
person 18.6
office 16.2
happy 15.7
portrait 15.5
business 15.2
world 14.6
mug shot 14.2
black 14
male 13.5
adult 13.2
child 12.8
smiling 12.3
dress 11.7
family 11.6
businessman 11.5
photograph 11.1
art 11.1
smile 10.7
bride 10.5
old 10.4
representation 9.7
one 9.7
brunette 9.6
window 9.5
happiness 9.4
face 9.2
billboard 9.1
fashion 9
currency 9
room 8.9
hair 8.7
women 8.7
money 8.5
pretty 8.4
vintage 8.3
human 8.2
body 8
blackboard 8
interior 8
working 8
couple 7.8
boy 7.8
desk 7.8
men 7.7
culture 7.7
elegance 7.6
design 7.5
computer 7.4
wedding 7.4
signboard 7.3
financial 7.1
love 7.1
drawing 7.1
modern 7

Google
created on 2019-11-16

Photograph 97.4
Black-and-white 87.9
Snapshot 87.6
Photography 77
Monochrome photography 69.6
Room 65.7
Photographic paper 63.3
Art 62.5
Picture frame 58.3
Photograph album 57.1
Collection 55.6
Album 51.8
Portrait 51.6
Interior design 50.1

Microsoft
created on 2019-11-16

person 97
clothing 96.5
man 95.5
text 91.9
human face 71.6
black and white 66.1
posing 62.2
gallery 61.4
room 51.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 54.9%
Happy 54.6%
Angry 45.1%
Disgusted 45%
Sad 45%
Surprised 45.1%
Calm 45%
Fear 45.1%
Confused 45%

AWS Rekognition

Age 41-59
Gender Male, 54.8%
Happy 45.1%
Fear 45.1%
Angry 46.1%
Confused 47.1%
Surprised 45.1%
Disgusted 51.1%
Calm 45.2%
Sad 45.3%

AWS Rekognition

Age 50-68
Gender Male, 54.9%
Sad 45%
Disgusted 45%
Happy 53.8%
Confused 45%
Fear 45%
Angry 45%
Calm 46.1%
Surprised 45%

AWS Rekognition

Age 26-40
Gender Male, 54.7%
Sad 45.1%
Surprised 45%
Confused 45%
Fear 45%
Angry 45%
Happy 54.6%
Calm 45.2%
Disgusted 45%

AWS Rekognition

Age 26-42
Gender Male, 54%
Happy 55%
Disgusted 45%
Fear 45%
Calm 45%
Confused 45%
Sad 45%
Surprised 45%
Angry 45%

AWS Rekognition

Age 38-56
Gender Male, 54.9%
Fear 45%
Confused 45%
Happy 55%
Calm 45%
Surprised 45%
Sad 45%
Angry 45%
Disgusted 45%

AWS Rekognition

Age 22-34
Gender Male, 54.6%
Sad 45%
Fear 45%
Angry 45.1%
Surprised 45%
Confused 45%
Calm 45%
Happy 54.9%
Disgusted 45%

AWS Rekognition

Age 23-35
Gender Male, 50.3%
Disgusted 49.5%
Calm 49.6%
Surprised 49.5%
Fear 49.7%
Happy 49.5%
Confused 49.5%
Sad 50.1%
Angry 49.5%

AWS Rekognition

Age 9-19
Gender Male, 50.1%
Sad 49.6%
Disgusted 49.5%
Fear 50.3%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 23-37
Gender Male, 50.5%
Fear 49.5%
Calm 49.6%
Disgusted 49.5%
Happy 49.5%
Sad 49.9%
Confused 49.5%
Surprised 49.5%
Angry 49.9%

AWS Rekognition

Age 20-32
Gender Female, 50%
Angry 49.5%
Fear 49.7%
Disgusted 49.5%
Sad 50.2%
Confused 49.5%
Calm 49.5%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 47-65
Gender Male, 50.5%
Angry 49.5%
Sad 50.4%
Calm 49.6%
Fear 49.6%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 38-56
Gender Female, 50.2%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Fear 50.3%
Sad 49.6%
Confused 49.5%
Calm 49.5%

AWS Rekognition

Age 7-17
Gender Female, 50%
Fear 50.3%
Calm 49.5%
Angry 49.5%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%
Sad 49.6%
Surprised 49.5%

AWS Rekognition

Age 43-61
Gender Male, 50.2%
Disgusted 49.5%
Sad 50%
Happy 49.5%
Surprised 49.5%
Calm 49.5%
Fear 50%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 43-61
Gender Male, 50.4%
Happy 49.5%
Fear 50%
Sad 49.6%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Calm 49.6%
Angry 49.6%

Microsoft Cognitive Services

Age 66
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99%

Categories

Imagga

people portraits 79.6%
paintings art 17.7%
events parties 1.5%

Text analysis

Amazon

59935A
Cheerios
STAMPS
EAGEE STAMPS
EAGEE

Google

EALE STAMPS EL Cheerios 59935A
EALE
STAMPS
EL
Cheerios
59935A