Human Generated Data

Title

Untitled (two photographs: couple with four children posed sitting on living room couch; double studio portrait of chef wearing hat and white coat)
Date

1937, printed later
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10263

Human Generated Data

Title

Untitled (two photographs: couple with four children posed sitting on living room couch; double studio portrait of chef wearing hat and white coat)

People

Artist: Martin Schweig, American 20th century

Date

1937, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10263

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.7
Person 99.7
Person 99.2
Person 99.1
Person 99.1
Person 98.7
Person 96.5
Chef 96
Advertisement 91.1
Poster 91.1
Collage 91.1
Person 88.9
Person 63.7

Clarifai
created on 2019-11-16

people 100
group 99.8
group together 98.8
adult 97.9
actress 97.7
woman 97.6
four 97.6
uniform 97.4
child 96.8
man 96.6
medical practitioner 95.7
leader 95.6
several 95.5
portrait 95.1
three 94.7
wear 94.6
five 94.6
actor 94.5
outfit 93.9
chef 91.7

Imagga
created on 2019-11-16

bow tie 46
necktie 36.7
man 30.9
people 28.4
kin 26.7
person 25.9
male 25.5
adult 24.2
portrait 21.3
couple 20.9
garment 20.7
nurse 19.3
black 16.8
men 16.3
clothing 16.1
fashion 15.8
women 15.8
happy 15
love 15
face 14.9
worker 14.9
attractive 14.7
dress 14.4
professional 14.1
smile 13.5
happiness 13.3
occupation 12.8
looking 12.8
sexy 12
job 11.5
hat 11.3
two 11
cheerful 10.6
bride 10.5
domestic 10.2
smiling 10.1
mother 10.1
vintage 9.9
team 9.8
retro 9.8
romantic 9.8
pretty 9.8
family 9.8
lady 9.7
indoors 9.7
color 9.4
work 9.4
model 9.3
holding 9.1
group 8.9
celebration 8.8
uniform 8.7
coat 8.7
standing 8.7
decoration 8.7
lifestyle 8.7
profession 8.6
party 8.6
senior 8.4
costume 8.4
old 8.4
studio 8.4
traditional 8.3
wedding 8.3
fun 8.2
style 8.2
success 8
office 8
home 8
medical 7.9
hair 7.9
together 7.9
look 7.9
brunette 7.8
art 7.8
waiter 7.8
patient 7.8
industry 7.7
youth 7.7
mask 7.7
loving 7.6
elegance 7.6
bouquet 7.5
hospital 7.5
doctor 7.5
glasses 7.4
room 7.3
business 7.3
pose 7.2
posing 7.1
interior 7.1
modern 7

Google
created on 2019-11-16

Photograph 97.2
Snapshot 86.9
Black-and-white 86.3
Photography 78.8
Room 65.7
Monochrome photography 64.7
Monochrome 54.4
Photo booth 51.1
Vintage clothing 50.7
Photographic paper 50.6
Art 50.2

Microsoft
created on 2019-11-16

person 99.8
human face 96.8
clothing 96.5
smile 94
text 87.9
posing 87.4
man 86.4
standing 83.9
black 83.7
player 83.1
white 82.9
black and white 77.9
people 76.9
old 75.5
group 65.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-47
Gender Male, 54.6%
Happy 45%
Calm 45.2%
Fear 45%
Confused 45.1%
Angry 54.5%
Surprised 45%
Disgusted 45.1%
Sad 45%

AWS Rekognition

Age 31-47
Gender Male, 98.6%
Disgusted 0.1%
Happy 0.2%
Surprised 0.1%
Sad 6%
Fear 0.1%
Calm 88.9%
Angry 0.6%
Confused 3.9%

AWS Rekognition

Age 5-15
Gender Male, 53.8%
Angry 45.2%
Happy 53.7%
Fear 45.1%
Disgusted 45.1%
Sad 45.1%
Calm 45.7%
Surprised 45%
Confused 45.1%

AWS Rekognition

Age 28-44
Gender Male, 98.1%
Angry 1.4%
Sad 6.3%
Happy 0.1%
Disgusted 0.1%
Calm 84.4%
Confused 7.4%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 24-38
Gender Male, 50.6%
Angry 45.5%
Happy 50.7%
Fear 45.9%
Disgusted 45.1%
Sad 45.7%
Calm 45.7%
Surprised 45.9%
Confused 45.6%

AWS Rekognition

Age 0-3
Gender Female, 54.8%
Surprised 45%
Confused 45%
Calm 45.3%
Happy 54.5%
Sad 45%
Angry 45.1%
Disgusted 45%
Fear 45%

AWS Rekognition

Age 7-17
Gender Female, 54.6%
Disgusted 45%
Happy 45%
Angry 45%
Fear 45%
Calm 54.8%
Sad 45%
Surprised 45%
Confused 45%

AWS Rekognition

Age 0-3
Gender Female, 53.3%
Happy 55%
Fear 45%
Angry 45%
Confused 45%
Surprised 45%
Disgusted 45%
Calm 45%
Sad 45%

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

people portraits 99.8%

Text analysis

Amazon

OLSSS

Google

a a ss S
a
ss
S