Human Generated Data

Title

Untitled (reception)

Date

1948

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.9

Human Generated Data

Title

Untitled (reception)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.9

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Clothing 99.9
Apparel 99.9
Human 99.5
Person 99.5
Person 98.8
Overcoat 97.8
Coat 97.8
Person 95.5
Person 93.6
Suit 90.6
Tuxedo 88.5
Person 87.8
Female 87.3
Gown 86.3
Fashion 86.3
Robe 86.3
People 79.8
Dress 79.3
Wedding 76.3
Woman 72.2
Wedding Gown 70.3
Evening Dress 70.1
Plant 62.1
Flower 59.4
Blossom 59.4
Sleeve 59.1
Bride 57
Long Sleeve 56.9
Face 56.4

Clarifai
created on 2019-03-25

people 100
administration 99.4
group 99.3
leader 99
adult 98.8
two 98.5
three 97.8
several 97.5
four 97.3
man 97.1
group together 96.7
offspring 96.5
wedding 96
facial expression 93.9
five 93.9
outfit 93.2
woman 92.9
wear 92.7
chair 92
ceremony 91.2

Imagga
created on 2019-03-25

man 45
groom 41.3
male 38.4
people 35.7
person 35.2
office 32.1
business 31.6
businessman 30.9
professional 30.1
adult 27.8
bow tie 26.9
suit 23.4
happy 22.6
necktie 22.2
portrait 22
executive 21.2
corporate 20.6
job 20.4
tie 19.9
looking 19.2
men 18
doctor 17.9
senior 17.8
handsome 16.1
meeting 16
manager 15.8
couple 15.7
face 15.6
team 15.2
medical 15
work 14.9
clothing 14.7
occupation 14.7
health 14.6
boss 14.4
smile 14.3
desk 14.2
working 14.1
indoors 14.1
mature 14
smiling 13.7
group 13.7
indoor 13.7
garment 13.5
hospital 13.5
elderly 13.4
formal 13.4
attractive 13.3
businesspeople 13.3
patient 13.3
old 13.2
lifestyle 13
home 12.8
confident 12.7
businesswoman 12.7
corporation 12.5
happiness 12.5
partnership 12.5
family 12.5
care 12.3
nurse 12.3
cheerful 12.2
worker 12.2
computer 12
successful 11.9
jacket 11.8
standing 11.3
sitting 11.2
casual 11
stethoscope 10.8
mother 10.7
leadership 10.6
illness 10.5
success 10.5
company 10.2
teamwork 10.2
uniform 10.2
room 10.2
camera 10.2
color 10
colleagues 9.7
one 9.7
partner 9.7
mid adult 9.6
love 9.5
career 9.5
shirt 9.3
husband 8.9
medicine 8.8
together 8.8
building 8.7
busy 8.7
coat 8.6
serious 8.6
kin 8.5
glasses 8.3
alone 8.2
aged 8.2
to 8
women 7.9
clinic 7.9
table 7.8
discussion 7.8
expertise 7.8
modern 7.7
two 7.6
talking 7.6
wife 7.6
adults 7.6
guy 7.6
fashion 7.5
horizontal 7.5
holding 7.4
20s 7.3
interior 7.1
day 7.1
look 7

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 100
man 96.7
standing 95.2
old 78.6
posing 76
wedding 74.9
suit 57
dressed 32.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Female, 80.6%
Angry 7.5%
Sad 52.6%
Surprised 5.4%
Confused 10.1%
Calm 11.6%
Happy 7.2%
Disgusted 5.6%

AWS Rekognition

Age 48-68
Gender Male, 98.1%
Happy 99.1%
Disgusted 0%
Confused 0.1%
Surprised 0.1%
Calm 0.4%
Sad 0.1%
Angry 0.2%

AWS Rekognition

Age 26-43
Gender Female, 99.9%
Sad 1.2%
Confused 0.5%
Angry 0.8%
Surprised 0.9%
Calm 0.1%
Happy 96%
Disgusted 0.5%

AWS Rekognition

Age 15-25
Gender Male, 63.1%
Calm 18.7%
Happy 1.9%
Confused 9.7%
Disgusted 9.1%
Sad 17.4%
Surprised 10%
Angry 33.2%

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 63
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Suit 90.6%

Categories

Text analysis

Amazon

MARTIN
MARTIN SCHWEIC
SCHWEIC
SAINT LOUIS

Google

MARTIN SCHWEIC SAINT LOUI5
MARTIN
SCHWEIC
SAINT
LOUI5