Human Generated Data

Title

Untitled (guests at reception)

Date

1948

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.13

Human Generated Data

Title

Untitled (guests at reception)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.13

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Apparel 99.7
Clothing 99.7
Overcoat 98.8
Accessory 98.5
Tie 98.5
Accessories 98.5
Person 98.2
Human 98.2
Person 98
Person 96.3
Person 95.2
Person 95
Tuxedo 94
Suit 80.3
Face 76
People 72.3
Female 69.4
Robe 65.6
Fashion 65.6
Gown 64.5
Plant 63.9
Flower 63.9
Blossom 63.9
Suit 56.1
Coat 54.6

Clarifai
created on 2019-03-25

people 100
group 99.7
group together 98.6
three 98.1
adult 98.1
four 98.1
leader 98.1
several 97.1
administration 97
man 96.4
five 94.9
two 94.4
outfit 93.9
wear 93.3
woman 93.2
wedding 92.8
offspring 91.2
actress 89.1
actor 88.4
ceremony 87.5

Imagga
created on 2019-03-25

man 28.2
adult 25
groom 24.9
people 22.9
male 22.7
person 21.2
clothing 20.8
business 17.6
couple 17.4
suit 15.6
dress 15.4
standing 14.8
old 14.6
office 14.4
garment 14
happy 13.8
portrait 13.6
fashion 13.6
professional 12.7
happiness 12.5
businessman 12.4
corporate 12
men 12
love 11.8
jacket 11.8
bride 11.7
family 11.6
black 11.3
wedding 11
kin 11
uniform 10.9
smile 10.7
military uniform 10.5
looking 10.4
bow tie 10.3
mature 10.2
casual 10.2
face 9.9
world 9.5
women 9.5
bouquet 9.4
two 9.3
executive 9.1
home 8.8
necktie 8.8
coat 8.7
statue 8.7
smiling 8.7
formal 8.6
room 8.4
covering 8.4
color 8.3
indoor 8.2
businesswoman 8.2
religion 8.1
history 8.1
handsome 8
building 7.9
hair 7.9
day 7.8
hands 7.8
career 7.6
elegance 7.6
consumer goods 7.5
senior 7.5
monument 7.5
one 7.5
holding 7.4
lady 7.3
group 7.3
aged 7.2
celebration 7.2
interior 7.1
indoors 7

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 99.9
wall 97.9
standing 95.1
man 92.9
posing 86.5
black 68.7
people 58.9
old 45.8
wedding 45.8
ceremony 4.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 60-80
Gender Male, 97.5%
Happy 1%
Disgusted 2.5%
Confused 5.3%
Surprised 1.9%
Calm 44.1%
Sad 3%
Angry 42.3%

AWS Rekognition

Age 23-38
Gender Female, 98.6%
Sad 1.7%
Disgusted 0.6%
Angry 1.1%
Calm 1.9%
Surprised 0.6%
Confused 1.4%
Happy 92.6%

AWS Rekognition

Age 23-38
Gender Male, 72%
Sad 50.1%
Calm 24.8%
Happy 1.4%
Surprised 3.7%
Disgusted 3.2%
Confused 8.2%
Angry 8.7%

AWS Rekognition

Age 20-38
Gender Female, 81.9%
Surprised 3.5%
Disgusted 2.3%
Calm 7.9%
Sad 56.8%
Confused 4.8%
Happy 0.9%
Angry 23.7%

Microsoft Cognitive Services

Age 63
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.5%
Person 98.2%
Suit 80.3%
Coat 54.6%

Categories

Imagga

paintings art 94.7%
interior objects 3.1%

Text analysis

Amazon

MARTIN
MARTIN SCHWEIC
SCHWEIC
SAINT
SAINT LOUIS SAINT LOUIS
SAINT LOUIS
LOUIS

Google

MARTIN SCHWEIC SAINT LOUIS
MARTIN
SCHWEIC
SAINT
LOUIS