Human Generated Data

Title

Untitled (groom and guest)
Date

1948
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.17

Human Generated Data

Title

Untitled (groom and guest)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.17

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Clothing 99.1
Apparel 99.1
Person 98.5
Human 98.5
Furniture 97.6
Home Decor 97.4
Coat 96.3
Suit 96.3
Overcoat 96.3
Tie 96.1
Accessory 96.1
Accessories 96.1
Person 93.8
Chair 86.8
Couch 85.5
Man 68.7
Tuxedo 58.6
Jacket 58.1
Electronics 55.4
Screen 55.4
Table 55.3

Clarifai
created on 2019-03-25

people 99.9
adult 99.2
two 99
man 98.8
group 98.1
wear 98
portrait 97.4
administration 97.1
three 95.1
facial expression 94.6
outfit 92.9
leader 90
actor 89.5
woman 88.9
group together 86.7
movie 82.4
indoors 79.4
four 78.9
music 78.5
outerwear 78.1

Imagga
created on 2019-03-25

people 38.5
man 36.3
person 34.4
happy 32
home 31.9
couple 31.4
male 30.6
adult 30.1
happiness 25.9
grandma 24.2
indoors 23.7
office 23.5
smile 22.8
suit 22.5
business 22.5
groom 22.1
businessman 22.1
clothing 21.5
portrait 20.7
smiling 20.3
men 19.8
love 19.7
looking 19.2
lifestyle 18.8
senior 18.8
cheerful 18.7
professional 17.5
attractive 17.5
standing 17.4
indoor 17.4
family 16.9
mature 16.7
together 16.7
face 16.3
elderly 16.3
casual 16.1
handsome 16.1
executive 15
old 14.6
two 13.6
women 13.5
kin 13.3
corporate 12.9
jacket 12.8
husband 12.7
tie 12.3
color 12.2
sitting 12
bow tie 12
businesswoman 11.8
aged 11.8
formal 11.5
expression 11.1
work 11
garment 10.8
retired 10.7
job 10.6
mid adult 10.6
lady 10.6
boss 10.5
human 10.5
one 10.5
wife 10.4
mother 10.4
alone 10.1
confident 10
holding 9.9
middle aged 9.7
group 9.7
building 9.6
computer 9.6
married 9.6
businesspeople 9.5
necktie 9.4
grandfather 9.4
relationship 9.4
manager 9.3
company 9.3
camera 9.2
successful 9.2
interior 8.9
working 8.8
medical 8.8
two people 8.8
corporation 8.7
leadership 8.6
desk 8.5
pretty 8.4
health 8.3
glasses 8.3
director 8.3
inside 8.3
care 8.2
pensioner 8.1
world 8.1
hair 7.9
bright 7.9
good mood 7.8
60s 7.8
half length 7.8
older 7.8
30s 7.7
room 7.7
only 7.6
age 7.6
hand 7.6
marriage 7.6
females 7.6
laughing 7.6
fashion 7.5
meeting 7.5
horizontal 7.5
house 7.5
drink 7.5
success 7.2
dress 7.2
sexy 7.2
romance 7.1
day 7.1
modern 7
look 7

Google
created on 2019-03-25

Photograph 97
Snapshot 87.6
Gentleman 72.7
Room 65.7
Vintage clothing 63.3
Photography 62.4
Picture frame 60.3
Family 59.5
Classic 56.7
Black-and-white 56.4

Microsoft
created on 2019-03-25

person 99.1
window 91.2
standing 85
posing 74.1
black 65.4
military 10.1
black and white 6.1
retro 4.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-57
Gender Male, 99.3%
Sad 1.4%
Confused 6.5%
Angry 24.2%
Surprised 5.1%
Calm 3.1%
Happy 55.5%
Disgusted 4.1%

AWS Rekognition

Age 26-43
Gender Female, 99.6%
Angry 3.2%
Sad 3.1%
Happy 83%
Calm 0.4%
Surprised 3.7%
Confused 2.6%
Disgusted 4%

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Suit 96.3%
Tie 96.1%

Categories

Imagga

people portraits 51.8%
paintings art 37.1%
pets animals 9.8%

Text analysis

Amazon

MARTIN
MARTIN SCHWEIC
SCHWEIC
SAINT
SAINT LOUIS
LOUIS

Google

MARTIN SCHWEIC SAINT LOUIS
MARTIN
SCHWEIC
SAINT
LOUIS