Human Generated Data

Title

Untitled (three young guests)
Date

1948
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.19

Human Generated Data

Title

Untitled (three young guests)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.19

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Clothing 98.9
Apparel 98.9
Human 98.4
Person 98.4
Person 98
Tie 92.4
Accessory 92.4
Accessories 92.4
Overcoat 88.5
Person 88.1
Suit 87.3
Indoors 69.2
Face 67
Room 66.8
People 62.3
Text 61.8
Tuxedo 59.8
Female 58.7
Living Room 57.6
Court 57.2
Floor 57.1
Coat 51.6

Clarifai
created on 2019-03-25

people 99.9
two 98.8
adult 98.4
group 98.3
woman 97.2
administration 96.4
three 96.1
wear 95.7
man 95.5
actress 95.1
leader 93.1
actor 92.4
outfit 90.6
four 89.5
movie 89.2
group together 89.2
portrait 84.2
facial expression 82.5
partnership 81.6
music 79.6

Imagga
created on 2019-03-25

groom 68.4
man 49.1
businessman 48.6
business 41.3
office 39.2
male 39
people 37.4
person 37.4
corporate 37
professional 35.2
suit 33.7
meeting 33
businesswoman 31.8
happy 28.8
adult 28.8
team 28.7
businesspeople 28.5
executive 28.4
group 26.6
work 25.1
teamwork 24.1
colleagues 22.4
men 22.3
job 22.1
smile 22.1
handsome 20.5
working 20.3
career 19.9
portrait 19.4
communication 19.3
couple 19.2
smiling 18.8
lifestyle 18.8
success 18.5
company 17.7
attractive 17.5
computer 16.8
manager 16.8
successful 16.5
sitting 16.3
bow tie 15.6
laptop 15.5
confident 15.5
cheerful 15.5
worker 15.5
corporation 15.5
formal 15.3
home 15.2
happiness 14.9
indoor 14.6
partner 14.5
leadership 14.4
partnership 14.4
tie 14.2
desk 14.2
indoors 14.1
clothing 14
standing 13.9
table 13.9
necktie 13.8
women 13.5
holding 13.2
together 13.2
occupation 12.8
expression 12.8
modern 12.6
boss 12.4
workplace 12.4
talking 12.4
casual 11.9
coworkers 11.8
busy 11.6
staff 11.5
building 11.2
presentation 11.2
employee 11.1
discussing 10.8
businessmen 10.7
face 10.7
diversity 10.6
color 10.6
room 10.4
garment 10.3
two 10.2
mother 9.9
diverse 9.8
discussion 9.7
mature 9.3
human 9
jacket 8.9
family 8.9
businesswomen 8.8
looking 8.8
businessperson 8.8
partners 8.8
black 8.8
planning 8.7
30s 8.7
20s 8.3
secretary 8.2
life 8.2
aged 8.2
restaurant 8
love 7.9
cooperation 7.7
mid adult 7.7
pretty 7.7
hand 7.6
shirt 7.5
friendly 7.3
alone 7.3
interior 7.1

Google
created on 2019-03-25

Photograph 97.1
Snapshot 88
Vintage clothing 86.9
Classic 84.6
Retro style 77
Formal wear 63.7
Photography 62.4
Gentleman 61.7
Family 59.2
Black-and-white 56.4

Microsoft
created on 2019-03-25

person 99.8
man 94.4
standing 94.3
posing 47.9
old 40
dressed 29.3
clothes 27.1
wedding 18.5
black and white 4.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 17-27
Gender Female, 57%
Sad 9.8%
Surprised 27.8%
Disgusted 8.6%
Happy 12.7%
Angry 9.1%
Confused 10.5%
Calm 21.6%

AWS Rekognition

Age 20-38
Gender Female, 86.3%
Angry 4%
Calm 2.3%
Happy 82%
Confused 2%
Disgusted 5.2%
Surprised 1.3%
Sad 3.2%

AWS Rekognition

Age 23-38
Gender Male, 84%
Angry 9.8%
Sad 26.9%
Happy 23.2%
Calm 14%
Surprised 7.6%
Confused 10.4%
Disgusted 8.1%

AWS Rekognition

Age 10-15
Gender Female, 50.1%
Happy 49.6%
Confused 49.6%
Disgusted 49.6%
Angry 49.6%
Calm 49.6%
Surprised 49.6%
Sad 50.1%

AWS Rekognition

Age 10-15
Gender Male, 52.2%
Angry 46.3%
Disgusted 47.9%
Surprised 46%
Sad 46.7%
Confused 46.5%
Calm 46.4%
Happy 45.2%

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Tie 92.4%
Suit 87.3%
Coat 51.6%

Categories

Imagga

people portraits 88.6%
paintings art 9.4%

Text analysis

Amazon

SAINT LOUIS
SCHWEIC
MARTIN SCHWEIC
MARTIN

Google

MARTIN SCHWEIC SAINT LOUIS
MARTIN
SCHWEIC
SAINT
LOUIS