Human Generated Data

Title

Untitled (group sitting on stairway at party)
Date

c. 1945
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1448

Human Generated Data

Title

Untitled (group sitting on stairway at party)

People

Artist: Martin Schweig, American 20th century

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1448

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.1
Human 99.1
Person 98.4
Person 98.2
Person 97.6
Person 97.3
Person 97.3
Person 97.2
Person 96.7
People 90
Tie 86.2
Accessories 86.2
Accessory 86.2
Person 84.2
Suit 79.2
Coat 79.2
Overcoat 79.2
Clothing 79.2
Apparel 79.2
Crowd 69.7
Staircase 65.4
Jury 58.7
Court 56
Indoors 56
Room 56
Person 43.5

Clarifai
created on 2023-10-26

people 100
group 99.9
adult 98.5
man 98.5
group together 97.5
sit 97.4
many 96.9
administration 96.4
leader 95.1
several 94.7
woman 94.5
five 89.5
monochrome 89.2
child 88.9
retro 86.8
indoors 86
chair 85.1
four 85.1
war 84.1
step 82.7

Imagga
created on 2022-01-22

man 48.4
businessman 38
people 36.3
male 35.6
person 35.4
business 35.2
team 30.5
adult 30.4
teacher 29.7
classroom 29.7
meeting 29.2
office 28.2
group 28.2
room 26.1
men 24.9
professional 24.5
businesswoman 23.6
colleagues 23.3
businesspeople 21.8
smiling 21.7
happy 20.7
student 20.6
corporate 19.8
teamwork 19.5
executive 19.1
indoors 17.6
sitting 17.2
cheerful 17.1
educator 16.9
couple 16.6
standing 16.5
desk 16.1
senior 15.9
working 15.9
lifestyle 15.9
women 15.8
work 14.9
coworkers 14.7
life 14.5
mature 14
portrait 13.6
nurse 13.6
school 13.2
together 13.1
education 13
table 13
20s 12.8
talking 12.4
worker 12.3
color 12.2
smile 12.1
manager 12.1
home 12
happiness 11.8
40s 11.7
discussion 11.7
30s 11.6
success 11.3
casual 11
successful 11
suit 10.8
job 10.6
four 10.6
career 10.4
presentation 10.2
communication 10.1
indoor 10
conference 9.8
staff 9.6
adults 9.5
laptop 9.1
holding 9.1
family 8.9
medical 8.8
businessmen 8.8
partner 8.7
hands 8.7
workplace 8.6
tie 8.5
two 8.5
horizontal 8.4
occupation 8.3
friendly 8.2
care 8.2
new 8.1
child 8
trainer 7.9
associates 7.9
discussing 7.9
employee 7.8
diverse 7.8
well dressed 7.8
black 7.8
mid adult 7.7
class 7.7
partnership 7.7
clothing 7.7
elderly 7.7
boss 7.7
finance 7.6
human 7.5
mother 7.5
patient 7.4
company 7.4
inside 7.4
looking 7.2
to 7.1
interior 7.1

Google
created on 2022-01-22

Outerwear 95.5
Photograph 94.2
Coat 92.4
Suit 84.9
Font 82.6
Snapshot 74.3
Blazer 74.1
Vintage clothing 71.8
Tie 71.7
Event 71.7
Room 70.3
History 65.9
Art 65.9
Stock photography 65.2
Chair 61.2
Photo caption 58.5
Monochrome photography 57.5
Visual arts 57.4
Classic 57.2
Collaboration 56.5

Microsoft
created on 2022-01-22

person 99.8
text 99.6
clothing 96.9
man 91.5
suit 72.4
posing 47.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 96.3%
Sad 1%
Angry 0.9%
Happy 0.7%
Confused 0.7%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 30-40
Gender Male, 100%
Happy 54.5%
Fear 18.6%
Calm 16.5%
Disgusted 2.5%
Confused 2.2%
Surprised 2%
Angry 2%
Sad 1.8%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 77.8%
Angry 13.8%
Confused 2.6%
Sad 2.4%
Happy 1%
Surprised 0.9%
Disgusted 0.8%
Fear 0.7%

AWS Rekognition

Age 18-24
Gender Male, 62.5%
Calm 83.7%
Sad 11.5%
Angry 1.2%
Surprised 0.9%
Fear 0.7%
Confused 0.7%
Happy 0.7%
Disgusted 0.6%

AWS Rekognition

Age 18-26
Gender Female, 87%
Calm 99%
Angry 0.3%
Sad 0.2%
Surprised 0.2%
Confused 0.1%
Happy 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 25-35
Gender Female, 100%
Fear 77.6%
Calm 14.8%
Surprised 2.6%
Disgusted 1.5%
Sad 1.2%
Angry 1%
Confused 0.9%
Happy 0.4%

AWS Rekognition

Age 16-24
Gender Female, 96.7%
Calm 89.2%
Sad 9.7%
Fear 0.4%
Confused 0.2%
Disgusted 0.2%
Surprised 0.2%
Happy 0.1%
Angry 0.1%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Suit
Person 99.1%
Person 98.4%
Person 98.2%
Person 97.6%
Person 97.3%
Person 97.3%
Person 97.2%
Person 96.7%
Person 84.2%
Person 43.5%
Tie 86.2%
Suit 79.2%

Text analysis

Amazon

PROOF
SAINT
SAINT LOUIS
LOUIS
MARTIN
MARTIN SCHWEIG
SCHWEIG

Google

PROOF MARTIN SCHWEIG SAINT LOUIS
PROOF
MARTIN
SCHWEIG
SAINT
LOUIS