Human Generated Data

Title

Untitled (group portrait in office)

Date

1951

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10174

Human Generated Data

Title

Untitled (group portrait in office)

People

Artist: Martin Schweig, American 20th century

Date

1951

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10174

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Accessory 99.4
Tie 99.4
Accessories 99.4
Human 98.5
Person 98.5
Person 97.9
Person 97.6
Person 97.5
Tie 96.9
Tie 96.8
Person 96.6
Person 96
Tie 95.9
Clothing 95.3
Apparel 95.3
Overcoat 94.6
Coat 94.6
Person 94.3
Person 93.2
Person 91.8
Person 91.7
Person 91
People 85
Suit 84
Suit 77
Crowd 73.8
Suit 72.7
Tuxedo 70.3
Suit 68
Suit 62.8
Room 62.6
Indoors 62.6
Court 59.7
Suit 58
Family 55.2

Clarifai
created on 2023-10-26

people 99.9
group 99.9
group together 99.4
administration 98.3
many 98.3
leader 98.2
adult 98.2
several 97.9
man 96.5
woman 95
five 93
three 92.8
four 92.3
monochrome 88
medical practitioner 87.3
war 86.4
partnership 80.5
portrait 80.2
facial expression 77.9
military 75.1

Imagga
created on 2022-01-22

nurse 91.3
man 38.3
doctor 35.7
male 34.8
people 32.9
hospital 30.9
professional 29.5
medical 28.2
adult 27.3
person 27.1
uniform 26.4
happy 26.3
team 26
medicine 24.7
group 23.4
care 23
health 22.2
office 21.7
business 20.6
stethoscope 20.4
military uniform 19.6
portrait 19.4
clinic 19.4
clothing 19
indoors 18.4
home 18.3
patient 18.3
job 17.7
smiling 17.4
work 17.3
doctors 16.7
kin 16.7
teamwork 16.7
coat 16.6
men 16.3
room 16
businessman 15.9
smile 15.7
colleagues 15.5
elderly 15.3
mature 14.9
businesswoman 14.5
looking 14.4
working 14.1
meeting 14.1
cheerful 13.8
exam 13.4
businesspeople 13.3
standing 13
lifestyle 13
occupation 12.8
20s 12.8
casual 12.7
physician 12.7
consultant 12.7
women 12.7
staff 12.4
classroom 12.3
senior 12.2
glasses 12
camera 12
child 12
indoor 11.9
clinical 11.7
color 11.7
expertise 11.6
30s 11.5
face 11.4
corporate 11.2
successful 11
happiness 11
confident 10.9
horizontal 10.9
discussion 10.7
interior 10.6
mid adult 10.6
confidence 10.5
attractive 10.5
lab coat 10.4
discussing 9.8
examination 9.7
success 9.7
partnership 9.6
brunette 9.6
couple 9.6
two 9.3
inside 9.2
friendly 9.1
mother 9.1
old 9.1
worker 8.9
general practitioner 8.9
coworkers 8.8
together 8.8
specialist 8.7
illness 8.6
manager 8.4
suit 8.1
handsome 8
family 8
innocent 8
corridor 7.9
heal 7.8
diagnosis 7.8
consumer goods 7.8
education 7.8
40s 7.8
covering 7.7
healthy 7.6
desk 7.6
executive 7.4
practitioner 7.3
aged 7.2
building 7.1
love 7.1

Google
created on 2022-01-22

Hairstyle 95.1
Standing 86.4
Dress 86.1
Social group 82.6
Suit 81.9
Vintage clothing 78
Chair 77.2
Classic 76.5
Formal wear 76.1
Blazer 76
Event 74.9
Monochrome 74.8
Team 71.7
Smile 71.3
Family reunion 70.1
History 68.9
Room 68.5
Monochrome photography 68.4
Picture frame 68.2
Table 66

Microsoft
created on 2022-01-22

person 100
posing 99.8
text 98.3
clothing 98
wall 97.6
group 96.9
smile 95.5
suit 95.2
standing 93.3
man 90.5
people 89.1
human face 68
woman 53.5
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Calm 66.9%
Confused 26.1%
Surprised 1.9%
Angry 1.5%
Disgusted 1.5%
Sad 0.9%
Happy 0.8%
Fear 0.5%

AWS Rekognition

Age 47-53
Gender Female, 100%
Happy 73.8%
Angry 9.6%
Surprised 4.3%
Disgusted 3.3%
Fear 2.7%
Confused 2.5%
Sad 2.1%
Calm 1.6%

AWS Rekognition

Age 58-66
Gender Female, 98.6%
Happy 93%
Surprised 2.3%
Confused 1.4%
Calm 1.1%
Fear 0.9%
Angry 0.6%
Sad 0.4%
Disgusted 0.3%

AWS Rekognition

Age 43-51
Gender Female, 100%
Calm 59%
Confused 12.9%
Surprised 10.4%
Angry 5.9%
Sad 3.8%
Happy 3.3%
Fear 2.7%
Disgusted 2%

AWS Rekognition

Age 41-49
Gender Female, 100%
Happy 99.4%
Surprised 0.2%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%
Sad 0.1%
Calm 0.1%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 88%
Surprised 7.8%
Confused 1.6%
Fear 1.1%
Angry 0.6%
Disgusted 0.4%
Happy 0.3%
Sad 0.2%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Surprised 70.3%
Happy 13.5%
Calm 6.1%
Confused 3.6%
Fear 3%
Angry 1.8%
Disgusted 1.3%
Sad 0.5%

AWS Rekognition

Age 36-44
Gender Male, 100%
Happy 37.6%
Calm 34.3%
Angry 8.9%
Confused 8%
Disgusted 3.3%
Sad 3.1%
Surprised 3.1%
Fear 1.7%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 84.4%
Sad 4.1%
Confused 2.6%
Disgusted 2.5%
Surprised 2.4%
Happy 2%
Angry 1.4%
Fear 0.5%

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Calm 94.4%
Confused 1.5%
Angry 1.3%
Surprised 0.9%
Happy 0.7%
Sad 0.5%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 38-46
Gender Male, 100%
Happy 63.6%
Confused 25.6%
Surprised 4.4%
Calm 1.8%
Angry 1.5%
Disgusted 1.4%
Sad 0.9%
Fear 0.8%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 50
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.4%
Person 98.5%
Suit 84%

Categories

Text analysis

Amazon

PROOF
MARTIN
SAINT
SAINT LOUIS
LOUIS
MARTIN SCHWEIG
SCHWEIG
PROOF 19
19

Google

PROOF MARTIN SCHWE SAINT L OUIS
SAINT
PROOF
MARTIN
SCHWE
L
OUIS