Human Generated Data

Title

Untitled (woman surrounded by men in tuxes, Mask and Wig: University of Pennsylvania, Philadelphia, Pennsylvania)
Date

1937, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.299
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman surrounded by men in tuxes, Mask and Wig: University of Pennsylvania, Philadelphia, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 98.2
Person 98.1
Person 97.6
Person 97.4
Person 97.1
Person 96.4
Crowd 96.3
Person 96.2
Person 95.5
Person 95.2
Person 93.6
Person 93.1
Person 91.6
People 86.7
Suit 78.1
Clothing 78.1
Apparel 78.1
Coat 78.1
Overcoat 78.1
Audience 69.3
Suit 67.4
Suit 65.3
Press Conference 62.3
Jury 57.9

Imagga
created on 2022-01-08

groom 77.4
businessman 56.5
business 49.8
man 44.4
team 43
corporate 43
meeting 41.5
office 40.2
teamwork 39.9
people 39.6
businesswoman 39.1
male 39
group 37.1
businesspeople 37
professional 33.5
person 33.4
colleagues 32.1
men 30.1
executive 28.9
happy 28.8
work 28.3
suit 27.1
adult 26.5
success 25.8
job 25.7
smile 24.2
communication 23.5
manager 22.4
successful 22
kin 21.6
together 21
working 20.3
smiling 20.3
staff 20.1
businessmen 19.5
confident 19.1
women 19
coworkers 18.7
company 18.6
laptop 18.2
worker 18.1
handsome 17.8
career 17
attractive 16.8
discussing 16.7
partner 16.4
corporation 16.4
partnership 16.3
sitting 15.5
workplace 15.3
couple 14.8
associates 14.8
diverse 14.7
cooperation 14.5
busy 14.5
diversity 14.4
leadership 14.4
boss 14.4
talking 14.3
portrait 14.2
happiness 14.1
computer 13.6
workers 13.6
employee 13
table 13
discussion 12.7
partners 12.6
30s 12.5
desk 12.3
standing 12.2
presentation 12.1
modern 11.9
businesswomen 11.8
conference 11.7
lifestyle 11.6
holding 11.6
ethnic 11.4
cheerful 11.4
looking 11.2
pretty 11.2
building 11.1
20s 11
indoor 11
planning 10.6
indoors 10.5
formal 10.5
black 10
mid adult 9.7
four 9.6
student 8.9
crew 8.9
handshake 8.8
brass 8.7
tie 8.5
room 8.5
finance 8.5
entrepreneur 8.4
interaction 7.9
30 35 years 7.9
well dressed 7.8
businessperson 7.8
leader 7.7
expression 7.7
hand 7.6
females 7.6
wind instrument 7.5
mature 7.4
friendly 7.3
lady 7.3

Google
created on 2022-01-08

Coat 87.8
Collar 83.5
Suit 79.4
Blazer 77.7
Formal wear 77.6
Font 74
White-collar worker 74
Crew 73.6
Event 73.5
Vintage clothing 71.1
Team 69.7
Art 64.5
Classic 63.7
Stock photography 63.5
History 60.1
Uniform 58.9
Monochrome 55.5
Retro style 52.9
Family reunion 52.5
Sitting 52.4

Microsoft
created on 2022-01-08

person 100
posing 99.3
clothing 96.9
text 95.5
man 94.7
group 90.8
smile 84.4
standing 79.4
old 75
suit 71.1
black 67.7
dressed 35
clothes 19
crowd 0.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Male, 99.4%
Happy 95.9%
Angry 2%
Confused 0.7%
Surprised 0.5%
Calm 0.4%
Sad 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.5%
Happy 99.4%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Calm 0.1%
Sad 0.1%

AWS Rekognition

Age 18-26
Gender Male, 100%
Sad 21.5%
Calm 20.2%
Fear 18%
Disgusted 14.3%
Happy 10.9%
Confused 5.3%
Surprised 5.2%
Angry 4.7%

AWS Rekognition

Age 12-20
Gender Female, 99.9%
Happy 98%
Angry 0.5%
Calm 0.3%
Surprised 0.3%
Confused 0.3%
Disgusted 0.3%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Female, 96.8%
Calm 96.9%
Happy 1.9%
Sad 0.6%
Angry 0.2%
Surprised 0.2%
Confused 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Happy 87.1%
Calm 10.2%
Confused 0.6%
Surprised 0.6%
Angry 0.5%
Disgusted 0.3%
Fear 0.3%
Sad 0.3%

AWS Rekognition

Age 20-28
Gender Male, 97.2%
Calm 94.5%
Sad 2.8%
Confused 1.5%
Fear 0.3%
Surprised 0.2%
Angry 0.2%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 18-24
Gender Male, 99.6%
Calm 56.4%
Happy 25.4%
Surprised 5.9%
Confused 3.6%
Angry 3.2%
Disgusted 2.2%
Fear 1.6%
Sad 1.6%

AWS Rekognition

Age 22-30
Gender Male, 97.5%
Calm 85.8%
Surprised 4.2%
Sad 2.9%
Happy 2.5%
Confused 1.4%
Angry 1.3%
Fear 1%
Disgusted 0.8%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Calm 51.1%
Angry 13.3%
Confused 11.2%
Surprised 7%
Sad 6.8%
Disgusted 5.3%
Fear 3.5%
Happy 1.8%

AWS Rekognition

Age 20-28
Gender Female, 71.9%
Calm 42.3%
Sad 34.3%
Surprised 6.9%
Disgusted 4.3%
Fear 3.9%
Angry 2.9%
Happy 2.8%
Confused 2.7%

AWS Rekognition

Age 21-29
Gender Female, 94.7%
Sad 78.8%
Fear 13.7%
Calm 2.8%
Confused 2.4%
Disgusted 0.8%
Angry 0.7%
Surprised 0.5%
Happy 0.4%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Suit 78.1%

Captions

Microsoft

a group of people posing for a photo 99.2%
a group of people posing for the camera 99.1%
a group of people posing for a picture 99%