Human Generated Data

Title

Untitled (crowd at formal function)

Date

1937

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4508

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd at formal function)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 97.5
Person 97.5
Person 96.8
Person 95.7
Person 94.8
Person 94.4
Clothing 94.2
Apparel 94.2
Person 93.1
Crowd 83.5
Face 83
Coat 82.8
Overcoat 82.8
Person 82
Person 78.4
Indoors 74.3
People 72.1
Person 71.6
Person 69.6
Dance 67.9
Leisure Activities 67.6
Suit 64.2
Person 63.9
Photography 63.1
Photo 63.1
Portrait 62.9
Dance Pose 59.5
Room 58.3
Person 58.3
Performer 57.5
Dress 57.4
Tuxedo 57.1
Wedding 57
Sailor Suit 56.7
Person 47
Person 46.2

Imagga
created on 2022-01-23

nurse 100
doctor 58.3
medical 52.1
man 47.7
hospital 46.4
coat 42.4
medicine 38.8
professional 37.7
health 36.1
specialist 34.9
clinic 33.6
male 33.4
person 31.9
lab coat 31.4
people 30.7
care 30.5
stethoscope 30.3
adult 29.8
team 29.6
occupation 29.3
job 27.4
mature 26
uniform 25.8
practitioner 24.6
patient 23.4
work 22
doctors 21.6
looking 21.6
worker 21.5
happy 21.3
business 21.3
elderly 21.1
profession 21.1
surgeon 20.6
portrait 20.1
senior 19.7
laboratory 19.3
30s 19.2
smiling 18.8
working 17.7
colleagues 17.5
businessman 16.8
clinical 16.6
illness 16.2
indoors 15.8
teamwork 15.8
student 15.8
expertise 15.5
confident 15.5
men 15.5
staff 15.3
camera 14.8
standing 14.8
lab 14.6
group 14.5
bright 14.3
smile 14.3
office 13.7
handsome 13.4
research 13.3
friendly 12.8
indoor 12.8
day 12.6
healthy 12
treatment 11.9
physician 11.7
science 11.6
exam 11.5
businesspeople 11.4
face 11.4
couple 11.3
40s 10.7
middle aged 10.7
assistant 10.7
health care 10.7
practice 10.6
mid adult 10.6
test 10.6
technology 10.4
lifestyle 10.1
20s 10.1
general practitioner 9.9
fifties 9.8
associates 9.8
clothing 9.8
healing 9.8
50s 9.8
human 9.8
consultant 9.7
serious 9.5
happiness 9.4
casual 9.3
two 9.3
good mood 8.8
diagnosis 8.8
scientist 8.8
look 8.8
thirties 8.8
women 8.7
chemistry 8.7
sick 8.7
education 8.7
old 8.4
color 8.3
inside 8.3
businesswoman 8.2
equipment 8.1
aged 8.1
clinician 7.9
surgical 7.9
expert 7.9
coworkers 7.9
discussing 7.9
heal 7.9
forties 7.8
surgery 7.8
ill 7.8
examination 7.8
chemical 7.7
confidence 7.7
chart 7.7
biology 7.6
desk 7.6
garment 7.5
successful 7.3
cheerful 7.3
lady 7.3
room 7.3
attractive 7

Google
created on 2022-01-23

Photograph 94.2
Black-and-white 82.6
Font 82.2
Line 81.8
Art 79.9
Adaptation 79.3
Snapshot 74.3
Monochrome 72.8
Event 72.1
Uniform 71.4
Illustration 71
Monochrome photography 70.7
Suit 68.8
Crew 68
Photo caption 66
Room 64.3
Stock photography 63.6
Team 62.8
Crowd 61.8
History 56.4

Microsoft
created on 2022-01-23

person 99.5
text 95.9
group 84.8
wedding dress 84.1
man 80.1
clothing 78.9
bride 70.9
people 60.1
posing 47.2
old 45
crowd 1.8

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Female, 78.9%
Happy 35.7%
Sad 21.4%
Fear 14.5%
Confused 8.7%
Calm 8.1%
Surprised 6.1%
Disgusted 3.6%
Angry 1.9%

AWS Rekognition

Age 40-48
Gender Male, 93.5%
Calm 82.7%
Happy 5%
Surprised 3.7%
Sad 2.8%
Angry 2.4%
Confused 2%
Disgusted 1%
Fear 0.3%

AWS Rekognition

Age 27-37
Gender Female, 92.3%
Calm 91.3%
Happy 5%
Sad 2.5%
Confused 0.4%
Angry 0.2%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 48-54
Gender Female, 95.9%
Calm 86.5%
Sad 10.1%
Confused 1.2%
Disgusted 0.7%
Surprised 0.6%
Happy 0.4%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 41-49
Gender Male, 99%
Calm 43.5%
Confused 34.9%
Sad 16.6%
Angry 1.6%
Happy 1.2%
Surprised 0.8%
Disgusted 0.8%
Fear 0.6%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 90.5%
Sad 5.8%
Happy 1.2%
Confused 1.1%
Angry 0.5%
Disgusted 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 28-38
Gender Female, 81.8%
Calm 86.6%
Sad 5.9%
Fear 1.9%
Angry 1.5%
Surprised 1.4%
Confused 1%
Happy 1%
Disgusted 0.6%

AWS Rekognition

Age 22-30
Gender Female, 83.1%
Calm 99.6%
Sad 0.2%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%
Happy 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 22-30
Gender Male, 95.8%
Calm 97.2%
Sad 1.5%
Confused 0.5%
Surprised 0.2%
Fear 0.2%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Female, 95%
Calm 99.6%
Sad 0.2%
Angry 0.1%
Surprised 0%
Disgusted 0%
Happy 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 87.2%
Calm 45.4%
Confused 33.2%
Sad 13.5%
Disgusted 2%
Happy 1.9%
Fear 1.7%
Surprised 1.5%
Angry 0.8%

AWS Rekognition

Age 23-33
Gender Female, 55.3%
Calm 75.8%
Sad 15.1%
Fear 5.9%
Confused 1.8%
Disgusted 0.5%
Angry 0.3%
Surprised 0.3%
Happy 0.2%

AWS Rekognition

Age 22-30
Gender Female, 55.4%
Calm 63.5%
Confused 19.8%
Sad 11.4%
Angry 2.4%
Happy 1.4%
Fear 0.5%
Surprised 0.5%
Disgusted 0.4%

AWS Rekognition

Age 24-34
Gender Female, 99.5%
Calm 62.2%
Confused 14.4%
Happy 10.8%
Sad 8.3%
Fear 1.6%
Surprised 1.2%
Angry 0.8%
Disgusted 0.6%

AWS Rekognition

Age 22-30
Gender Female, 80%
Happy 35.8%
Sad 32%
Calm 16.6%
Fear 6.6%
Angry 3.6%
Confused 2%
Disgusted 1.8%
Surprised 1.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%
Suit 64.2%

Captions

Microsoft

a group of people posing for a photo 90.5%
a group of people standing in front of a crowd posing for the camera 88.7%
a group of people standing in front of a crowd 88.6%

Text analysis

Amazon

COM
8
AEROSS
ZOME AEROSS
ZOME
MUNICAL
32AB
32AB BYEER
BYEER
WORKED

Google

YT3JA2
32A8 YT3JA2 A3OM3330
32A8
A3OM3330