Human Generated Data

Title

Untitled (aerial view of formally dressed crowd in foyer)
Date

1958
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4656
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (aerial view of formally dressed crowd in foyer)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1958

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 98.4
Human 98.4
Person 96.2
Crowd 95.2
Person 94
Audience 91.3
Person 83.7
People 82.3
Person 81.5
Person 79.5
Person 75.2
Person 73.9
Indoors 68.5
Person 67.3
Person 66.3
Person 66.3
Room 64.4
Person 63.7
Text 63.3
Photography 62.8
Photo 62.8
Clothing 61.2
Apparel 61.2
Portrait 61.1
Face 61.1
School 59.9
Classroom 59.9
Person 56.2
Clinic 56
Person 46.6

Imagga
created on 2021-12-14

people 36.8
person 34.6
man 34
nurse 33
male 31.9
working 26.5
medical 26.5
patient 26.3
doctor 25.4
professional 25
adult 24.2
office 23.4
businessman 22.1
work 22
team 21.5
negative 21.1
specialist 21.1
business 19.4
medicine 19.4
hospital 19.2
surgeon 18.7
film 18.7
worker 18.7
indoors 17.6
businesswoman 17.3
meeting 16.9
health 16.7
clinic 16.1
coat 16.1
care 15.6
men 15.4
laboratory 15.4
smiling 15.2
technology 14.8
lab 14.6
desk 14.5
test 14.4
computer 14.4
businesspeople 14.2
table 14.1
teamwork 13.9
group 13.7
illness 13.3
happy 13.2
photographic paper 12.9
occupation 12.8
suit 12.6
horizontal 12.6
job 12.4
biology 12.3
together 12.3
cheerful 12.2
sitting 12
room 12
women 11.9
case 11.7
colleagues 11.7
portrait 11.6
talking 11.4
couple 11.3
two 11
student 10.9
lifestyle 10.8
scientist 10.8
holding 10.7
human 10.5
research 10.5
home 10.4
corporate 10.3
equipment 10.1
face 9.9
science 9.8
chemical 9.7
expertise 9.7
scientific 9.7
chemistry 9.7
30s 9.6
looking 9.6
day 9.4
senior 9.4
casual 9.3
mature 9.3
hand 9.1
lab coat 9
chemist 8.9
biotechnology 8.8
education 8.7
photographic equipment 8.6
serious 8.6
attractive 8.4
color 8.3
20s 8.2
indoor 8.2
laptop 8.2
interior 8
bride 7.9
love 7.9
biochemistry 7.9
development 7.9
happiness 7.8
surgery 7.8
physician 7.8
40s 7.8
concentration 7.7
clothing 7.6
uniform 7.6
instrument 7.4
presentation 7.4
sick person 7.3
successful 7.3
to 7.1
life 7
modern 7

Google
created on 2021-12-14

Photograph 94.2
Black 89.6
Hat 87.2
Black-and-white 87
Style 84.1
Art 80.8
Adaptation 79.3
Monochrome photography 77
Monochrome 75.2
Snapshot 74.3
Font 73.9
Event 72.5
Photo caption 67.9
Room 67.3
Vintage clothing 67.1
Stock photography 65.7
Visual arts 65.5
Crowd 62.7
Sun hat 59.1
Illustration 58.6

Microsoft
created on 2021-12-14

text 97.8
person 96.2
clothing 94.1
group 88.4
posing 80.3
people 73.6
woman 70.3
man 69.9
dance 55

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 95.4%
Calm 50.7%
Sad 42%
Happy 2.6%
Angry 2%
Confused 1.6%
Disgusted 0.4%
Fear 0.4%
Surprised 0.4%

AWS Rekognition

Age 30-46
Gender Female, 94.2%
Calm 55.7%
Sad 42%
Happy 1%
Confused 0.5%
Angry 0.5%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 24-38
Gender Female, 56.6%
Sad 49.8%
Calm 43.6%
Happy 3.7%
Confused 1%
Angry 0.9%
Surprised 0.5%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 21-33
Gender Male, 83.3%
Calm 74.6%
Sad 15.1%
Happy 5.9%
Surprised 1.8%
Confused 1.6%
Disgusted 0.4%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 14-26
Gender Male, 88.8%
Happy 45.6%
Sad 19.8%
Calm 17.2%
Angry 9.6%
Fear 4.1%
Confused 2%
Surprised 1.1%
Disgusted 0.6%

AWS Rekognition

Age 26-40
Gender Male, 61%
Calm 96.7%
Surprised 1.4%
Sad 1%
Fear 0.3%
Happy 0.3%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 9-19
Gender Male, 64.9%
Angry 83.9%
Happy 8.1%
Calm 6.7%
Sad 0.4%
Confused 0.3%
Surprised 0.3%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 41-59
Gender Female, 56.5%
Calm 92.6%
Happy 2.7%
Sad 2%
Confused 1%
Angry 0.7%
Surprised 0.5%
Disgusted 0.4%
Fear 0.1%

AWS Rekognition

Age 21-33
Gender Male, 82.2%
Calm 73%
Happy 24.7%
Angry 0.8%
Sad 0.7%
Surprised 0.5%
Confused 0.3%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 44-62
Gender Male, 94.6%
Sad 70.7%
Calm 22.4%
Happy 5.4%
Angry 0.8%
Confused 0.5%
Disgusted 0.1%
Fear 0.1%
Surprised 0%

AWS Rekognition

Age 10-20
Gender Female, 51.6%
Calm 76.7%
Sad 14.6%
Happy 8%
Angry 0.4%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 13-25
Gender Female, 62.5%
Happy 76%
Calm 14.6%
Surprised 3.1%
Sad 2.2%
Confused 1.5%
Angry 1.3%
Fear 0.9%
Disgusted 0.4%

AWS Rekognition

Age 22-34
Gender Female, 62.8%
Happy 97.5%
Calm 1.4%
Sad 0.5%
Surprised 0.2%
Angry 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 13-23
Gender Female, 89.1%
Calm 87.3%
Happy 10.9%
Surprised 0.7%
Sad 0.4%
Confused 0.3%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 18-30
Gender Female, 69.7%
Calm 76.2%
Sad 10.4%
Happy 9.6%
Confused 1.2%
Surprised 1.1%
Disgusted 0.6%
Fear 0.5%
Angry 0.4%

AWS Rekognition

Age 9-19
Gender Female, 87.7%
Happy 38.6%
Fear 28.2%
Sad 14.8%
Surprised 7%
Calm 5.4%
Confused 2.6%
Disgusted 2.3%
Angry 1.1%

AWS Rekognition

Age 49-67
Gender Male, 77.1%
Calm 86.6%
Sad 7.1%
Happy 5.1%
Confused 0.5%
Angry 0.3%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 13-23
Gender Male, 84.6%
Calm 55.8%
Happy 30.9%
Sad 6.8%
Fear 2.2%
Angry 1.6%
Disgusted 1.3%
Confused 0.9%
Surprised 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 98.4%

Captions

Microsoft

a group of people posing for a photo 96.1%
a group of people posing for the camera 96%
a group of people posing for a picture 95.9%

Text analysis

Amazon

252511
DE
VOORSELF
BEER VOORSELF
BEER
and

Google

-
MJI7--YT37A°2 - - NAGOX
MJI7--YT37A°2
NAGOX