Human Generated Data

Title

Untitled (piano player and crowd at bottom of stairs)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4535
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (piano player and crowd at bottom of stairs)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.4
Human 99.4
Person 99.2
Person 99.1
Clinic 98.5
Person 97.8
Person 97.5
Person 97.1
Person 94.3
Hospital 93.4
Operating Theatre 87.4
Person 84.9
Person 73.4
Doctor 72.3
Person 69.1
Person 66.2
People 57.4
Clothing 56.5
Apparel 56.5

Imagga
created on 2022-01-23

man 49.8
businessman 46.9
male 42.6
person 41.3
professional 41.1
adult 41.1
business 40.1
lab coat 38.7
specialist 38.3
office 37.9
meeting 37.7
people 37.4
team 36.8
colleagues 35
businesswoman 34.6
businesspeople 34.2
coat 33.6
executive 33.6
work 31.4
group 29.9
teamwork 28.8
desk 28.4
working 28.3
worker 27.8
happy 27.6
corporate 27.5
groom 25.1
patient 24.9
smiling 24.6
table 24.3
laptop 23.7
computer 23.3
sitting 23.2
indoors 22
indoor 21.9
room 21.1
talking 20
nurse 19.9
job 19.5
suit 18.9
associates 18.7
casual 18.7
teacher 18.5
confident 18.2
men 18.1
together 17.5
women 17.4
clothing 16.8
medical 16.8
coworkers 16.7
conference 16.6
portrait 16.2
doctor 16
communication 16
smile 15.7
modern 15.4
garment 15.3
looking 15.2
manager 14.9
20s 14.7
successful 14.7
cooperation 14.5
30s 14.5
explaining 13.8
hospital 13.8
success 13.7
practitioner 13.7
40s 13.6
face 13.5
boss 13.4
handsome 13.4
formal 13.4
couple 13.1
presentation 13
mature 13
discussion 12.7
health 12.5
staff 12.5
ethnic 12.4
color 12.3
educator 12
employee 11.9
horizontal 11.7
mid adult 11.6
lifestyle 11.6
workplace 11.4
education 11.3
home 11.2
occupation 11
boardroom 10.9
discussing 10.8
leader 10.6
cheerful 10.6
four 10.6
attractive 10.5
technology 10.4
senior 10.3
company 10.2
sick person 10.1
case 9.9
clinic 9.9
care 9.9
crew 9.9
30 35 years 9.8
businessmen 9.8
planning 9.6
standing 9.6
career 9.5
two 9.3
bright 9.3
hand 9.1
collaboration 8.9
25 30 years 8.8
medicine 8.8
colleague 8.8
businessperson 8.8
employment 8.7
corporation 8.7
busy 8.7
student 8.5
treatment 8.3
hall 8
businesswomen 7.9
happiness 7.8
diverse 7.8
partners 7.8
project 7.7
diversity 7.7
collar 7.7
finance 7.6
multi 7.6
plan 7.6
training 7.4
life 7.1
to 7.1
day 7.1

Google
created on 2022-01-23

Black-and-white 85.6
Style 83.9
Monochrome photography 75.1
Monochrome 73.9
Room 70.9
Event 69.4
Hat 68.8
T-shirt 68.5
Suit 67.2
Font 66.8
Service 65.2
Stock photography 64.6
Uniform 64.1
Team 63.8
Motor vehicle 63.5
Vintage clothing 62
Crew 60.1
Machine 57.4
Advertising 54.9
Photo caption 54

Microsoft
created on 2022-01-23

person 97.6
text 97.1
clothing 89.5
man 79.3
posing 63.7
group 59
black and white 58
wedding dress 57.2

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 99.8%
Calm 99.8%
Sad 0%
Confused 0%
Disgusted 0%
Surprised 0%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 99.7%
Calm 98.7%
Surprised 0.5%
Sad 0.3%
Happy 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 35-43
Gender Female, 56.2%
Surprised 64.3%
Calm 32.1%
Confused 0.9%
Sad 0.8%
Happy 0.7%
Disgusted 0.7%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 27-37
Gender Male, 96.9%
Calm 96.8%
Happy 1.3%
Sad 0.9%
Confused 0.4%
Surprised 0.3%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Male, 95.1%
Sad 56.5%
Calm 27.7%
Confused 8.5%
Surprised 3.6%
Disgusted 1.1%
Angry 1.1%
Happy 0.8%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people posing for a photo 93.1%
a group of people posing for the camera 93%
a group of people posing for a picture 92.9%

Text analysis

Amazon

13542
St

Google

13542 13542,
13542
13542,