Human Generated Data

Title

Untitled (Harold Rugg debating on stage at Benjamin Franklin Hotel)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5142
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Harold Rugg debating on stage at Benjamin Franklin Hotel)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.5
Person 99.5
Person 97.9
Crowd 92.7
Person 87.8
Person 87.3
Person 87.2
Person 81.1
Audience 80
People 68.8
Priest 64.4
Indoors 62.5
Interior Design 61.7
Press Conference 57.6
Linen 55.4
Home Decor 55.4

Imagga
created on 2022-01-23

office 41.6
businessman 41.5
business 40.1
work 33.8
people 33.5
male 33.3
man 32.9
person 30.5
group 29.8
desk 29.6
professional 29.1
team 28.7
meeting 27.3
adult 26.3
room 25.8
job 25.7
businesswoman 25.5
teamwork 25
corporate 24.9
table 23.9
executive 23
businesspeople 22.8
worker 22.4
working 22.1
colleagues 21.4
men 19.8
indoors 19.3
newspaper 18.5
computer 18.5
happy 18.2
talking 18.1
manager 17.7
communication 17.6
brass 16.9
women 16.6
classroom 16.4
wind instrument 16.4
smiling 15.9
sitting 15.5
together 14.9
education 14.7
successful 13.7
conference 13.7
musical instrument 13.5
modern 13.3
product 13
associates 12.8
indoor 12.8
suit 12.6
plan 12.3
teacher 12.2
success 12.1
occupation 11.9
laptop 11.8
coworkers 11.8
board 11.8
life 10.9
confident 10.9
chair 10.9
employee 10.7
cooperation 10.6
medical 10.6
partnership 10.6
cornet 10.6
career 10.4
presentation 10.2
patient 10.2
company 10.2
creation 10.1
collaboration 9.8
cheerful 9.8
interior 9.7
partners 9.7
partner 9.7
technology 9.7
diversity 9.6
lifestyle 9.4
casual 9.3
smile 9.3
explaining 8.9
building 8.8
couple 8.7
case 8.6
happiness 8.6
workplace 8.6
ethnic 8.6
doctor 8.5
finance 8.5
study 8.4
color 8.3
20s 8.2
new 8.1
handsome 8
looking 8
home 8
hospital 7.9
student 7.9
seminar 7.9
diverse 7.8
nurse 7.8
teaching 7.8
discussion 7.8
corporation 7.7
planning 7.7
30s 7.7
attractive 7.7
project 7.7
collar 7.7
boss 7.7
hand 7.6
daily 7.5
hall 7.5
mature 7.4
blackboard 7.3
entrepreneur 7.3
waiter 7.3
portrait 7.1
idea 7.1
day 7.1
school 7.1

Google
created on 2022-01-23

Photograph 94.1
Black-and-white 86
Style 84.1
Building 78.6
Font 77.1
Chair 76.5
Snapshot 74.3
Monochrome photography 74.2
Monochrome 73.1
Pianist 71.8
Room 70.5
Suit 68.4
Art 67
Piano 65.9
Music 65.7
Table 65.4
Classic 63.8
Stock photography 63.6
Recital 63
Vintage clothing 61.8

Microsoft
created on 2022-01-23

text 99.5
music 94.5
person 79.2
furniture 71.8
clothing 70.3
table 61.3
piano 57
black and white 53.7

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 79%
Confused 7.8%
Angry 6.7%
Sad 3.5%
Disgusted 1.2%
Surprised 0.8%
Happy 0.6%
Fear 0.3%

AWS Rekognition

Age 51-59
Gender Male, 99.7%
Calm 28.5%
Sad 24.1%
Happy 19.4%
Surprised 16%
Confused 3.9%
Fear 3.6%
Disgusted 2.7%
Angry 1.9%

AWS Rekognition

Age 49-57
Gender Male, 55.9%
Calm 99.8%
Angry 0%
Surprised 0%
Disgusted 0%
Sad 0%
Fear 0%
Confused 0%
Happy 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people sitting at a piano 89.8%
a person sitting at a piano 88.3%
a group of men sitting at a piano 84.4%

Text analysis

Amazon

TALKS.
a
15594.
RVGC, TALKS.
RVGC,
15594

Google

4. 15594. RUsC TALKS.
RUsC
TALKS.
4.
15594.