Human Generated Data

Title

Untitled (Henry Ringling North leaning over table with model of train cars)
Date

1942
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4935
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Henry Ringling North leaning over table with model of train cars)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.5
Human 98.5
Person 97.8
Person 91.5
Face 84.4
Computer Keyboard 78.2
Electronics 78.2
Computer 78.2
Hardware 78.2
Keyboard 78.2
Computer Hardware 78.2
Person 75.1
Portrait 64.2
Photography 64.2
Photo 64.2
Text 64.1
Building 63.5
Indoors 61.4
Furniture 55.1
Person 49.9

Imagga
created on 2022-01-23

computer 54.8
desk 44.8
laptop 44.7
office 43.7
keyboard 41.4
business 41.4
working 40.7
businessman 33.6
work 33
professional 30.9
table 30.6
male 30.6
man 29.8
people 29.6
person 27.2
job 26.6
businesswoman 25.5
businesspeople 24.7
adult 24.6
hand 24.4
corporate 24.1
notebook 24
key 23.6
indoors 22.9
technology 20.8
worker 20.5
workplace 20.1
portrait 19.5
typing 18.6
occupation 18.4
hands 18.3
meeting 17.9
specialist 17.5
sitting 17.2
happy 17
modern 16.9
smiling 16.7
executive 16.6
communication 16
document 15.9
button 15.9
busy 15.5
success 15.3
team 15.3
looking 15.2
human 15
face 14.9
teamwork 14.9
indoor 14.6
men 14.6
colleagues 14.6
group 14.5
casual 14.4
pharmacist 13.7
coat 13.6
using 13.5
horizontal 13.4
close 13.2
smile 12.9
home 12.8
paperwork 12.7
financial 12.5
finance 11.9
paper 11.8
lifestyle 11.6
bright 11.5
doctor 11.3
attractive 11.2
patient 11.2
finger 11.1
associates 10.8
planning 10.6
medical 10.6
showing 10.3
hospital 10.3
women 10.3
manager 10.3
company 10.3
20s 10.1
color 10
suit 9.9
one 9.7
look 9.7
formal 9.6
wireless 9.6
career 9.5
word 9.4
day 9.4
light 9.4
camera 9.3
student 9.2
room 9.2
clinic 9.2
data 9.2
confident 9.1
care 9.1
lab coat 9
equipment 9
furniture 9
coworkers 8.9
25 30 years 8.8
health professional 8.8
together 8.8
closeup 8.8
touching 8.8
employment 8.7
education 8.7
secretary 8.7
desktop 8.7
device 8.4
mature 8.4
archive 8.3
investment 8.3
jacket 8.3
successful 8.3
alone 8.2
cheerful 8.1
handsome 8
monitor 8
nurse 8
discussing 7.9
pushing 7.9
conference 7.8
consultant 7.8
discussion 7.8
pretty 7.7
health 7.7
fingers 7.6
happiness 7.1
medicine 7.1
model 7

Google
created on 2022-01-23

Eyewear 80.5
Font 79.2
Picture frame 76.1
Monochrome photography 72.6
Suit 72.3
Monochrome 69.7
White-collar worker 66.5
Audio equipment 66.2
Room 64.1
Stock photography 62.2
Office equipment 61.4
Machine 61.1
Electronic instrument 59.5
History 56.7
Collection 51.9
Brand 51.8

Microsoft
created on 2022-01-23

text 99.9
drawing 71.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 54-64
Gender Male, 91.1%
Happy 56.9%
Calm 15%
Angry 9.3%
Confused 5.6%
Surprised 4.5%
Sad 3.2%
Fear 2.9%
Disgusted 2.7%

AWS Rekognition

Age 33-41
Gender Male, 98.9%
Calm 33.9%
Happy 30.5%
Disgusted 9%
Angry 8%
Sad 6.1%
Confused 5.9%
Surprised 4.9%
Fear 1.6%

AWS Rekognition

Age 49-57
Gender Male, 97.3%
Calm 79.2%
Sad 13%
Confused 3.1%
Angry 3%
Surprised 0.7%
Disgusted 0.6%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Male, 99.5%
Calm 54%
Happy 30.7%
Sad 4.7%
Confused 4.1%
Disgusted 2.4%
Fear 2.1%
Angry 1.1%
Surprised 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Computer Keyboard 78.2%

Captions

Microsoft

diagram, engineering drawing 82.6%

Text analysis

Amazon

ABUSIVE
LANGUAGE
PROHIBITED
STRICTLY
19175
102
2
-
10g
2 M.C. RYHCE
M.C.
- MERT mct
RYHCE
mct
MERT
02

Google

ABUSIVE
LANGUAGE
19175· ABUSIVE LANGUAGE STRICTLY PROHIBITED 19175.
19175·
STRICTLY
PROHIBITED
19175.