Human Generated Data

Title

Untitled (couple getting married, man raising right hand)
Date

1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4626
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple getting married, man raising right hand)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.5
Human 99.5
Person 99.2
Person 97.5
Accessory 96.2
Tie 96.2
Accessories 96.2
Apparel 94.3
Clothing 94.3
Lab 79.9
Machine 74.4
Furniture 73.6
Workshop 69.2
Coat 68.8
Housing 68.5
Building 68.5
Face 67.2
Table 66.5
Text 63.8
Photography 62.1
Portrait 62.1
Photo 62.1
Scientist 57.9
Microscope 56.6

Imagga
created on 2021-12-14

office 53.7
man 48.4
businessman 43.3
male 42.6
business 38.9
people 36.8
meeting 33
businesspeople 31.3
adult 31
person 30.2
businesswoman 30
computer 29.7
team 29.6
group 29
room 28
work 25.9
working 25.6
professional 24.8
desk 24.8
colleagues 24.3
happy 23.8
indoors 23.7
corporate 23.2
teamwork 22.3
classroom 22
laptop 21.9
men 20.6
job 20.4
executive 20.2
indoor 19.2
casual 18.7
table 18.4
sitting 18
worker 17.8
coworkers 17.7
associates 16.7
20s 16.5
together 15.8
conference 15.6
clinic 15.3
smiling 15.2
looking 15.2
lifestyle 15.2
discussion 13.6
talking 13.3
newspaper 13.2
barbershop 13.1
40s 12.7
women 12.7
modern 12.6
shop 12.4
color 12.2
cheerful 12.2
education 12.1
smile 12.1
manager 12.1
home 12
successful 11.9
communication 11.8
horizontal 11.7
suit 11.7
portrait 11.7
cooperation 11.6
handsome 11.6
busy 11.6
30s 11.5
face 11.4
success 11.3
technology 11.1
employee 11
happiness 11
confident 10.9
attractive 10.5
couple 10.5
career 10.4
nurse 10.3
patient 10.3
company 10.2
document 10.2
product 10.2
lab coat 10.2
hospital 10.1
25 30 years 9.8
businessmen 9.8
conversation 9.7
medical 9.7
employment 9.7
mid adult 9.7
coat 9.6
paper 9.5
females 9.5
day 9.4
student 9.4
doctor 9.4
two 9.3
presentation 9.3
focus 9.3
occupation 9.2
holding 9.1
teacher 8.9
collaboration 8.9
crew 8.9
discussing 8.8
restaurant 8.8
partner 8.7
four 8.6
workplace 8.6
ethnic 8.6
expression 8.5
adults 8.5
learning 8.5
mercantile establishment 8.4
mature 8.4
clothing 8.4
camera 8.3
building 8.3
idea 8
creation 8
boardroom 7.9
engineer 7.9
explaining 7.9
4 7.8
businessperson 7.8
concentration 7.7
partnership 7.7
hand 7.6
plan 7.6
keyboard 7.5
bright 7.2
interior 7.1

Google
created on 2021-12-14

Hat 84.6
Watercraft 79.2
Naval architecture 78.9
Smile 77.1
Monochrome photography 69.8
Art 69.7
Monochrome 69.4
Vintage clothing 68.6
Room 65.7
Machine 65
Engineering 63.5
Boat 63.2
Motor vehicle 62.8
Science 61.6
Font 60.8
History 59.8
Suit 59.6
Door 59.2
Job 56
Paper product 55.5

Microsoft
created on 2021-12-14

text 99.4
person 95.2
clothing 84.8
man 75.6
black and white 74.7
sink 58.5

Face analysis

Amazon

Google

AWS Rekognition

Age 42-60
Gender Male, 98.4%
Surprised 52.2%
Calm 33%
Sad 6.6%
Angry 3.9%
Confused 2%
Happy 1.9%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 30-46
Gender Female, 82.3%
Calm 99.5%
Sad 0.3%
Surprised 0.1%
Confused 0%
Angry 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 22-34
Gender Male, 97.3%
Calm 93.2%
Sad 3.2%
Angry 1.9%
Confused 0.7%
Surprised 0.6%
Happy 0.3%
Disgusted 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 96.2%

Captions

Microsoft

a group of people standing in front of a building 80%
a man standing in front of a building 74.3%
a group of men standing in front of a building 74.2%

Text analysis

Amazon

Lyon's
SERVICE
W
Stone
W U SERVICE
Lyon's Druo Stone
Oil
U
Druo
JCHU
JCHU 830N3330
830N3330
an

Google

SCRU Y RA2 830M3330
Y
830M3330
SCRU
RA2