Human Generated Data

Title

Untitled (three women sitting in a booth at a diner)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4887
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (three women sitting in a booth at a diner)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.6
Human 99.6
Person 99.2
Chair 94.2
Furniture 94.2
Person 91.1
Face 86.5
Horse 83.8
Animal 83.8
Mammal 83.8
Chair 82.5
Table 80.7
Female 70.4
Dining Table 70
Apparel 66.9
Clothing 66.9
Beverage 65.3
Drink 65.3
Girl 61.5
Photo 61.3
Photography 61.3
Portrait 61.3
Suit 61.2
Overcoat 61.2
Coat 61.2
Indoors 58.8
Meal 57.5
Food 57.5
Smile 56.1
Dating 55.6

Imagga
created on 2022-01-23

person 33.9
people 31.2
man 25.5
male 24.1
businessman 23.8
room 23.2
adult 22.1
business 21.9
work 18.8
professional 18.7
group 18.5
classroom 17.3
men 17.2
office 15.5
computer 15.3
teacher 14.7
worker 14.7
education 13.8
student 13.8
wind instrument 13.7
businesswoman 13.6
modern 13.3
musical instrument 13.3
happy 13.2
brass 12.4
job 12.4
chair 12.1
smile 12.1
board 11.8
communication 11.7
team 11.6
blackboard 11.6
indoors 11.4
meeting 11.3
study 11.2
laptop 11.2
corporate 11.2
women 11.1
portrait 11
indoor 10.9
smiling 10.8
class 10.6
human 10.5
hall 10.5
home 10.4
equipment 10.3
manager 10.2
black 10.2
teamwork 10.2
successful 10.1
handsome 9.8
technology 9.6
planner 9.6
table 9.5
lifestyle 9.4
executive 9.3
holding 9.1
musician 8.9
interior 8.8
working 8.8
life 8.5
school 8.5
businesspeople 8.5
desk 8.5
employee 8.4
mature 8.4
hand 8.3
back 8.3
confident 8.2
success 8
couple 7.8
students 7.8
teaching 7.8
clothing 7.7
studying 7.7
device 7.6
casual 7.6
college 7.6
cornet 7.5
occupation 7.3
new 7.3
sax 7.1
day 7.1

Google
created on 2022-01-23

Black 89.7
Chair 87.8
Black-and-white 84.9
Style 84.1
Adaptation 79.2
Art 76
Suit 75.3
Font 75.3
Monochrome photography 74.7
Snapshot 74.3
Monochrome 74.2
Event 70.5
Vintage clothing 68.9
Table 64.8
Room 64.4
Stock photography 64
History 60.3
Visual arts 57.2
Sitting 53.4
Classic 53.2

Microsoft
created on 2022-01-23

text 99.9
black and white 85.8
drawing 77.1
ship 60.6
sketch 58.4
table 56
old 42

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Female, 91.7%
Happy 61.8%
Calm 26.1%
Sad 7.1%
Surprised 2%
Disgusted 1.1%
Angry 0.8%
Confused 0.6%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Chair 94.2%
Horse 83.8%

Captions

Microsoft

an old photo of a man 61.1%
old photo of a man 60%
a group of people sitting at a table 38.8%

Text analysis

Amazon

ICE CREAM
H16005.
НАСОЖА

Google

H16005.
HI6005.
H16005. HI6005. HI6005.