Human Generated Data

Title

Untitled (two seated men eating and talking)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4708

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two seated men eating and talking)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.2
Apparel 99.2
Human 96.9
Person 96.9
Overcoat 96.5
Coat 96.5
Accessories 94.6
Tie 94.6
Accessory 94.6
Person 88.1
Tuxedo 82.3
Shirt 78.4
Face 67.5
People 63.6
Female 60.2
Meal 59.5
Food 59.5
Gown 58.1
Fashion 58.1
Suit 57.5

Imagga
created on 2022-01-29

bow tie 45.9
person 42.7
necktie 38.6
professional 36.8
man 36.3
people 34.6
male 32
worker 31.3
businessman 29.1
adult 29.1
office 27.4
lab 27.2
work 26.7
medical 26.5
business 25.5
laboratory 25.1
garment 22.1
corporate 21.5
clothing 20.9
computer 20.9
portrait 20.7
businesspeople 19.9
coat 19.5
job 19.5
working 19.5
men 18.9
doctor 18.8
team 17.9
scientist 17.6
looking 17.6
employee 17.6
research 17.1
happy 16.9
medicine 16.7
biology 16.1
face 15.6
executive 15.4
waiter 15.4
handsome 15.2
occupation 14.7
chemical 14.5
casual 14.4
science 14.2
desk 14.2
manager 14
alone 13.7
businesswoman 13.6
scientific 13.6
chemistry 13.5
human 13.5
test 13.5
hospital 13.4
smiling 13
smile 12.8
successful 12.8
suit 12.8
laptop 12.8
student 12.7
profession 12.4
dining-room attendant 12.3
group 12.1
teamwork 12.1
one 11.9
modern 11.9
women 11.9
health 11.8
shirt 11.6
serious 11.4
development 11.4
success 11.3
study 11.2
confident 10.9
experiment 10.7
bright 10.7
colleagues 10.7
indoors 10.5
attractive 10.5
lab coat 10.5
tie 10.4
technology 10.4
sitting 10.3
happiness 10.2
20s 10.1
hand 9.9
exam 9.6
color 9.5
meeting 9.4
lifestyle 9.4
patient 9.4
microscope 9
researcher 8.9
nurse 8.8
film 8.8
physician 8.8
sample 8.8
thoughtful 8.8
assistant 8.7
concentration 8.7
uniform 8.7
education 8.7
table 8.7
clinic 8.6
thinking 8.5
career 8.5
leisure 8.3
holding 8.3
care 8.2
indoor 8.2
genes 7.9
associates 7.9
day 7.8
couple 7.8
conference 7.8
discovery 7.8
optical 7.8
pretty 7.7
30s 7.7
expression 7.7
instrument 7.7
workplace 7.6
negative 7.5
mature 7.4
focus 7.4
cheerful 7.3
home 7.2
together 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 94.1
person 88.6
sketch 87
drawing 85.5
man 83.6
clothing 78
wedding 77
wedding dress 74.8
suit 70.1
bride 61
old 59.9
painting 51.2

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Female, 86%
Calm 99.5%
Happy 0.2%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%
Surprised 0.1%
Angry 0%
Confused 0%

AWS Rekognition

Age 50-58
Gender Male, 71.9%
Calm 99.8%
Surprised 0.1%
Angry 0%
Disgusted 0%
Happy 0%
Sad 0%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.9%
Tie 94.6%
Suit 57.5%

Captions

Microsoft

an old photo of a person 88.1%
old photo of a person 86.3%
an old photo of a man and a woman standing next to a window 59.4%

Text analysis

Amazon

ELENDED
2
id
ELENDED CVELLX even
even
CVELLX