Human Generated Data

Title

Untitled (seated man smoking, table with drinks and food)

Date

1936

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4765

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (seated man smoking, table with drinks and food)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4765

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Furniture 99.8
Chair 98.4
Human 97.2
Person 96.6
Clothing 82
Apparel 82
Sitting 78.5
Flooring 78.4
Plant 73.9
Flower 72.9
Blossom 72.9
Clinic 71.5
Flower Arrangement 62.7
Photography 62.6
Photo 62.6
Table 59.9
Indoors 57.2
Flower Bouquet 56.9
Vase 56.6
Pottery 56.6
Jar 56.6
Face 55.3

Clarifai
created on 2023-10-27

people 99.8
adult 98.5
chair 98.5
furniture 98
man 97.2
two 96.1
one 95.3
sit 94.4
leader 92.5
room 91.1
administration 90
seat 89.8
medical practitioner 89.3
wear 87.2
table 86.2
group 85.6
three 84.3
indoors 83.1
medicine 81.3
portrait 79.7

Imagga
created on 2022-01-29

man 45.7
person 38.7
male 37.6
professional 33.3
people 30.1
adult 29.5
computer 26.6
office 26.4
business 24.9
patient 24.1
sitting 23.2
room 23.1
medical 23
businessman 23
coat 21.6
work 21.5
clinic 21.1
men 20.6
doctor 19.8
indoors 19.3
occupation 19.3
desk 19.1
hospital 18.7
laptop 18.5
colleagues 18.5
smiling 18.1
worker 17.9
job 17.7
lab coat 17.5
businesspeople 17.1
working 16.8
chair 16.7
table 16.6
indoor 16.4
home 16
senior 15.9
casual 15.3
barber chair 15
businesswoman 14.6
happy 14.4
face 14.2
color 13.9
health 13.9
corporate 13.8
20s 13.8
team 13.5
couple 13.1
seller 12.9
laboratory 12.5
30s 12.5
talking 12.4
meeting 12.3
mature 12.1
scientist 11.8
lab 11.7
portrait 11.7
elderly 11.5
medicine 11.5
student 11.3
group 11.3
confident 10.9
horizontal 10.9
associates 10.8
shop 10.7
chemistry 10.6
busy 10.6
serious 10.5
research 10.5
technology 10.4
study 10.3
seat 10.3
day 10.2
teamwork 10.2
notebook 10.2
bright 10
suit 9.9
coworkers 9.8
cheerful 9.8
businessmen 9.8
together 9.6
using 9.6
education 9.5
biology 9.5
salon 9.5
teacher 9.3
smile 9.3
communication 9.2
treatment 9.2
attractive 9.1
holding 9.1
care 9.1
handsome 8.9
science 8.9
clothing 8.8
barbershop 8.8
25 30 years 8.8
looking 8.8
case 8.7
lifestyle 8.7
sick person 8.7
exam 8.6
executive 8.5
sit 8.5
keyboard 8.5
screen 8.4
modern 8.4
old 8.4
pharmacist 8.4
furniture 8.2
women 7.9
30 35 years 7.9
monitor 7.8
mercantile establishment 7.8
40s 7.8
chemical 7.8
assistant 7.8
retired 7.8
mid adult 7.7
profession 7.7
illness 7.6
uniform 7.6
adults 7.6
hairdresser 7.5
shirt 7.5
successful 7.3
classroom 7.2
interior 7.1
happiness 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 99.4
furniture 99
person 96.1
chair 95.6
table 95.2
man 91.4
clothing 78.3
black and white 73.1
vase 68.1
coffee table 56

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 95.9%
Calm 84.1%
Sad 15.3%
Confused 0.3%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Happy 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair
Person
Chair 98.4%
Person 96.6%

Captions

Microsoft
created on 2022-01-29

a man sitting on a table 80.1%
a man sitting at a table 80%
a man sitting in a chair 79.9%

Text analysis

Amazon

SE
to
-
ETHOTE to
y
- nacional - - AMIA
3848
3848 YT33AP
. SE
YT33AP
ETHOTE
russ
us
AMIA
nacional
UNWAY
THE KOTTENCA

Google

ETOTTEN
ETOTTEN