Human Generated Data

Title

Untitled (woman pouring juice while family waits at table)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4687
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman pouring juice while family waits at table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Human 99.2
Person 99.2
Person 98.9
Person 98.4
Pottery 92.4
Saucer 90.3
Coffee Cup 84.4
Cup 84.4
Beverage 82.1
Drink 82.1
Beer 82.1
Alcohol 82.1
Person 69.5
Clothing 66.9
Apparel 66.9
Restaurant 59.9
Furniture 59.3
Table 59.3
Waiter 57.4
Cafe 55.7
Clinic 55.3

Imagga
created on 2022-02-05

salon 36.1
barbershop 31.9
man 27.5
shop 27.2
laboratory 27
work 25.9
people 25.1
person 23.5
medical 22.9
research 22.8
male 22
biology 20.9
science 19.6
working 19.4
mercantile establishment 19.3
scientist 18.6
test 18.3
medicine 17.6
chemistry 17.4
adult 17.3
office 16.8
home 16.7
worker 16.6
professional 16.2
smiling 15.9
happy 15.7
experiment 14.6
lab 14.6
scientific 14.5
chemical 14.5
looking 14.4
business 14
student 13.6
technology 13.4
job 13.3
doctor 13.2
place of business 12.9
glass 12.8
holding 12.4
businessman 12.4
indoors 12.3
portrait 12.3
microscope 12
occupation 11.9
equipment 11.9
hospital 11.9
health 11.8
chemist 11.8
lifestyle 11.6
education 11.3
modern 11.2
men 11.2
kitchen 11
standing 10.4
room 10.1
coat 10.1
biotechnology 9.8
cheerful 9.7
analysis 9.7
computer 9.6
table 9.5
corporate 9.4
beaker 9.3
house 9.2
human 9
device 9
interior 8.8
container 8.8
tube 8.7
exam 8.6
sitting 8.6
smile 8.5
communication 8.4
study 8.4
instrument 8.3
coffee 8.3
care 8.2
employee 8.1
team 8.1
handsome 8
clinic 7.8
brunette 7.8
happiness 7.8
hairdresser 7.8
analyzing 7.8
discovery 7.8
restaurant 7.8
pharmacy 7.8
concentration 7.7
industry 7.7
serious 7.6
two 7.6
fashion 7.5
cup 7.5
drink 7.5
one 7.5
glasses 7.4
phone 7.4
tool 7.3
face 7.1
look 7

Google
created on 2022-02-05

Glasses 97.4
Hat 90.7
Black-and-white 84.9
Style 84
Smile 83.7
Monochrome 75.6
Snapshot 74.3
Monochrome photography 73.9
Art 68.5
Science 67.4
Eyewear 65.8
Chair 64.8
Barware 64.4
Audio equipment 63.5
Sitting 63.5
Suit 62.7
Room 62.6
Stock photography 62.6
Glass 62.2
Sun hat 61.3

Microsoft
created on 2022-02-05

text 95.6
indoor 93.7
man 92
clothing 90.9
person 89.4
window 83.3
black and white 65.7
tableware 51.8

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Female, 98.4%
Happy 93.6%
Surprised 3.2%
Confused 1.2%
Sad 0.7%
Calm 0.5%
Disgusted 0.3%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Male, 95.4%
Calm 93%
Happy 3.3%
Disgusted 1%
Confused 0.8%
Sad 0.7%
Surprised 0.7%
Angry 0.4%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Beer 82.1%

Captions

Microsoft

a man standing in front of a window 66.2%
a man standing in front of a box 66.1%
a man and a woman standing in front of a window 42.1%

Text analysis

Amazon

8
46370.
MJR
8 MJR YESTAD ACCHA
YESTAD
ACCHA

Google

46370.
46370.