Human Generated Data

Title

Untitled (couple seated on couch)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8383
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple seated on couch)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Pillow 100
Cushion 100
Apparel 99.9
Clothing 99.9
Furniture 99.2
Person 97.3
Human 97.3
Bed 95.9
Shirt 95.8
Face 92.8
Suit 91.4
Overcoat 91.4
Coat 91.4
Home Decor 79.7
Indoors 76.5
Accessories 74
Accessory 74
Tie 74
Fashion 72.9
Robe 72.9
Gown 71.7
Photo 71.6
Portrait 71.6
Photography 71.6
Man 69.2
Bedroom 67.7
Room 67.7
Female 61.1
Head 59.4
Smile 58.4
Couch 58.3
Table 58
Wedding 56.9
Bridegroom 56.9
Chair 56.5
Flower 55.1
Plant 55.1
Blossom 55.1

Imagga
created on 2022-01-09

man 43.7
person 33.1
male 31.2
people 30.1
surgeon 28.3
medical 23.8
professional 23.6
adult 22.4
newspaper 22.4
work 21.2
business 20.7
working 20.3
office 20.1
patient 20
men 19.8
businessman 18.5
hospital 18.5
indoors 17.6
lab 17.5
laboratory 17.4
negative 17.3
worker 17
computer 16.8
product 16.5
study 15.9
scientist 15.7
education 15.6
research 15.2
doctor 15
student 14.7
coat 14.6
sitting 14.6
nurse 14.5
school 14.4
medicine 14.1
health 13.9
film 13.7
team 13.4
smiling 13
looking 12.8
creation 12.8
technology 12.6
college 12.3
biology 12.3
senior 12.2
home 12
laptop 11.8
job 11.5
room 11.4
desk 11.3
color 11.1
lab coat 10.8
science 10.7
face 10.7
happy 10.7
chemistry 10.6
photographic paper 10.6
exam 10.5
profession 10.5
university 10.5
illness 10.5
portrait 10.4
learning 10.3
casual 10.2
occupation 10.1
businesswoman 10
microscope 9.7
group 9.7
test 9.6
studying 9.6
businesspeople 9.5
corporate 9.5
manager 9.3
camera 9.2
black 9
clothing 8.8
experiment 8.8
case 8.7
scientific 8.7
chemical 8.7
using 8.7
classroom 8.6
learn 8.5
teamwork 8.3
teenager 8.2
cheerful 8.1
specialist 8
information 8
lifestyle 8
smile 7.8
surgery 7.8
40s 7.8
assistant 7.8
class 7.7
serious 7.6
reading 7.6
monitor 7.6
meeting 7.5
holding 7.4
care 7.4
photographic equipment 7.3
engineer 7.2
bright 7.1
women 7.1
to 7.1
clinic 7.1
day 7.1

Google
created on 2022-01-09

Smile 93.4
Vision care 90.5
Black 89.7
Sleeve 87.1
Black-and-white 87
Eyewear 86.9
Sunglasses 86.4
Style 84.1
Monochrome photography 77.5
Font 76.7
Monochrome 76.3
T-shirt 74.3
Snapshot 74.3
Automotive design 74.1
Motor vehicle 72.7
Room 70.5
Autograph 64
Photographic paper 63.7
Stock photography 63.2
Vintage clothing 58.8

Microsoft
created on 2022-01-09

text 99.8
black and white 89.3
clothing 89.2
person 88.8
human face 83.5
man 83.3
cartoon 79.7

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 99.8%
Happy 97.8%
Surprised 0.7%
Calm 0.4%
Disgusted 0.3%
Sad 0.2%
Fear 0.2%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 33-41
Gender Female, 98.9%
Happy 80.5%
Surprised 16.5%
Calm 0.9%
Disgusted 0.8%
Confused 0.6%
Fear 0.3%
Sad 0.3%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%

Captions

Microsoft

a photo of a man 61.7%

Text analysis

Amazon

12224

Google

224·
12224.
12
12 224· 12224.