Human Generated Data

Title

Untitled (Ben Stahl and family in living room)
Date

1955
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7867
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Ben Stahl and family in living room)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.4
Human 99.4
Chair 99.3
Furniture 99.3
Clothing 99.2
Apparel 99.2
Person 99.1
Person 99
Person 98.3
Sitting 89
Female 88.5
Woman 73.5
Room 71.1
Indoors 71.1
Living Room 64.5
People 63.9
Flooring 60.6
Photo 60.6
Photography 60.6
Dress 59.7
Girl 59.5
Fashion 59.1
Robe 59.1
Gown 59.1
Evening Dress 59.1
Table 58.9
Couch 57.7
Face 56.7

Imagga
created on 2022-01-09

person 26.3
people 25.1
adult 25
lifestyle 21.7
women 19
portrait 18.1
fashion 17.3
sexy 16.9
attractive 16.8
home 16.7
indoors 16.7
happy 16.3
man 16.2
clothing 16.1
smiling 15.9
room 15.5
dress 15.3
interior 15
male 14.9
pretty 14.7
lady 14.6
sitting 14.6
body 14.4
model 14
dishwasher 13.1
skin 12.7
happiness 12.5
blond 12.3
house 11.7
casual 11
indoor 11
relaxation 10.9
negative 10.9
cheerful 10.6
luxury 10.3
love 10.3
table 10.1
chair 10
human 9.7
couple 9.6
day 9.4
smile 9.3
20s 9.2
leisure 9.1
health 9
white goods 8.9
mother 8.8
hair 8.7
cute 8.6
men 8.6
film 8.6
business 8.5
togetherness 8.5
enjoyment 8.4
relax 8.4
elegance 8.4
one 8.2
style 8.2
work 8.1
together 7.9
face 7.8
elegant 7.7
comfortable 7.6
adults 7.6
professional 7.5
outdoors 7.5
worker 7.4
teamwork 7.4
home appliance 7.3
relaxing 7.3
sensual 7.3
businesswoman 7.3
group 7.2
team 7.2
posing 7.1
working 7.1
businessman 7.1
modern 7

Google
created on 2022-01-09

Table 93
Furniture 92.9
Black 89.7
Chair 86.1
Black-and-white 85.9
Style 84
Adaptation 79.3
Monochrome photography 76.9
Monochrome 75.9
Beauty 74.8
Art 74.1
Vintage clothing 73.7
Classic 70.7
Room 66.9
Event 66.3
Fashion design 66
Sitting 64
Visual arts 63.9
Stock photography 63.7
History 57.9

Microsoft
created on 2022-01-09

furniture 95.9
table 94.7
person 90.7
text 89.4
clothing 87.1
chair 81.1
woman 77.4
dress 73.2
vase 68.3
black and white 66.3
old 44.2

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Female, 50.8%
Calm 92.8%
Happy 3.3%
Sad 2.7%
Confused 0.5%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 48-56
Gender Female, 82.8%
Calm 87.8%
Happy 8.2%
Sad 1.5%
Fear 1.2%
Confused 0.8%
Disgusted 0.3%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 38-46
Gender Female, 86.4%
Happy 57.3%
Calm 39.6%
Sad 1%
Fear 0.9%
Disgusted 0.3%
Surprised 0.3%
Angry 0.3%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people sitting on a bench 72.5%
a group of people sitting at a table 72.4%
a man and a woman sitting on a bench 55.6%

Text analysis

Amazon

41579.
Hotel

Google

GON
-
XA
--YT37 A°2 - - XA GON
--YT37
A°2