Human Generated Data

Title

Untitled (Ben Stahl and family in living room)
Date

1955
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7868
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Ben Stahl and family in living room)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.5
Human 99.5
Clothing 99.1
Apparel 99.1
Person 98.5
Sitting 98.3
Furniture 97.9
Person 95.7
Chair 92.5
Blonde 90.2
Teen 90.2
Kid 90.2
Child 90.2
Female 90.2
Woman 90.2
Girl 90.2
Couch 85.1
Dress 82
Table 78.8
Flooring 74.2
Room 74.1
Indoors 74.1
Shoe 69.8
Footwear 69.8
Wood 67.5
Evening Dress 66.8
Fashion 66.8
Gown 66.8
Robe 66.8
People 65.7
Floor 63.1
Suit 62.1
Coat 62.1
Overcoat 62.1
Plywood 61.8
Living Room 61.1
Photography 60.7
Photo 60.7
Face 58.5
Dining Table 56.4

Imagga
created on 2022-01-09

people 36.2
classroom 31.6
man 31.6
person 31.4
room 30.8
male 29.2
adult 28.8
happy 28.8
laptop 28.5
home 27.1
computer 25.7
smiling 24.6
together 23.7
business 23.1
women 22.1
table 21.8
group 21.8
meeting 21.7
businessman 21.2
office 20.6
indoors 20.2
businesswoman 20
men 19.7
smile 19.2
portrait 18.1
lifestyle 18.1
sitting 18
casual 17.8
couple 17.4
senior 16.9
teamwork 16.7
indoor 16.4
desk 16.2
team 16.1
attractive 16.1
work 15.7
executive 15.6
mature 14.9
professional 14.7
teacher 14.5
talking 14.3
corporate 13.7
colleagues 13.6
mother 13.5
elderly 13.4
happiness 13.3
clothing 12.4
businesspeople 12.3
cheerful 12.2
face 12.1
worker 12.1
interior 11.5
grandma 11.4
success 11.3
pretty 11.2
negative 11
day 11
suit 10.8
two people 10.7
job 10.6
working 10.6
modern 10.5
boy 10.4
enjoying 10.4
hall 10.4
manager 10.2
communication 10.1
successful 10.1
house 10
blond 10
confident 10
old 9.7
older 9.7
retired 9.7
technology 9.6
sexy 9.6
30s 9.6
looking 9.6
education 9.5
student 9.5
horizontal 9.2
chair 9.1
color 8.9
casual clothing 8.8
60s 8.8
discussion 8.8
40s 8.8
conversation 8.7
film 8.7
class 8.7
retirement 8.6
pensioner 8.1
new 8.1
family 8
bright 7.9
discussing 7.9
coworkers 7.9
conference 7.8
busy 7.7
drinking 7.7
sofa 7.7
boss 7.6
two 7.6
age 7.6
ethnic 7.6
notebook 7.6
togetherness 7.6
world 7.5
friends 7.5
friendship 7.5
fun 7.5
inside 7.4
20s 7.3
relaxing 7.3
child 7.2
educator 7.2
hair 7.1
handsome 7.1
daughter 7
kin 7

Google
created on 2022-01-09

Table 94.1
Furniture 93.1
Black 89.8
Black-and-white 86.2
Style 84
Chair 81.7
Line 81.6
Art 81.2
Adaptation 79.3
Monochrome 78.8
Monochrome photography 77.5
Vintage clothing 71.2
Event 68.6
Coffee table 67.7
Room 67.6
Stock photography 64.9
Visual arts 64.9
Sitting 63.5
Indoor games and sports 58.6
Classic 58.2

Microsoft
created on 2022-01-09

furniture 97.9
text 96.2
clothing 95
table 94.5
chair 91
person 89
woman 76.1
footwear 61.3
black and white 56.9

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Female, 54.9%
Happy 98.9%
Calm 0.9%
Fear 0%
Surprised 0%
Angry 0%
Sad 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 20-28
Gender Female, 90.2%
Calm 85.1%
Sad 7.4%
Fear 3.7%
Surprised 1.5%
Happy 0.7%
Confused 0.7%
Disgusted 0.6%
Angry 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.5%
Couch 85.1%
Shoe 69.8%

Captions

Microsoft

a person sitting on a table 84.1%
a person sitting at a table 84%
a man and a woman sitting on a table 57.8%

Text analysis

Amazon

Hotel

Google

8 SIH -YT37A°2 -- XAGON
8
SIH
-YT37A°2
--
XAGON