Human Generated Data

Title

Untitled (two couples seated in living room near fireplace)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11937
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two couples seated in living room near fireplace)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11937

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Furniture 99.9
Chair 99.6
Person 98.7
Human 98.7
Indoors 97.8
Room 97.8
Chair 97.6
Person 97.2
Person 95.6
Apparel 95.4
Clothing 95.4
Table 93
Living Room 92.5
Dining Table 92.5
Dining Room 91.8
Sitting 90.7
Tie 86.9
Accessories 86.9
Accessory 86.9
Couch 84.4
Female 82.1
Dress 79
People 76.2
Face 76
Person 74.1
Flower 71.3
Blossom 71.3
Plant 71.3
Flooring 69.4
Meal 68.6
Food 68.6
Woman 68.3
Linen 64.8
Home Decor 64.8
Monitor 64.6
Electronics 64.6
Display 64.6
Screen 64.6
Suit 62.6
Coat 62.6
Overcoat 62.6
Person 61.4
Photography 58.1
Photo 58.1
Cabinet 58
Flower Arrangement 57.4
Flower Bouquet 57.4
Girl 56.7
Restaurant 56.7
Floor 56.5
Housing 55.6
Building 55.6
Person 49.3

Clarifai
created on 2023-10-25

people 99.8
furniture 98.3
chair 97.7
adult 97.3
group 96.3
seat 96
woman 94.8
man 94.7
room 94.4
group together 92.6
administration 91.1
dining room 90.8
two 90.4
sit 89.2
home 89.2
leader 89.1
indoors 88.7
several 87.1
wear 83.1
actress 81.8

Imagga
created on 2022-01-15

man 37.6
people 30.7
person 27.1
male 27
adult 23.7
happy 21.3
sitting 19.7
smiling 18.1
lifestyle 18.1
kin 17.7
home 17.5
shop 17.4
women 17.4
chair 16.6
room 15.9
indoors 15.8
couple 15.7
musical instrument 15.4
casual 15.2
men 14.6
portrait 14.2
family 14.2
business 14
mother 13.9
cheerful 13.8
mature 13
father 12.8
patient 12.7
percussion instrument 12.3
senior 12.2
smile 12.1
happiness 11.7
interior 11.5
medical 11.5
together 11.4
barbershop 11.4
old 11.1
nurse 11.1
indoor 11
seller 10.3
work 10
holiday 10
hairdresser 9.7
40s 9.7
health 9.7
office 9.6
table 9.6
life 9.5
child 9.4
shopping 9.2
care 9
professional 8.9
kitchen 8.9
job 8.8
working 8.8
teacher 8.8
boy 8.7
mid adult 8.7
30s 8.7
day 8.6
elderly 8.6
store 8.5
classroom 8.3
leisure 8.3
occupation 8.2
fun 8.2
aged 8.1
team 8.1
mercantile establishment 8
looking 8
businessman 7.9
grandfather 7.9
cart 7.8
colleagues 7.8
gift 7.7
hospital 7.7
pretty 7.7
four 7.7
worker 7.6
two 7.6
hand 7.6
togetherness 7.6
fashion 7.5
house 7.5
stringed instrument 7.5
holding 7.4
drum 7.4
lady 7.3
parent 7.3
new 7.3
relaxing 7.3
face 7.1
love 7.1

Google
created on 2022-01-15

Picture frame 88.7
Chair 85.5
Plant 83
Flowerpot 73.4
Monochrome 72.6
Vintage clothing 72.4
Monochrome photography 72.1
Hat 71.6
Classic 71.4
Art 70.2
Room 69.8
Houseplant 64.8
Suit 64.6
Stock photography 62.5
Sitting 59.3
History 59.2
Illustration 58.6
Retro style 53.9
Guitar 51.8

Microsoft
created on 2022-01-15

text 99.5
furniture 91.7
table 88.5
indoor 87.8
chair 81.1
clothing 76.6
person 74.6
white 69.2
black and white 67.4
black 65.4
vase 60.2
flower 50

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 92.1%
Happy 96.2%
Calm 2.7%
Sad 0.5%
Surprised 0.2%
Confused 0.2%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 40-48
Gender Female, 81%
Calm 95%
Sad 2.7%
Happy 1%
Confused 0.5%
Fear 0.3%
Disgusted 0.3%
Angry 0.2%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.6%
Person 98.7%
Dining Table 92.5%
Tie 86.9%

Categories

Imagga

paintings art 51.8%
people portraits 46%

Captions

Microsoft
created on 2022-01-15

a person standing in front of a store 54.5%
an old photo of a person 54.4%
a person standing in a room 54.3%

Text analysis

Amazon

5391
over
ace

Google

30a0 Y 1e 83
30a0
Y
1e
83