Human Generated Data

Title

Untitled (children seated at table for birthday celebration)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8348
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (children seated at table for birthday celebration)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Furniture 99.9
Chair 99.4
Room 98.9
Indoors 98.9
Person 98.9
Human 98.9
Chair 98.8
Person 98.3
Person 96.8
Classroom 93.8
School 93.8
Person 90.4
Living Room 84.2
Dining Room 83.9
Dining Table 79.2
Table 79.2
Interior Design 78.8
Plant 73.3
Person 72.4
Chair 70.8
Person 65.6
Couch 64.8
People 61.9
Kid 60.2
Child 60.2
Screen 55.3
Electronics 55.3
Door 55.2

Imagga
created on 2022-01-09

room 65.3
chair 60.7
classroom 50.4
restaurant 44
table 41.3
interior 38.9
furniture 29
seat 27.6
cafeteria 27.1
building 25.5
home 23.9
house 23.4
floor 21.4
dining 20.9
structure 20
chairs 19.6
wood 19.2
indoors 16.7
indoor 15.5
modern 15.4
inside 14.7
design 14.6
dinner 14.6
decoration 14.5
decor 14.1
window 13.9
sitting 13.7
wicker 13.5
residential 13.4
style 12.6
architecture 12.5
glass 12.4
food 12.1
relax 11.8
relaxation 11.7
summer 11.6
comfortable 11.4
work 11.2
empty 11.2
luxury 11.1
bar 11.1
kitchen 10.9
nobody 10.9
drink 10.9
lifestyle 10.8
folding chair 10.6
wooden 10.5
wall 10.4
lunch 10.4
shop 10.3
counter 10.2
elegance 10.1
product 9.9
blackboard 9.8
apartment 9.6
light 9.4
meal 9.1
people 8.9
hospital 8.9
tables 8.9
flowers 8.7
office 8.6
sunny 8.6
hotel 8.6
eat 8.4
place 8.4
old 8.4
coffee 8.3
service 8.3
wine 8.3
stylish 8.1
domestic 8.1
stool 7.9
rest 7.7
setting 7.7
outside 7.7
outdoor 7.6
contemporary 7.5
city 7.5
plant 7.5
man 7.4
sun 7.2

Google
created on 2022-01-09

Furniture 93.8
Table 93.3
Black 89.6
Chair 89.3
Black-and-white 85.1
Style 83.8
Line 81.7
Adaptation 79.2
Monochrome 77.6
Monochrome photography 76.1
Snapshot 74.3
Room 71.8
Sitting 66.4
Dining room 66.2
Stock photography 62.4
Desk 59.1
History 58.7
Coffee table 57.2
Classic 54.1
Font 54.1

Microsoft
created on 2022-01-09

furniture 98.3
text 97.7
chair 95.3
table 94.2
black and white 90.8
house 83.9

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Surprised 85.8%
Fear 3.6%
Angry 2.9%
Sad 2.4%
Happy 2.3%
Calm 1.7%
Disgusted 0.9%
Confused 0.5%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Surprised 94.6%
Calm 4.7%
Angry 0.3%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%
Sad 0%
Fear 0%

AWS Rekognition

Age 48-56
Gender Male, 59.9%
Calm 92.5%
Sad 6.6%
Confused 0.4%
Angry 0.3%
Happy 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.4%
Person 98.9%

Captions

Microsoft

a group of people sitting in a chair 76.7%
a group of people sitting on a chair 73.7%
a group of people sitting at a table 64.3%

Text analysis

Amazon

12088.

Google

12 0 88. 12088.
12
0
88.
12088.