Human Generated Data

Title

Untitled (children seated at table for birthday celebration)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8349
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (children seated at table for birthday celebration)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Furniture 99.7
Chair 99.7
Indoors 98.7
Room 98.7
Restaurant 98.2
Dining Room 97.8
Chair 97.5
Person 97.3
Human 97.3
Person 96.3
Dining Table 96
Table 96
Chair 92.8
Person 90.4
Cafeteria 87.7
Interior Design 85.4
Person 74.7
Living Room 70.1
Meal 69.5
Food 69.5
Tabletop 65.9
Sitting 64.1
Cafe 63.8
Person 63.2
Couch 60.5
People 59.2
Food Court 58.3
Plant 56.9
Classroom 56.7
School 56.7

Imagga
created on 2022-01-09

room 65.8
classroom 60.5
chair 35
interior 29.2
building 24.6
house 24.3
home 23.9
window 21.9
architecture 20.8
furniture 19
indoors 18.4
seat 17.5
table 16.1
floor 15.8
structure 15.6
old 15.3
wall 14.7
school 13.7
design 13.5
residential 13.4
wood 13.3
modern 13.3
sitting 12.9
indoor 12.8
decor 12.4
light 12
inside 12
people 11.7
decoration 11.6
apartment 11.5
urban 10.5
luxury 10.3
relaxation 10
style 9.6
women 9.5
living 9.5
man 9.4
classic 9.3
stone 9.3
elegance 9.2
travel 9.1
city 9.1
sofa 8.7
lifestyle 8.7
person 8.6
lamp 8.6
nobody 8.5
two 8.5
center 8.4
domestic 8.1
door 7.8
desk 7.8
men 7.7
windows 7.7
comfortable 7.6
estate 7.6
fashion 7.5
office 7.5
balcony 7.5
vintage 7.4
work 7.4
business 7.3
shop 7.3
to 7.1
wooden 7

Google
created on 2022-01-09

Table 93.1
Chair 89.7
Interior design 84.5
Black-and-white 83.5
Sharing 81.3
Adaptation 79.4
Monochrome photography 75.4
Monochrome 74.7
Building 73
Room 73
Window 71.4
Event 69.9
Dining room 67.4
Sitting 65.9
History 64.5
Coffee table 62.3
Curtain 61.6
Plant 58.7
Art 58.5
Child 56.7

Microsoft
created on 2022-01-09

text 98
furniture 95.9
table 95.8
black and white 92.4
chair 90.1
person 71.2
house 70.1
clothing 66.6

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 96.4%
Happy 83.1%
Calm 8.4%
Surprised 3.6%
Fear 2.1%
Angry 1.4%
Disgusted 0.6%
Confused 0.6%
Sad 0.4%

AWS Rekognition

Age 37-45
Gender Male, 98.7%
Calm 94.8%
Sad 3%
Surprised 1.6%
Angry 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 47-53
Gender Male, 99.7%
Happy 59.3%
Calm 33.5%
Sad 2.1%
Disgusted 1.5%
Fear 1.2%
Surprised 0.9%
Confused 0.9%
Angry 0.7%

AWS Rekognition

Age 22-30
Gender Female, 63.6%
Calm 98.9%
Surprised 0.4%
Happy 0.3%
Sad 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.7%
Person 97.3%

Captions

Microsoft

a group of people sitting in a chair 69.7%
a group of people sitting on a chair 66%
a group of people sitting in chairs 65.9%

Text analysis

Amazon

12089.

Google

12089.
12089.