Human Generated Data

Title

Untitled (group seated in a circle in a room of the Hedgerow Theater, PA)

Date

c. 1938

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11985

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group seated in a circle in a room of the Hedgerow Theater, PA)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Furniture 99.9
Chair 99.9
Human 98.8
Person 98.8
Restaurant 98.5
Person 98.2
Chair 97.5
Chair 97.5
Person 95.9
Person 92.6
Chair 92.3
Person 91.5
Cafeteria 91
Person 90.3
Person 90.1
Person 89.4
Person 87.2
Cafe 87
Person 85.2
Indoors 80.2
Room 80.2
Sitting 79.9
Person 77.2
Flooring 72.8
Person 68.9
Couch 60.9
Classroom 59.2
School 59.2
Food 57.1
Food Court 57.1
Person 51.2

Imagga
created on 2022-01-15

restaurant 70.5
room 62.4
cafeteria 61.5
chair 56.3
interior 53.1
building 44.8
table 43.4
furniture 39.4
barbershop 37.3
classroom 33.8
structure 32.7
shop 31.1
modern 30.8
house 25.9
floor 25.1
home 24.7
indoors 24.6
wood 24.2
decor 23.9
design 23.6
mercantile establishment 22.4
chairs 21.6
window 21.2
seat 21
architecture 20.3
inside 19.3
dining 19
style 18.5
salon 18.5
empty 18
indoor 17.3
comfortable 17.2
glass 16.3
tables 15.8
place of business 15.7
light 15.4
dinner 15.2
contemporary 15.1
office 14.5
food 13.3
hall 13.1
decoration 13
sofa 12.4
hotel 12.4
lamp 12.4
desk 12.3
bar 12
living 11.4
lunch 11.2
luxury 11.1
kitchen 11
business 10.9
elegance 10.9
eat 10.9
stool 10.9
drink 10.9
residential 10.5
urban 10.5
wall 10.3
place 10.2
relax 10.1
nobody 10.1
city 10
apartment 9.6
women 9.5
relaxation 9.2
establishment 9.1
counter 9.1
lighting 8.7
lifestyle 8.7
work 8.6
space 8.5
3d 8.5
people 8.4
coffee 8.3
life 7.9
wooden 7.9
drawer 7.9
oven 7.9
conference 7.8
scene 7.8
carpet 7.8
party 7.7
men 7.7
decorate 7.6
plant 7.5
service 7.4
meal 7.3

Google
created on 2022-01-15

Window 90.5
Chair 88.9
Table 79.6
Adaptation 79.3
Suit 72.7
Monochrome photography 72.7
Monochrome 71.7
Room 69.3
Event 67.9
History 63.9
Building 61.1
Art 58.3
Sitting 56.8
Vintage clothing 56.5
Photo caption 56.4
Font 55.2
Class 53.9
Rectangle 52
Paper product 51
Cafeteria 50.8

Microsoft
created on 2022-01-15

table 98.5
chair 97.3
indoor 96.3
floor 91.1
room 90.7
text 87.1
house 82
person 73
kitchen & dining room table 62.1
clothing 58
building 52.7
furniture 22.5
several 10.8

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 94%
Calm 82.6%
Sad 10.7%
Happy 2.2%
Confused 2.2%
Surprised 0.8%
Angry 0.6%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 23-31
Gender Male, 96%
Calm 75.7%
Fear 10.4%
Confused 7.4%
Sad 2.8%
Disgusted 1.5%
Surprised 1.4%
Angry 0.5%
Happy 0.5%

AWS Rekognition

Age 22-30
Gender Male, 87.3%
Calm 44.6%
Fear 29.2%
Sad 19.2%
Disgusted 1.8%
Confused 1.7%
Angry 1.4%
Happy 1.2%
Surprised 1%

AWS Rekognition

Age 39-47
Gender Male, 95.8%
Calm 62.1%
Confused 14.6%
Disgusted 6.6%
Angry 6.6%
Sad 4.8%
Surprised 2.8%
Happy 1.3%
Fear 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.9%
Person 98.8%

Captions

Microsoft

a group of people in a room 96.2%
a group of people sitting around a living room 88.7%
a group of people sitting in a room 88.6%

Text analysis

Amazon

BY2E