Human Generated Data

Title

Untitled (people seated on patio, man grilling hamburgers)
Date

1959
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4660
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (people seated on patio, man grilling hamburgers)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1959

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4660

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.5
Human 99.5
Person 98.2
Person 93
Building 87.9
Restaurant 87.8
Person 83.3
Cafeteria 81.3
Person 64.8
Urban 62.6
Clinic 58.9
Cafe 56.7

Clarifai
created on 2023-10-15

people 99.2
man 97.6
adult 96.7
chair 95.4
monochrome 95.2
furniture 94.9
group 92.1
table 91.7
room 91.4
woman 90.9
desk 89.4
many 86.4
family 86.2
sit 86.1
group together 85.5
indoors 82.4
house 82.2
war 80.8
street 80.6
child 79.8

Imagga
created on 2021-12-14

interior 66.4
room 64.3
table 47.4
furniture 46.8
modern 44.2
house 40.1
home 37.3
design 32.6
chair 30.3
hall 30.1
floor 28.8
decor 26.5
architecture 25.2
apartment 24.9
indoor 24.7
3d 24
wood 22.5
inside 22.1
window 21.6
luxury 20.6
lamp 20
glass 19.5
office 19.4
indoors 19.3
sofa 19.2
wall 19.1
kitchen 19
building 18.9
desk 18.9
empty 18
center 17.9
classroom 17.6
light 17.4
living 17.1
chairs 15.7
nobody 15.6
comfortable 15.3
business 15.2
contemporary 15.1
gymnasium 14.5
render 13.8
decoration 13.8
restaurant 13.7
dining 13.3
counter 13.3
facility 12.8
style 12.6
structure 12.4
new 12.1
reflection 12.1
plant 11.9
space 11.6
vase 11.6
athletic facility 11.6
residential 11.5
cabinet 10.8
living room 10.8
steel 10.6
rendering 10.5
urban 10.5
work 10.3
city 10
seat 10
area 9.7
wooden 9.7
day 9.4
lifestyle 9.4
elegance 9.2
domestic 9
tile 9
tables 8.9
stove 8.9
metal 8.9
oven 8.8
carpet 8.8
couch 8.7
lighting 8.7
expensive 8.6
dinner 8.4
bar 8.3
furnishing 8.3
food 8.3
sink 8.2
pillow 7.8
construction 7.7
hotel 7.6
decorate 7.6
estate 7.6
perspective 7.5
cook 7.3
cafeteria 7.3
success 7.2
stylish 7.2
refrigerator 7.1

Google
created on 2021-12-14

Black 89.7
Black-and-white 86.3
Style 83.9
Urban design 79.7
Adaptation 79.3
Monochrome 76.8
Font 76.5
Chair 76.4
Monochrome photography 75.9
Table 74.7
Shade 73.2
Plant 72
Window 71.7
Room 69
Building 64.1
Art 63.5
Stock photography 63.3
House 62.7
Rectangle 61.9
History 59.1

Microsoft
created on 2021-12-14

text 96.7
house 91.9
table 82.1
black and white 59.9
building 52.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 52-70
Gender Male, 84.1%
Calm 75.4%
Sad 19%
Happy 4.9%
Confused 0.3%
Angry 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 20-32
Gender Male, 55.5%
Calm 69.2%
Happy 23.4%
Surprised 2.7%
Confused 1.4%
Sad 1.2%
Angry 1%
Disgusted 0.6%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Categories

Imagga

paintings art 75.7%
interior objects 21.6%
text visuals 1.6%

Captions

Microsoft
created on 2021-12-14

diagram 41.5%

Text analysis

Amazon

36.
573 36.
573

Google

77336.
77336.