Human Generated Data

Title

Untitled (family posing on patio)
Date

1957
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8986
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (family posing on patio)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1957

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 97.3
Human 97.3
Furniture 96.6
Person 96.6
Person 93.4
Person 92.1
Indoors 89.5
Room 89
Person 87.1
Person 85
Living Room 84.6
Housing 77.9
Building 77.9
Table 77.8
Monitor 65.7
Screen 65.7
Electronics 65.7
Display 65.7
Tabletop 64
Desk 62.1
LCD Screen 59.9
Flooring 58.1
Shelf 57
Chair 56.7
Restaurant 55.9
Cafeteria 55.9

Imagga
created on 2022-01-09

interior 77.1
room 73.5
kitchen 63.6
house 54.4
furniture 53.5
home 52.7
modern 47
table 46.1
decor 40.7
chair 40.3
design 36.1
inside 35.9
floor 35.4
restaurant 33.8
indoor 32
wood 31.7
luxury 30.1
architecture 27.9
contemporary 27.3
building 26.4
apartment 25.9
stove 25.5
counter 24.6
style 24.5
cafeteria 23.1
decoration 22.5
indoors 21.1
dining 21
cabinet 21
area 21
structure 20.7
residential 20.1
window 19.8
oven 19.7
light 19.4
wall 18.8
lamp 18.1
glass 17.9
3d 17.8
office 16.8
estate 16.2
chairs 15.7
cook 15.6
empty 15.5
food 14.7
tile 14.6
expensive 14.4
sofa 14.4
nobody 14
space 14
sink 13.7
comfortable 13.4
decorate 13.3
living 13.3
refrigerator 13
stylish 12.7
domestic 12.7
wooden 12.3
island 11.9
cabinets 11.9
stool 11.9
real estate 11.7
drawer 10.9
granite 10.8
residence 10.7
lighting 10.6
new 10.5
plant 10.5
real 10.5
bar 10.2
desk 10
door 9.9
appliances 9.9
upscale 9.9
tables 9.9
hood 9.8
steel 9.7
carpet 9.7
classroom 9.6
render 9.5
lifestyle 9.4
clean 9.2
center 9
remodel 8.9
ceiling 8.9
hardwood 8.9
appliance 8.9
microwave 8.8
urban 8.7
cooking 8.7
work 8.6
mirror 8.6
construction 8.6
dinner 8.4
classic 8.4
shelf 8.2
studio apartment 7.9
spacious 7.9
rug 7.9
living room 7.8
stainless 7.8
vase 7.8
comfort 7.7
elegant 7.7
sliding door 7.7
hotel 7.6
rendering 7.6
drink 7.5
case 7.5
marble 7.4

Google
created on 2022-01-09

Black 89.8
Window 89.7
Rectangle 87.6
Black-and-white 86.6
Architecture 85.2
Table 85.1
Style 83.9
Building 81.6
Tints and shades 76.9
Monochrome 76.9
Monochrome photography 76.8
Shelving 76.7
Shelf 76.1
Chair 74.2
Glass 71.4
Space 71.3
Room 69.8
Design 68.4
Font 66
Darkness 64.2

Microsoft
created on 2022-01-09

furniture 98.2
table 97
text 96.4
chair 88
indoor 85.8
building 85.1
black and white 76.7
person 59.2
desk 5.9

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Female, 95%
Happy 84.8%
Calm 7.8%
Sad 5%
Confused 1.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 25-35
Gender Male, 84.6%
Calm 94.4%
Happy 4.7%
Sad 0.4%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Female, 61.8%
Calm 100%
Sad 0%
Happy 0%
Disgusted 0%
Angry 0%
Surprised 0%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 97.3%

Captions

Microsoft

a group of people standing in front of a window 48%
a group of people in front of a window 47.9%
a group of people in a room 47.8%

Text analysis

Amazon

MJI7-
ROK