Human Generated Data

Title

Untitled (children sitting around table at birthday party)
Date

1959
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10512
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (children sitting around table at birthday party)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1959

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.6
Human 99.6
Person 98.8
Furniture 98.2
Person 97.7
Person 96.2
Interior Design 94.4
Indoors 94.4
Room 93.9
Person 93.3
Person 90.9
Person 90
Person 88.9
Table 87.2
Dining Table 84.3
Person 81.3
Living Room 79.4
Person 78.2
Meal 71.9
Food 71.9
Person 65.9
Building 64.4
Housing 64.4
Dish 63.1
Kid 62.5
Child 62.5
Couch 60.7
Classroom 59.8
School 59.8
Chair 59.6
People 59.2
Dining Room 58.4
Play 57.2
Restaurant 56.5
Kindergarten 56.2

Imagga
created on 2022-01-09

table 60.7
interior 53.9
room 52.7
furniture 43.6
desk 35.4
chair 32.7
indoors 31.6
home 28.7
modern 26.6
house 25.1
kitchen 24.8
restaurant 23.1
decor 23
glass 21.4
dining 20.9
design 19.7
office 19.6
classroom 17.3
luxury 17.1
floor 16.7
wood 16.7
chairs 15.7
empty 15.5
comfortable 15.3
seat 15.2
window 15.1
architecture 14.8
domestic 14.5
counter 13.9
decoration 13.7
dinner 13.7
food 13.4
stove 13
people 12.8
indoor 12.8
style 12.6
drink 12.5
computer 12.4
business 12.1
work 11.8
meal 11.7
light 11.4
service 11.1
plate 11
elegance 10.9
lifestyle 10.8
furnishing 10.8
oven 10.8
setting 10.6
apartment 10.5
residential 10.5
person 10.3
elegant 10.3
nobody 10.1
hospital 10.1
cabinet 10.1
shop 9.9
sink 9.8
appliance 9.8
case 9.7
hotel 9.5
man 9.5
party 9.5
lunch 9.4
contemporary 9.4
hall 9.3
inside 9.2
tables 8.9
silverware 8.8
cooking 8.7
adult 8.7
screen 8.6
formal 8.6
sitting 8.6
eat 8.4
place 8.4
bar 8.3
wall 7.9
reception 7.8
cutlery 7.8
3d 7.7
vase 7.7
knife 7.7
fork 7.7
lamp 7.6
fine 7.6
communication 7.6
equipment 7.5
barbershop 7.3
breakfast 7.3
center 7.3
metal 7.2
smiling 7.2
black 7.2
structure 7.2
steel 7.1
happiness 7
wooden 7

Google
created on 2022-01-09

Black 89.7
Black-and-white 87.1
Chair 86.5
Interior design 84.6
Style 84
Table 80.1
Monochrome 76.5
Monochrome photography 76.2
Snapshot 74.3
Event 72.1
Room 66
Glass 65.3
Sitting 64.4
Stock photography 63.7
Curtain 63.3
Still life photography 63.2
Visual arts 53.9
Tableware 53.3
Photography 51.6

Microsoft
created on 2022-01-09

text 98.2
window 97.9
table 93.4
indoor 85.2
person 70.9
clothing 59.6
furniture 56.2
bottle 54.9
cluttered 17.2

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Female, 82.6%
Happy 98.8%
Calm 0.8%
Surprised 0.1%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%
Fear 0%
Confused 0%

AWS Rekognition

Age 23-31
Gender Female, 86.4%
Happy 99.7%
Calm 0.1%
Sad 0%
Angry 0%
Disgusted 0%
Surprised 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Happy 83.1%
Calm 12.1%
Surprised 1.7%
Fear 1.2%
Angry 0.6%
Disgusted 0.5%
Sad 0.5%
Confused 0.3%

AWS Rekognition

Age 22-30
Gender Female, 64%
Calm 60.2%
Happy 32.2%
Sad 4.2%
Surprised 1.2%
Disgusted 0.8%
Angry 0.6%
Fear 0.6%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Chair 59.6%

Captions

Microsoft

a group of people sitting in front of a window 75.9%
a group of people sitting in chairs in front of a window 75.8%
a group of people sitting in a window 72.7%

Text analysis

Amazon

44974

Google

4
4974
4 4974