Human Generated Data

Title

Untitled (four women in formal dining room, table set for tea, with built in china closet)

Date

1954

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18466

Human Generated Data

Title

Untitled (four women in formal dining room, table set for tea, with built in china closet)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Person 98.7
Human 98.7
Person 95.5
Person 95.2
Person 94.7
Indoors 91.5
Room 90.5
Furniture 84.9
Clothing 79.7
Apparel 79.7
Rug 77.3
Face 74.2
Chair 71.3
Living Room 67.2
People 67.2
Flooring 63.3
Female 60.5
Electronics 58.9
Monitor 58.9
LCD Screen 58.9
Screen 58.9
Display 58.9
Worker 55.5

Imagga
created on 2022-03-04

chair 54.7
table 48.2
interior 47.8
room 39.9
furniture 37.5
house 32.6
home 31.9
restaurant 31.6
floor 27
seat 23.3
window 22.5
dining 21.9
percussion instrument 21.5
design 21.4
decor 21.2
indoors 21.1
modern 20.3
wood 20
chairs 19.6
inside 19.3
indoor 19.2
musical instrument 18.9
building 18.4
contemporary 17.9
luxury 17.2
glass 16.3
kitchen 16.3
structure 15.7
dinner 15.4
style 14.8
residential 14.4
architecture 14.1
empty 13.7
marimba 13.6
classroom 13.4
counter 13.1
food 12.8
grandfather 12.7
hotel 12.4
decoration 12.3
piano 12.2
plant 11.9
relaxation 11.7
grand piano 11.5
light 11.4
eat 10.9
lunch 10.8
urban 10.5
decorate 10.5
living 10.4
scene 10.4
sitting 10.3
nobody 10.1
drink 10
office 9.8
rocking chair 9.8
comfortable 9.6
kin 9.3
hall 9.2
stringed instrument 9.2
meal 9.1
keyboard instrument 9
people 8.9
stool 8.9
stove 8.9
patio 8.9
oven 8.8
lifestyle 8.7
estate 8.5
business 8.5
relax 8.4
elegance 8.4
coffee 8.3
wooden 7.9
drawer 7.9
upscale 7.9
refrigerator 7.9
rug 7.9
tables 7.9
napkin 7.8
residence 7.8
desk 7.7
lighting 7.7
wall 7.7
cafeteria 7.7
lamp 7.6
tile 7.6
waiter 7.6
teacher 7.6
door 7.6
traditional 7.5
city 7.5
cook 7.3
cabinet 7.3
stylish 7.2
domestic 7.2
travel 7

Google
created on 2022-03-04

Black 89.8
Black-and-white 85.6
Dress 84.1
Style 83.9
Rectangle 81.3
Adaptation 79.4
Chair 78.9
Table 78.6
Couch 76.9
Picture frame 76.6
Monochrome photography 76.4
Monochrome 75.1
Beauty 75.1
Snapshot 74.3
Plant 73.5
Flooring 73.5
Art 72
Coffee table 71
Room 70.2
Comfort 70.1

Microsoft
created on 2022-03-04

black and white 95
text 89.6
indoor 89.3
clothing 83.8
person 81.8
house 77.7
furniture 76.8
table 64.6

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Female, 84.9%
Happy 97.8%
Calm 0.9%
Sad 0.5%
Surprised 0.3%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 45-51
Gender Male, 99.7%
Calm 40.8%
Happy 35.8%
Sad 15.3%
Confused 2.2%
Surprised 2%
Disgusted 1.9%
Angry 1%
Fear 0.9%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Calm 99.1%
Sad 0.3%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Calm 96.1%
Happy 1.7%
Sad 1%
Angry 0.4%
Disgusted 0.3%
Confused 0.2%
Surprised 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Rug 77.3%

Captions

Microsoft

a man and a woman sitting on a chair 46.2%
a group of people sitting in a chair 46.1%
a group of people sitting on a chair 46%