Human Generated Data

Title

Untitled (woman at reception desk for insurance company)

Date

c. 1937, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5799

Human Generated Data

Title

Untitled (woman at reception desk for insurance company)

People

Artist: Durette Studio, American 20th century

Date

c. 1937, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 96.5
Human 96.5
Furniture 96.2
Indoors 93
Room 93
Living Room 93
Interior Design 86.8
Plant 75.8
Shelf 75.4
Flower 71.3
Blossom 71.3
Cabinet 69.5
Flower Arrangement 65
Lamp 63.5
Flower Bouquet 61.6
Flooring 59.7
Couch 58.5
Screen 58.2
Monitor 58.2
Display 58.2
LCD Screen 58.2
Electronics 58.2
Sideboard 57.5
Pub 57.3
Restaurant 55.8
Cafe 55.8
Apparel 55.4
Clothing 55.4

Clarifai
created on 2019-11-16

people 100
furniture 99.4
room 98.9
group 98.6
adult 98.1
woman 97.8
group together 97.7
man 97.1
indoors 97
seat 95.3
chair 94.9
bar 93.3
sit 92.8
two 92.7
music 92.5
dining room 92.4
restaurant 91.9
one 91.5
four 91
monochrome 90.4

Imagga
created on 2019-11-16

case 100
interior 46
furniture 43.2
house 30.9
home 29.5
table 27.9
window 27.7
room 27.3
modern 25.9
wood 25.8
design 23.6
indoors 22.8
chair 21.8
style 20.8
cabinet 20.3
architecture 19.5
inside 18.4
furnishing 17.3
wardrobe 16.9
wall 16.5
glass 16.3
luxury 16.3
kitchen 16.1
decoration 15.9
decor 15.9
door 15.5
light 15.4
old 13.9
floor 13
chairs 12.7
domestic 12.6
elegance 12.6
lamp 12.4
shop 12.3
building 12.1
elegant 12
china cabinet 11.8
residential 11.5
comfortable 11.5
dining 11.4
brown 11
indoor 10.9
restaurant 10.6
office 10.4
dinner 10.1
space 10.1
shelf 9.9
business 9.7
new 9.7
wooden 9.7
stylish 9
black 9
urban 8.7
apartment 8.6
living 8.5
traditional 8.3
fashion 8.3
stove 8.1
oven 7.8
vase 7.7
expensive 7.7
hotel 7.6
center 7.6
contemporary 7.5
city 7.5
vintage 7.4
service 7.4
retro 7.4
food 7.2
lifestyle 7.2
antique 7.1
working 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

indoor 97.7
wall 95.2
vase 93.8
black and white 92.7
flower 87.3
text 86.9
house 81.1
ceiling 79.7
person 65.8
white 60.8
furniture 59
table 57.6
clothing 55.6

Face analysis

Amazon

Google

AWS Rekognition

Age 23-35
Gender Female, 52.9%
Surprised 45%
Sad 45%
Calm 54.9%
Happy 45%
Confused 45%
Disgusted 45%
Fear 45%
Angry 45%

AWS Rekognition

Age 29-45
Gender Male, 50.4%
Disgusted 49.5%
Happy 49.5%
Angry 49.6%
Calm 50.3%
Surprised 49.5%
Confused 49.5%
Sad 49.6%
Fear 49.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.5%

Captions

Microsoft

a vase of flowers on a table 53.4%
a group of people in a room 53.3%
a white vase on a table 35.3%

Text analysis

Google

tu ed
ed
tu