Human Generated Data

Title

Untitled (men and women seated at banquet with head table in background)

Date

1940

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4199

Human Generated Data

Title

Untitled (men and women seated at banquet with head table in background)

People

Artist: Durette Studio, American 20th century

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Furniture 99.5
Chair 99.5
Human 96.8
Person 96.8
Person 94
Person 93.9
Chair 92.5
Tablecloth 92.3
Person 90.5
Person 89.3
Person 85.1
Indoors 84.2
Table 83.6
Chair 82.1
Restaurant 80.6
Flooring 80.5
Person 79.3
Person 78
Person 77.7
Cafeteria 77.2
Dining Table 75.5
Room 73.9
Person 71.2
Hall 65.8
People 62.3
Floor 59.3
Tabletop 58.3
Home Decor 57.9
Dining Room 57.3
Crowd 56.5

Clarifai
created on 2019-06-01

furniture 99.8
chair 99.3
room 99.3
table 98.7
indoors 97.2
inside 96.8
seat 94.4
dining room 93.5
people 93.1
window 88.8
home 88.8
family 87.8
luxury 86
lamp 83.6
desk 82.6
wood 82.2
many 81.7
apartment 78.7
group 78.4
house 78.2

Imagga
created on 2019-06-01

room 100
hall 75.2
interior 74.4
classroom 60.9
furniture 57.8
table 55.7
chair 49
house 48.6
home 41
modern 39.3
floor 39.1
decor 35.4
design 34.4
wood 34.3
apartment 29.7
dining 29.5
window 28.4
inside 27.7
indoor 27.4
contemporary 27.3
architecture 26.6
kitchen 26.2
luxury 24.1
style 23.8
indoors 22.9
living 22.8
light 22.8
lamp 22
seat 21.9
decoration 21
sofa 20.4
residential 20.1
empty 19.8
chairs 19.6
3d 18.6
plant 17.9
glass 17.1
wall 15.7
comfortable 15.3
nobody 14.8
stove 14.8
decorate 14.3
restaurant 14.1
office 14
food 12.9
elegance 12.6
relaxation 12.6
desk 12.4
counter 12.3
urban 12.3
render 12.1
structure 12
residence 11.9
cabinet 11.9
stool 11.9
dinner 11.8
vase 11.6
wooden 11.4
cook 11
cabinets 10.9
tile 10.9
stylish 10.9
domestic 10.9
refrigerator 10.9
oven 10.8
couch 10.7
hotel 10.5
bar 10.2
relax 10.1
space 10.1
dining room 9.9
drawer 9.9
hardwood 9.8
sink 9.8
armchair 9.8
steel 9.7
expensive 9.6
estate 9.5
day 9.4
flower 9.2
drink 9.2
upscale 8.9
building 8.9
rug 8.9
tables 8.9
percussion instrument 8.9
parquet 8.8
carpet 8.8
lighting 8.7
comfort 8.7
business 8.5
area 8.2
deck 8.1
marble 7.9
cafeteria 7.9
living room 7.8
scene 7.8
rendering 7.6
lifestyles 7.6
place 7.5
classic 7.4
lifestyle 7.2
sunlight 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

table 98.9
indoor 97.9
floor 97
chair 95.2
room 94.7
living 82.1
wedding 74.7
coffee table 73.8
white 65.9
furniture 60.6
kitchen & dining room table 54.4
bed 52.7
several 10.2

Face analysis

Amazon

AWS Rekognition

Age 48-68
Gender Female, 50.3%
Disgusted 49.5%
Calm 49.9%
Surprised 49.6%
Angry 49.6%
Happy 49.7%
Sad 49.6%
Confused 49.6%

AWS Rekognition

Age 14-25
Gender Female, 53.7%
Disgusted 45.2%
Calm 48.5%
Angry 45.4%
Sad 47.6%
Happy 45.3%
Surprised 46.3%
Confused 46.7%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Disgusted 49.7%
Sad 49.6%
Calm 49.6%
Confused 49.6%
Surprised 49.6%
Happy 49.7%
Angry 49.6%

AWS Rekognition

Age 48-68
Gender Female, 54.2%
Confused 45.4%
Surprised 45.3%
Sad 47.1%
Angry 45.4%
Happy 45.4%
Calm 51.2%
Disgusted 45.3%

AWS Rekognition

Age 16-27
Gender Male, 54.7%
Confused 45.4%
Surprised 45.5%
Calm 47.8%
Sad 48.2%
Happy 47.1%
Disgusted 45.5%
Angry 45.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Confused 49.6%
Disgusted 49.6%
Happy 49.9%
Surprised 49.6%
Calm 49.7%
Sad 49.6%
Angry 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Disgusted 49.7%
Sad 49.8%
Surprised 49.6%
Happy 49.6%
Angry 49.7%
Calm 49.6%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Disgusted 49.5%
Sad 49.5%
Confused 49.5%
Happy 49.5%
Angry 49.5%
Surprised 49.5%
Calm 50.4%

AWS Rekognition

Age 48-68
Gender Female, 50.5%
Sad 49.6%
Calm 49.8%
Surprised 49.6%
Angry 49.5%
Disgusted 49.5%
Happy 49.9%
Confused 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Surprised 49.5%
Disgusted 49.5%
Calm 50.4%
Happy 49.5%
Sad 49.5%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.5%
Angry 49.6%
Happy 50%
Confused 49.5%
Sad 49.6%
Calm 49.7%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Happy 49.7%
Disgusted 49.6%
Angry 49.6%
Calm 50%
Sad 49.6%
Confused 49.5%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Calm 49.8%
Surprised 49.6%
Disgusted 49.6%
Happy 49.6%
Sad 49.6%
Confused 49.6%
Angry 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.2%
Happy 49.5%
Calm 49.5%
Angry 49.5%
Confused 49.5%
Surprised 49.5%
Sad 50.4%
Disgusted 49.5%

AWS Rekognition

Age 17-27
Gender Female, 50.5%
Calm 50.3%
Surprised 49.5%
Sad 49.5%
Confused 49.5%
Disgusted 49.6%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Surprised 49.7%
Confused 49.6%
Disgusted 49.6%
Happy 49.6%
Sad 49.7%
Calm 49.8%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Confused 49.6%
Surprised 49.6%
Sad 49.6%
Angry 49.6%
Happy 49.6%
Calm 50%
Disgusted 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Happy 49.6%
Confused 49.6%
Disgusted 49.6%
Sad 50%
Calm 49.6%
Angry 49.6%
Surprised 49.6%

AWS Rekognition

Age 48-68
Gender Female, 50%
Surprised 49.6%
Calm 50%
Disgusted 49.6%
Confused 49.5%
Sad 49.6%
Happy 49.6%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Sad 49.6%
Angry 49.5%
Happy 49.7%
Confused 49.6%
Calm 50%
Surprised 49.6%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Angry 49.5%
Sad 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.7%
Calm 50.2%
Confused 49.5%

AWS Rekognition

Age 45-65
Gender Female, 50.2%
Disgusted 49.7%
Confused 49.5%
Surprised 49.6%
Calm 49.9%
Happy 49.7%
Angry 49.6%
Sad 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Calm 50.1%
Disgusted 49.6%
Sad 49.6%
Surprised 49.6%
Happy 49.6%
Confused 49.6%
Angry 49.6%

AWS Rekognition

Age 38-57
Gender Female, 50.5%
Angry 49.5%
Calm 49.9%
Sad 49.6%
Surprised 49.6%
Disgusted 49.5%
Happy 49.7%
Confused 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Confused 49.6%
Sad 49.6%
Calm 50.1%
Happy 49.5%
Surprised 49.6%
Disgusted 49.5%
Angry 49.5%

AWS Rekognition

Age 20-38
Gender Female, 53.9%
Angry 45.3%
Sad 47.2%
Happy 45.7%
Calm 51.2%
Confused 45.2%
Disgusted 45.1%
Surprised 45.3%

AWS Rekognition

Age 17-27
Gender Female, 50.4%
Surprised 49.5%
Happy 49.6%
Disgusted 49.6%
Calm 50.1%
Sad 49.6%
Confused 49.6%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.6%
Confused 49.6%
Angry 49.6%
Calm 49.6%
Surprised 49.6%
Happy 49.9%
Sad 49.6%

Feature analysis

Amazon

Chair 99.5%
Person 96.8%

Captions

Microsoft

a room filled with furniture and a large window 77.6%
a black and white photo of a living room 70.9%
a room filled with furniture and a window 70.8%