Human Generated Data

Title

Untitled (formal student lounge, young men seated, studying and reading)
Date

1946
People

Artist: Harris & Ewing, American 1910s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22254

Human Generated Data

Title

Untitled (formal student lounge, young men seated, studying and reading)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22254

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Furniture 98.5
Restaurant 98.5
Person 97.9
Human 97.9
Person 97.4
Room 96.8
Indoors 96.8
Couch 96
Person 94.4
Living Room 94.3
Person 93
Interior Design 87.8
Cafeteria 86.1
Chair 81.2
Dining Room 80.3
Table 79.7
Dining Table 79.2
Meal 76.1
Food 76.1
Cafe 73.6
Person 68.7
Dish 66.6
Person 61.4
Flooring 59.3
Waiting Room 59.2
Food Court 58.1
Reception Room 56.7
Reception 56.7

Clarifai
created on 2023-10-22

furniture 99.5
room 99
indoors 98.4
people 97.4
table 97.4
chair 96.5
man 94.7
group 92.3
adult 90.6
group together 90.4
woman 90.1
seat 90
hotel 89.4
luxury 89.2
bed 89.1
home 88.2
inside 88
lamp 87.2
monochrome 86.5
family 84.9

Imagga
created on 2022-03-11

room 71
interior 62.8
restaurant 56.4
table 51.9
furniture 48.9
chair 43.1
house 37.6
modern 34.4
home 32.7
decor 31.8
building 31.1
design 30.4
floor 28.8
luxury 27.4
center 25.3
wood 25
structure 24.1
empty 24.1
lamp 23.8
cafeteria 23.6
chairs 23.5
classroom 23.3
inside 23
comfortable 22
dining 21.9
architecture 21.2
indoor 21
seat 20.8
style 20.8
indoors 20.2
light 20.1
decoration 18.8
window 18.6
dinner 17.9
glass 17.9
residential 17.2
living 17.1
kitchen 16.6
hotel 16.2
contemporary 16
tables 15.8
nobody 15.6
sofa 15.4
office 14.7
hall 14.3
food 14
bar 13.9
elegance 13.4
apartment 13.4
relaxation 13.4
wall 12.8
carpet 12.6
couch 12.6
wooden 12.3
counter 11.5
decorate 11.4
place 11.2
eat 10.9
space 10.9
lunch 10.6
plant 10.4
desk 10.1
relax 10.1
stool 9.9
upscale 9.9
vase 9.7
lighting 9.7
bedroom 9.6
urban 9.6
bed 9.5
banquet 9.4
3d 9.3
drink 9.2
stylish 9
drawer 8.9
furnishings 8.9
stove 8.9
pillow 8.7
comfort 8.7
party 8.6
fireplace 8.6
elegant 8.6
estate 8.6
business 8.5
travel 8.4
service 8.3
domestic 8.1
reflection 8.1
lifestyle 8
refrigerator 7.9
cozy 7.9
hardwood 7.9
ceiling 7.9
work 7.9
walls 7.8
scene 7.8
residence 7.8
tile 7.6
real 7.6
meal 7.6
clean 7.5
shop 7.4
life 7.4
warm 7.4
new 7.3
breakfast 7.2
family 7.1
night 7.1
armchair 7.1
cabinet 7

Google
created on 2022-03-11

Building 91.2
Table 90.4
Black 89.5
Chair 88.6
Couch 87.9
Black-and-white 85.4
Interior design 84.8
Style 84.1
Living room 80.8
Monochrome photography 74.2
Window 72.5
Monochrome 72.4
Event 71.8
Kitchen & dining room table 69
Coffee table 67.9
Room 65.7
Hall 62
Curtain 60.3
Classic 60.1
Ceiling 59.1

Microsoft
created on 2022-03-11

table 99.2
indoor 93.7
furniture 90
black and white 89.1
text 84.2
house 71.7
building 56.7
vase 55.8
chair 52.2
clothes 21

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Female, 87.5%
Calm 90.1%
Sad 5.1%
Happy 1.3%
Fear 0.9%
Surprised 0.8%
Disgusted 0.8%
Angry 0.5%
Confused 0.4%

AWS Rekognition

Age 27-37
Gender Female, 56.8%
Fear 27.3%
Sad 21%
Calm 18.8%
Happy 17.8%
Surprised 4.7%
Angry 4.3%
Disgusted 4%
Confused 2.1%

AWS Rekognition

Age 29-39
Gender Female, 56.7%
Sad 88.4%
Calm 8.8%
Confused 0.9%
Happy 0.7%
Fear 0.6%
Disgusted 0.3%
Surprised 0.2%
Angry 0.2%

AWS Rekognition

Age 20-28
Gender Male, 97.9%
Calm 45.5%
Angry 24.3%
Sad 17.4%
Fear 4.9%
Happy 4.2%
Disgusted 1.8%
Surprised 1%
Confused 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person
Person 97.9%
Person 97.4%
Person 94.4%
Person 93%
Person 68.7%
Person 61.4%

Captions

Microsoft
created on 2022-03-11

a group of people in a room 92.3%
a group of people sitting on a bed 56.2%
a group of people on a bed 56.1%