Human Generated Data

Title

Untitled (boy and girl playing cards in living room)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16967

Human Generated Data

Title

Untitled (boy and girl playing cards in living room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Chair 99
Furniture 99
Human 98.9
Person 98.9
Chair 96.8
Chair 96.7
Indoors 95.5
Room 95.5
Person 94.8
Dining Room 91.5
Living Room 89.1
Table 88.9
Restaurant 84.3
Chair 82.7
Dining Table 74.4
Meal 71.9
Food 71.9
Cafe 69.9
Cafeteria 65.9
Floor 55.8

Imagga
created on 2022-02-26

room 79.8
interior 74.4
furniture 60.9
house 57.7
home 55.1
table 49.6
decor 41.6
modern 40.7
floor 40
chair 38.2
kitchen 35.2
design 33.8
luxury 33.5
inside 30.4
wood 30.1
window 29.9
salon 29
architecture 28.9
apartment 28.8
living 28.5
indoor 28.3
style 25.3
sofa 24
residential 24
decoration 23.9
dining 22.9
barbershop 22.7
contemporary 22.6
indoors 22
lamp 22
estate 21.9
cabinet 21.1
bedroom 20.3
light 20.1
shop 19
chairs 18.6
comfortable 18.2
door 17.8
nobody 16.3
3d 15.5
domestic 15.5
empty 15.5
real 15.2
glass 14.8
restaurant 14.8
mercantile establishment 14.4
expensive 14.4
elegance 14.3
wall 14
tile 13.6
clean 13.4
decorate 13.3
seat 13.3
elegant 12.9
rug 12.8
residence 12.7
carpet 12.7
sliding door 12.1
area 12
plant 12
stylish 11.8
vase 11.6
counter 11.6
anteroom 11.5
hotel 11.5
wooden 11.4
new 11.4
building 11.3
structure 10.9
space 10.9
lifestyle 10.9
stove 10.8
hardwood 10.8
oven 10.8
living room 10.8
clinic 10.7
couch 10.6
classic 10.2
relaxation 10.1
cabinets 9.9
drawer 9.9
refrigerator 9.9
ceiling 9.8
sink 9.8
place of business 9.8
food 9.7
lighting 9.7
lifestyles 9.5
bathroom 9.5
dinner 9.3
cook 9.2
upscale 8.9
faucet 8.9
fireplace 8.1
parquet 8
dining room 7.9
spacious 7.9
furnishings 7.9
china cabinet 7.9
tables 7.9
cozy 7.9
mansion 7.9
real estate 7.8
render 7.8
decorating 7.8
hospital 7.7
comfort 7.7
construction 7.7
flower 7.7
rendering 7.6
mirror 7.6
marble 7.4
movable barrier 7.2

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

indoor 99.4
text 98.4
window 98.3
table 96.9
chair 95.3
house 94.4
black and white 84.7
room 81.5
coffee table 78.2
vase 72.8
kitchen & dining room table 72
bed 71.4
white 65.1
couch 61
building 60.7
cabinetry 59.7
furniture 33.5

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 85.1%
Calm 96.1%
Sad 3%
Confused 0.3%
Happy 0.2%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 19-27
Gender Male, 94.7%
Calm 89.3%
Sad 7%
Surprised 1.2%
Confused 0.8%
Happy 0.7%
Disgusted 0.5%
Angry 0.4%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Possible

Feature analysis

Amazon

Chair 99%
Person 98.9%
Dining Table 74.4%

Captions

Microsoft

a dining room table in front of a window 85.7%
a person sitting at a table in front of a window 73.1%
a room filled with furniture and a large window 73%

Text analysis

Amazon

KODAA-ITW

Google

MJI7-- YT37A°2--AGO
MJI7--
YT37A°2--AGO