Human Generated Data

Title

Untitled (office with receptionist and coatrack)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16548

Human Generated Data

Title

Untitled (office with receptionist and coatrack)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-12

Human 99.4
Person 99.4
Person 98.5
Restaurant 98.5
Person 98.1
Person 97
Person 94.9
Cafeteria 87.3
Clothing 82.2
Apparel 82.2
Furniture 80.3
Plywood 77.2
Wood 77.2
Meal 73.9
Food 73.9
Table 67.1
Flooring 66.9
Cafe 64.4
Person 62.7
Transportation 61.9
Vehicle 61.9
Train 61.9
Chair 58.9
Food Court 58.3
Dining Table 56.7

Imagga
created on 2022-02-12

room 73.6
interior 70
furniture 52.1
home 50.4
house 48.5
modern 47
table 41.1
kitchen 40.7
decor 39
floor 38.2
wood 36.7
design 33.2
luxury 32.6
counter 31.9
indoors 30.8
apartment 29.7
inside 29.5
indoor 29.3
chair 28.1
architecture 26.7
window 25.6
lamp 23.9
residential 23
light 22.1
3d 21.7
sofa 21.5
cabinet 20.8
wall 19.9
living 19.9
comfortable 19.1
stove 19
contemporary 18.8
nobody 18.7
style 18.6
new 17.8
domestic 17.2
glass 17.1
office 17.1
empty 16.3
decoration 15.9
dining 15.2
estate 15.2
building 15
oven 14.7
tile 14.5
vase 14.5
stylish 14.5
lifestyle 14.5
desk 14.2
appliance 13.4
clean 13.4
steel 13.3
center 12.8
ceiling 12.8
living room 12.7
restaurant 12.5
expensive 12.5
wooden 12.3
plant 12
sink 11.8
carpet 11.7
space 11.6
food 11.6
couch 11.6
marble 11.6
seat 11.4
render 11.3
panel 11.1
galley 11
refrigerator 11
island 11
residence 10.8
chairs 10.8
granite 10.8
area 10.8
bedroom 10.7
barbershop 10.7
bed 10.5
shop 10.3
equipment 10.3
construction 10.3
elegance 10.1
relaxation 10.1
cabinets 9.9
real estate 9.8
decorating 9.7
pillow 9.7
structure 9.7
lighting 9.7
real 9.5
hall 9.4
dinner 9.3
bar 9.3
cook 9.2
microwave 9
mansion 8.8
vessel 8.1
drawer 7.9
spacious 7.9
business 7.9
cooking 7.9
work 7.9
comfort 7.7
elegant 7.7
decorate 7.6
classroom 7.6
mercantile establishment 7.5
rest 7.4
lights 7.4
computer 7.3
color 7.2
parquet 7.1
monitor 7.1

Google
created on 2022-02-12

Microsoft
created on 2022-02-12

indoor 86.6
text 83.9
sink 80.7
bathroom 61.8
wedding dress 56.3

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 97.5%
Sad 51.9%
Calm 40.5%
Happy 3.2%
Confused 1.5%
Angry 1.2%
Surprised 0.7%
Disgusted 0.6%
Fear 0.4%

AWS Rekognition

Age 24-34
Gender Female, 55.5%
Calm 99.6%
Confused 0.1%
Sad 0.1%
Fear 0.1%
Happy 0.1%
Disgusted 0%
Surprised 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.4%
Train 61.9%

Captions

Microsoft

a person sitting on a bed 26%
a person standing in front of a mirror posing for the camera 25.9%
a person standing in front of a mirror 25.8%

Text analysis

Amazon

se

Google

-YT3HA°2-
28
-NAGON
MJIA-
MJIA- -YT3HA°2- -NAGON 28