Human Generated Data

Title

Untitled (advertising agency reception room)

Date

1948

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20109

Human Generated Data

Title

Untitled (advertising agency reception room)

People

Artist: Peter James Studio, American

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.4
Human 99.4
Person 98.3
Person 95.1
Restaurant 94.2
Lighting 93.2
Sitting 93.1
Furniture 92.2
Indoors 88.4
Cafe 87.6
Person 87.4
Room 85.5
Person 85.4
Cafeteria 82.8
Interior Design 79.9
Flooring 75.5
Tabletop 73.5
Table 73.1
Floor 69
Lobby 67.3
Studio 64.1
Living Room 59.6
Couch 55.5
Desk 52.2

Imagga
created on 2022-03-05

room 66.7
interior 62.8
table 44.9
furniture 42.5
chair 41.1
counter 38
home 31.9
modern 31.6
house 30.9
floor 29.8
classroom 28.6
design 28.2
shop 26.1
barbershop 25
indoors 24.6
office 23.9
decor 23.9
luxury 22.3
lamp 22
wood 21.7
light 21.4
window 21.2
teacher 20.5
inside 20.3
restaurant 20.2
architecture 19.5
center 18.5
indoor 18.3
sofa 18.2
apartment 17.3
empty 17.2
chairs 16.7
wall 16.4
kitchen 16.3
comfortable 16.2
living 16.1
mercantile establishment 15.5
dining 15.2
residential 14.4
glass 14
hotel 13.4
3d 13.2
carpet 12.7
style 12.6
lighting 12.6
decoration 12.3
professional 12.3
contemporary 12.2
building 12.1
domestic 11.9
elegance 11.8
place of business 11.7
desk 11.6
couch 11.6
business 11.6
seat 11.5
man 11.4
estate 11.4
educator 11.3
work 11
relaxation 10.9
lifestyle 10.8
tables 10.8
decorate 10.5
relax 10.1
person 10.1
mirror 9.5
render 9.5
real 9.5
elegant 9.4
plant 9
living room 8.8
hall 8.8
wooden 8.8
residence 8.8
women 8.7
nobody 8.6
communication 8.4
people 8.4
stylish 8.1
upscale 7.9
food 7.9
dinner 7.6
lights 7.4
service 7.4
bar 7.4
structure 7.3
computer 7.2
establishment 7.2
hospital 7.2

Google
created on 2022-03-05

Black-and-white 87.3
Interior design 85.7
Style 84.1
Monochrome 80.3
Monochrome photography 79.1
Fixture 76.7
Chair 73
Flooring 71.2
Rectangle 68.7
Room 67.8
Building 66.2
Ceiling 65.7
Stock photography 63.3
Art 58.5
Table 57.6
Desk 54.7
Visual arts 54.5
Retail 53.1
Suit 51.1

Microsoft
created on 2022-03-05

indoor 99.3
wall 97
floor 96.3
person 93.6
ceiling 91.1
black and white 90.2
clothing 87.8
room 80.5
chair 79.8
text 79.8
desk 72.7
man 71.5
building 56
furniture 35.9
table 35.4
several 13.7

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 99.1%
Calm 99.6%
Surprised 0.3%
Disgusted 0%
Confused 0%
Sad 0%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Female, 92.4%
Calm 97.1%
Happy 1.3%
Sad 0.4%
Surprised 0.4%
Fear 0.3%
Confused 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 38-46
Gender Male, 98.7%
Calm 66.8%
Happy 11.5%
Sad 9.2%
Confused 5.5%
Angry 3%
Disgusted 1.3%
Surprised 1.3%
Fear 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Desk 52.2%

Captions

Microsoft

a group of people in a room 90%
a group of people standing in a room 86.7%
a group of people that are standing in a room 79.7%

Text analysis

Amazon

CVCC
28