Human Generated Data

Title

Untitled (formal meeting room, Committee on Interstate and Foreign Commerce)

Date

1956

People

Artist: Harris & Ewing, American 1910s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22238

Human Generated Data

Title

Untitled (formal meeting room, Committee on Interstate and Foreign Commerce)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

1956

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Indoors 99.7
Room 99.3
Person 99.1
Human 99.1
Ballroom 99
Person 98.8
Hall 98
Person 97.9
Person 95.4
Person 94.3
Person 92.2
Person 91.9
Person 91.6
Theater 86.2
Auditorium 86.2
Furniture 80.4
Interior Design 75.4
Person 75.2
Person 72.9
Person 70.9
Person 68.3
Person 67.3
Person 66.1
Person 66
Person 63.2
Person 60.9
Person 60.8
Waiting Room 59.8
Stage 58.7
Reception 56.1
Reception Room 56.1

Imagga
created on 2022-03-11

interior 73.4
room 62.9
furniture 50.3
table 49.8
house 44.9
hall 41
chair 40.3
home 40.2
decor 35.4
inside 30.4
modern 29.5
lamp 28.8
wood 28.4
floor 27.9
architecture 27.7
luxury 27.5
design 27
restaurant 25.8
indoor 25.6
window 24.3
dining 21.9
style 21.5
comfortable 21
decoration 21
living 20.9
chairs 20.6
residential 20.1
sofa 19.1
counter 18.7
indoors 18.5
kitchen 18.2
glass 17.9
apartment 17.3
decorate 16.2
light 16
contemporary 16
building 15.6
hotel 15.3
anteroom 15.1
empty 14.6
elegant 14.6
expensive 14.4
marble 14
classroom 13.7
office 13
residence 12.9
tables 12.8
carpet 12.6
dinner 12.6
elegance 12.6
lighting 11.8
cafeteria 11.8
nobody 11.7
couch 11.6
food 11.5
estate 11.4
real 11.4
seat 11
cabinet 10.8
stove 10.8
center 10.6
wall 10.6
plant 10.5
chandelier 10.4
structure 10.3
3d 10.1
fireplace 10
stylish 10
dining room 9.9
upscale 9.9
rug 9.9
bed 9.5
barroom 9.5
classic 9.3
stool 8.9
pillow 8.7
vase 8.7
decorated 8.6
space 8.5
drink 8.4
domestic 8.1
wooden 7.9
drawer 7.9
furnishings 7.9
sink 7.8
walls 7.8
real estate 7.8
tile 7.8
party 7.7
comfort 7.7
desk 7.6
eat 7.6
relaxation 7.5
lights 7.4
cook 7.3
new 7.3
bedroom 7

Google
created on 2022-03-11

Microsoft
created on 2022-03-11

indoor 99.3
table 95.3
building 80.5
white 72.7
text 71.8
chair 65.3
furniture 50.7
person 50.5
decorated 34.9
cluttered 26.3

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 68.2%
Calm 89.2%
Fear 9.3%
Sad 0.4%
Happy 0.4%
Angry 0.3%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 24-34
Gender Male, 98.5%
Sad 40.7%
Calm 39.6%
Happy 13.4%
Fear 2.3%
Confused 1.4%
Disgusted 1.1%
Angry 1.1%
Surprised 0.5%

AWS Rekognition

Age 16-22
Gender Male, 85%
Calm 73.9%
Sad 11.4%
Fear 6%
Confused 3.2%
Angry 2.4%
Disgusted 1.3%
Happy 1.1%
Surprised 0.7%

AWS Rekognition

Age 26-36
Gender Female, 54.7%
Calm 58%
Happy 29.3%
Sad 5.9%
Surprised 2.8%
Disgusted 1.1%
Confused 1.1%
Angry 0.9%
Fear 0.7%

AWS Rekognition

Age 23-33
Gender Male, 93.6%
Calm 99.3%
Sad 0.2%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Male, 87.6%
Calm 51.4%
Happy 30.9%
Confused 6.5%
Sad 4.4%
Disgusted 2.9%
Fear 2%
Surprised 1.1%
Angry 0.9%

AWS Rekognition

Age 20-28
Gender Female, 54.8%
Calm 29.9%
Sad 25.1%
Happy 23.6%
Fear 6.9%
Angry 5.4%
Confused 3.6%
Surprised 2.9%
Disgusted 2.7%

AWS Rekognition

Age 25-35
Gender Male, 83%
Happy 53.5%
Sad 18.3%
Fear 13.4%
Calm 8.5%
Disgusted 2.3%
Angry 1.8%
Confused 1.5%
Surprised 0.7%

AWS Rekognition

Age 42-50
Gender Male, 99.6%
Sad 35.5%
Happy 31.7%
Fear 16.7%
Calm 10.2%
Confused 2.6%
Disgusted 1.5%
Surprised 0.9%
Angry 0.9%

AWS Rekognition

Age 31-41
Gender Female, 98.1%
Sad 91.3%
Happy 2.9%
Fear 1.6%
Calm 1%
Surprised 1%
Angry 0.9%
Disgusted 0.7%
Confused 0.5%

AWS Rekognition

Age 24-34
Gender Female, 98.4%
Sad 39.3%
Calm 31.8%
Happy 12.7%
Fear 6.2%
Disgusted 3%
Confused 2.5%
Angry 2.4%
Surprised 2.1%

AWS Rekognition

Age 24-34
Gender Female, 51.3%
Calm 85.7%
Fear 6%
Sad 3.5%
Happy 2.8%
Confused 0.6%
Angry 0.6%
Surprised 0.5%
Disgusted 0.4%

AWS Rekognition

Age 22-30
Gender Male, 89.7%
Happy 53.5%
Sad 21.2%
Calm 15.1%
Angry 5.7%
Fear 2.5%
Disgusted 1.2%
Surprised 0.6%
Confused 0.4%

AWS Rekognition

Age 23-31
Gender Female, 96.7%
Calm 49.1%
Angry 26.8%
Sad 9.3%
Happy 6.1%
Disgusted 3.6%
Confused 2.5%
Fear 1.7%
Surprised 0.9%

AWS Rekognition

Age 21-29
Gender Male, 93.9%
Calm 94.4%
Happy 2.9%
Sad 1.2%
Fear 0.6%
Confused 0.4%
Disgusted 0.3%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 39-47
Gender Male, 90.6%
Angry 35.2%
Sad 21.6%
Happy 15.3%
Calm 11.2%
Confused 9.7%
Disgusted 3.8%
Surprised 1.8%
Fear 1.3%

AWS Rekognition

Age 12-20
Gender Female, 90%
Fear 67.8%
Happy 16.4%
Calm 6.2%
Angry 4.9%
Sad 2.5%
Disgusted 1.3%
Surprised 0.5%
Confused 0.4%

AWS Rekognition

Age 19-27
Gender Female, 56.4%
Sad 42.7%
Calm 40.8%
Happy 13.3%
Confused 1%
Disgusted 0.7%
Angry 0.7%
Fear 0.5%
Surprised 0.3%

AWS Rekognition

Age 21-29
Gender Male, 74.6%
Calm 89.8%
Happy 5.8%
Sad 1.9%
Angry 1.3%
Confused 0.7%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Female, 63.4%
Calm 99.8%
Happy 0.1%
Sad 0%
Disgusted 0%
Surprised 0%
Fear 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 22-30
Gender Male, 96.8%
Disgusted 44.3%
Calm 20.5%
Sad 14.5%
Confused 7.6%
Happy 5.8%
Angry 3.6%
Surprised 2.4%
Fear 1.3%

AWS Rekognition

Age 2-8
Gender Male, 99.9%
Calm 91%
Sad 4.8%
Confused 1.3%
Angry 1%
Happy 0.9%
Disgusted 0.5%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 18-26
Gender Male, 65.5%
Calm 77.4%
Happy 18.9%
Sad 2%
Angry 0.6%
Fear 0.4%
Confused 0.3%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 16-22
Gender Female, 58.1%
Happy 73.1%
Fear 11.2%
Calm 11%
Angry 1.9%
Sad 0.9%
Surprised 0.7%
Confused 0.6%
Disgusted 0.6%

AWS Rekognition

Age 19-27
Gender Female, 72.1%
Happy 93.4%
Calm 3.9%
Sad 1.2%
Confused 0.7%
Angry 0.3%
Surprised 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 31-41
Gender Female, 63%
Calm 94.2%
Sad 4%
Angry 1.1%
Happy 0.2%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 99.4%
Calm 89.9%
Happy 3.3%
Angry 3.2%
Sad 3.2%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 18-24
Gender Male, 90.7%
Calm 80.3%
Sad 9.1%
Happy 2.5%
Confused 2.4%
Surprised 2%
Angry 1.8%
Disgusted 1.2%
Fear 0.8%

AWS Rekognition

Age 16-24
Gender Female, 83.5%
Calm 61.2%
Sad 18.5%
Confused 4.6%
Happy 4.3%
Angry 4.1%
Disgusted 3%
Fear 2.8%
Surprised 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a room filled with furniture and a mirror 86.2%
a room filled with furniture and a large mirror 76.8%
a view of a living room filled with furniture and a mirror 68.1%

Text analysis

Amazon

PEACE
ON
ON EARTH
EARTH
Healt

Google

o
o oo o
oo