Human Generated Data

Title

Untitled (official meeting, Committee on Public Works)

Date

1947

People

Artist: Harris & Ewing, American 1910s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22285

Human Generated Data

Title

Untitled (official meeting, Committee on Public Works)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Person 99.3
Human 99.3
Room 98.8
Indoors 98.8
Person 97.9
Person 97.4
Person 96.8
Person 96.5
Person 96.1
Lamp 93.7
Person 93.3
Person 91.9
Person 91.6
Person 88.9
Person 85
Person 84.1
Ballroom 83.4
Furniture 82.7
Interior Design 77.5
Person 77
Chandelier 76.3
Person 75.7
Dining Room 73.4
Person 72.2
Person 68.8
Hall 63.9
Living Room 57
Person 56.4
Person 52.3
Person 46.2

Imagga
created on 2022-03-11

restaurant 64.4
cafeteria 62.5
interior 57.5
building 45.4
room 43.4
table 40.7
chair 39.8
house 39.4
furniture 33.4
structure 31.9
home 31.1
architecture 26.7
decor 26.5
design 25.9
counter 25.7
floor 25.1
modern 24.5
dining 21.9
indoor 21
window 20.6
inside 20.2
style 20
luxury 19.7
chairs 19.6
hall 19.5
kitchen 19.2
lamp 19.1
decoration 18.8
indoors 17.6
wood 17.5
light 16.7
glass 16.3
barroom 16.3
comfortable 16.2
contemporary 16
residential 15.3
seat 14.3
empty 13.7
apartment 13.4
food 13.4
city 13.3
bar 12.9
dinner 12.6
living 12.3
residence 11.9
elegance 11.8
classroom 11.7
elegant 11.1
wall 11.1
center 10.9
drawer 10.9
stool 10.9
tables 10.8
stove 10.8
carpet 10.7
expensive 10.5
hotel 10.5
urban 10.5
decorate 10.5
plant 10.4
eat 10.1
party 9.5
space 9.3
drink 9.2
office 9
balcony 8.9
upscale 8.9
life 8.8
wooden 8.8
lighting 8.7
windows 8.6
sofa 8.6
estate 8.5
culture 8.5
real 8.5
relaxation 8.4
old 8.4
lights 8.3
traditional 8.3
waiter 8.2
stylish 8.1
night 8
cabinets 7.9
lunch 7.9
oven 7.9
sink 7.8
nobody 7.8
place 7.4
shop 7.4
cook 7.3
new 7.3
cabinet 7

Google
created on 2022-03-11

Building 91.7
Hall 85.3
Black-and-white 84
Style 83.9
Art 78.7
Monochrome 76.1
Event 72.9
Monochrome photography 72.5
Ceiling 71.7
Painting 70.2
Room 65.6
Symmetry 65.4
Font 64.7
Chair 64.3
History 64
Visual arts 63.6
Classic 63
Suit 62.4
Chandelier 61.5
Ballroom 60.7

Microsoft
created on 2022-03-11

text 92.5
indoor 90.5
table 90.3
white 80.6
building 80.4
furniture 72
person 70.6
old 43.8
cluttered 13.3
dining room 10.7

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Happy 65%
Sad 28%
Calm 3.7%
Fear 0.9%
Angry 0.7%
Disgusted 0.7%
Confused 0.6%
Surprised 0.4%

AWS Rekognition

Age 24-34
Gender Female, 99.2%
Calm 86%
Happy 8.9%
Sad 3.7%
Surprised 0.3%
Disgusted 0.3%
Angry 0.3%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 21-29
Gender Male, 56%
Calm 86.2%
Happy 6.6%
Sad 2.5%
Confused 1.9%
Disgusted 1.3%
Fear 0.5%
Surprised 0.5%
Angry 0.4%

AWS Rekognition

Age 16-22
Gender Male, 59.2%
Sad 49.1%
Fear 35.5%
Calm 7.1%
Angry 3.1%
Happy 1.8%
Confused 1.2%
Surprised 1.1%
Disgusted 1.1%

AWS Rekognition

Age 18-26
Gender Female, 99.5%
Calm 34.6%
Confused 18.6%
Happy 14.9%
Sad 12.3%
Fear 11.1%
Angry 4.9%
Disgusted 2%
Surprised 1.5%

AWS Rekognition

Age 28-38
Gender Male, 96.6%
Calm 82.5%
Happy 8%
Sad 5%
Fear 1.9%
Angry 0.8%
Disgusted 0.7%
Surprised 0.6%
Confused 0.5%

AWS Rekognition

Age 47-53
Gender Male, 98.5%
Sad 57.3%
Calm 15.1%
Fear 6.6%
Confused 6.3%
Angry 5.7%
Happy 5.4%
Disgusted 2.9%
Surprised 0.7%

AWS Rekognition

Age 4-10
Gender Female, 51.3%
Calm 68.5%
Sad 23.6%
Happy 3.7%
Fear 2.3%
Confused 1.3%
Disgusted 0.3%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 21-29
Gender Female, 63.1%
Fear 91.6%
Sad 3.6%
Happy 2.3%
Confused 1%
Surprised 0.5%
Calm 0.5%
Angry 0.3%
Disgusted 0.3%

AWS Rekognition

Age 18-24
Gender Female, 62.8%
Calm 99.4%
Sad 0.4%
Happy 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 22-30
Gender Male, 99.4%
Sad 42.6%
Calm 37.3%
Happy 14.9%
Confused 2.1%
Fear 1%
Disgusted 0.7%
Surprised 0.7%
Angry 0.6%

AWS Rekognition

Age 21-29
Gender Male, 62.7%
Sad 37.1%
Happy 17.1%
Confused 15.4%
Calm 12.3%
Angry 12.3%
Disgusted 2.2%
Fear 2.1%
Surprised 1.4%

AWS Rekognition

Age 21-29
Gender Male, 98.4%
Happy 34.4%
Calm 30.5%
Disgusted 8.4%
Sad 8.3%
Angry 8.3%
Fear 7%
Confused 1.7%
Surprised 1.5%

AWS Rekognition

Age 16-24
Gender Female, 54.6%
Calm 61.6%
Sad 33.9%
Angry 1%
Happy 0.8%
Fear 0.8%
Confused 0.8%
Disgusted 0.7%
Surprised 0.5%

AWS Rekognition

Age 18-24
Gender Female, 58.9%
Calm 75.4%
Sad 13.9%
Angry 4.4%
Happy 2.3%
Fear 1.6%
Surprised 0.9%
Confused 0.9%
Disgusted 0.6%

AWS Rekognition

Age 18-26
Gender Male, 59%
Calm 97.5%
Angry 0.8%
Happy 0.6%
Sad 0.4%
Fear 0.3%
Disgusted 0.2%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-24
Gender Female, 78%
Calm 96.2%
Happy 1.9%
Sad 0.5%
Angry 0.5%
Disgusted 0.4%
Fear 0.3%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 19-27
Gender Female, 98.2%
Sad 34.4%
Calm 32.6%
Happy 27.4%
Angry 1.5%
Fear 1.4%
Confused 1.4%
Disgusted 0.7%
Surprised 0.7%

AWS Rekognition

Age 23-31
Gender Male, 75.8%
Calm 84.5%
Sad 11.6%
Happy 1.3%
Disgusted 0.7%
Confused 0.7%
Angry 0.6%
Fear 0.4%
Surprised 0.2%

AWS Rekognition

Age 22-30
Gender Male, 92.9%
Calm 63.9%
Sad 24.4%
Happy 6.8%
Angry 1.7%
Disgusted 1.1%
Fear 0.8%
Confused 0.7%
Surprised 0.6%

AWS Rekognition

Age 20-28
Gender Male, 77.2%
Calm 98.3%
Sad 0.8%
Happy 0.3%
Confused 0.3%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 19-27
Gender Male, 66.1%
Happy 63.7%
Calm 31.8%
Sad 1.7%
Fear 0.8%
Confused 0.8%
Angry 0.5%
Surprised 0.4%
Disgusted 0.4%

AWS Rekognition

Age 18-26
Gender Female, 91.4%
Fear 71.9%
Surprised 14.1%
Happy 6.7%
Sad 3%
Confused 1.7%
Calm 1%
Angry 1%
Disgusted 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Chandelier 76.3%

Captions

Microsoft

an old photo of a group of people in a room 87.6%
a group of people in a room 87.5%
an old photo of a restaurant 87.4%

Text analysis

Amazon

&