Human Generated Data

Title

Untitled (couple having meal inside pool hall)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16090

Human Generated Data

Title

Untitled (couple having meal inside pool hall)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Chair 98.8
Furniture 98.8
Human 98.7
Person 98.7
Person 98.5
Person 98.2
Person 98.1
Person 97.2
Restaurant 95.9
Chair 93
Wood 91.7
Chair 90.9
Plywood 87.8
Sitting 84.6
Person 84.2
Person 77.7
Person 77.3
Food Court 76.3
Food 76.3
Beverage 74.2
Alcohol 74.2
Drink 74.2
Cafe 72.4
Cafeteria 69.9
Person 67.5
Bottle 65.9
Person 65.4
Pub 63.6
Person 63.4
Person 63.3
Flooring 62.8
Person 61.7
Bar Counter 59.9
Dining Table 57.3
Table 57.3
Wine 57.1
Chair 50.5
Person 45.2
Person 44.1

Imagga
created on 2022-02-05

restaurant 100
cafeteria 82.8
building 64.6
interior 54
chair 51.1
structure 48.1
table 47.6
room 44.3
furniture 31.1
dining 27.6
modern 25.2
house 24.2
wood 24.2
indoors 23.7
design 23.6
chairs 23.5
floor 23.3
home 22.3
empty 21.5
dinner 21.2
hall 20.6
seat 19.9
decor 19.5
inside 19.3
tables 18.7
window 18.5
comfortable 18.2
indoor 17.4
glass 17.1
style 17.1
food 17
contemporary 16.9
architecture 16.4
eat 15.9
drink 15.9
lunch 15.1
light 14.7
elegance 13.4
classroom 13.1
kitchen 13.1
decoration 13
bar 12.9
luxury 12.9
stool 12.8
office 12.8
residential 12.5
hotel 12.4
lamp 12.4
urban 12.2
city 11.6
party 11.2
coffee 11.1
relax 11
counter 10.8
meal 10.7
plant 10.5
desk 10.4
life 10.2
service 10.2
diner 9.8
business 9.7
scene 9.5
decorate 9.5
living 9.5
wall 9.4
place 9.3
stylish 9
people 8.9
cabinets 8.9
drawer 8.9
stove 8.9
wooden 8.8
lifestyle 8.7
elegant 8.6
nobody 8.6
culture 8.6
space 8.5
upscale 7.9
lighting 7.8
sofa 7.7
relaxation 7.5
row 7.5
man 7.4
wine 7.4
cook 7.3
waiter 7.2
banquet 7.2
celebration 7.2
person 7.1
work 7.1

Google
created on 2022-02-05

Furniture 95.1
Chair 93.8
Table 92.4
Lighting 86.4
Wood 74.4
Event 74.3
Leisure 74.2
T-shirt 71
Fun 69.8
Coffee table 66.3
Conversation 64.4
Houseplant 63.8
Plucked string instruments 62.8
Room 62.7
Barware 62.5
Cafeteria 61
Sitting 59.8
Recreation 59.5
Folk instrument 57.5
Musician 52.2

Microsoft
created on 2022-02-05

indoor 99.4
table 96.7
furniture 96.4
floor 95.9
wall 95.2
chair 94.4
person 88.8
clothing 82.3
text 68.2
woman 61.1
kitchen & dining room table 56.7
restaurant 31.7
dining table 13
dining room 6.9

Face analysis

Amazon

Google

AWS Rekognition

Age 18-24
Gender Male, 86.5%
Calm 65.3%
Happy 17.5%
Fear 12.4%
Sad 1.9%
Surprised 0.9%
Confused 0.8%
Disgusted 0.7%
Angry 0.5%

AWS Rekognition

Age 33-41
Gender Male, 79.3%
Sad 77.8%
Calm 9.6%
Fear 3.9%
Disgusted 3.1%
Surprised 2.2%
Angry 1.6%
Happy 1.3%
Confused 0.7%

AWS Rekognition

Age 26-36
Gender Male, 97.8%
Disgusted 39.4%
Happy 29.4%
Sad 11.5%
Confused 8.4%
Surprised 3.7%
Angry 3.2%
Fear 2.5%
Calm 2%

AWS Rekognition

Age 19-27
Gender Male, 84.9%
Sad 88.5%
Calm 5.2%
Happy 5%
Angry 0.4%
Confused 0.3%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 16-22
Gender Male, 98.9%
Sad 31.3%
Confused 21.8%
Fear 18.4%
Calm 10.3%
Angry 7.2%
Happy 5.1%
Disgusted 3.6%
Surprised 2.3%

AWS Rekognition

Age 4-10
Gender Female, 99.7%
Happy 98.2%
Sad 0.6%
Calm 0.3%
Confused 0.2%
Surprised 0.2%
Fear 0.2%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 7-17
Gender Male, 99.9%
Calm 57.3%
Happy 18.4%
Sad 11.3%
Confused 4.6%
Disgusted 2.6%
Surprised 2.5%
Angry 2.4%
Fear 0.9%

AWS Rekognition

Age 24-34
Gender Female, 99.6%
Sad 51%
Fear 14.1%
Calm 13.5%
Disgusted 6.4%
Happy 4.8%
Surprised 4.6%
Confused 2.9%
Angry 2.7%

AWS Rekognition

Age 13-21
Gender Female, 75.3%
Calm 53.1%
Fear 37.1%
Happy 4.6%
Sad 1.4%
Angry 1.3%
Surprised 1.1%
Disgusted 0.8%
Confused 0.6%

AWS Rekognition

Age 19-27
Gender Male, 98.7%
Calm 79.8%
Sad 10.5%
Angry 2.7%
Fear 2.1%
Happy 1.9%
Surprised 1.3%
Confused 1%
Disgusted 0.7%

AWS Rekognition

Age 7-17
Gender Female, 61.5%
Calm 87.5%
Sad 5.8%
Confused 2.6%
Fear 1.4%
Disgusted 0.8%
Angry 0.8%
Surprised 0.5%
Happy 0.5%

AWS Rekognition

Age 16-24
Gender Female, 89.1%
Calm 97.9%
Angry 0.7%
Happy 0.4%
Sad 0.4%
Disgusted 0.3%
Confused 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 16-24
Gender Male, 61.6%
Calm 75.4%
Sad 21.3%
Happy 1.1%
Confused 0.6%
Disgusted 0.5%
Fear 0.4%
Angry 0.4%
Surprised 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 98.8%
Person 98.7%

Captions

Microsoft

a group of people sitting at a table in a restaurant 93.6%
a group of people sitting at a table 93.5%
a group of people sitting around a table 93.4%