Human Generated Data

Title

Untitled (family at kitchen counter)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17412

Human Generated Data

Title

Untitled (family at kitchen counter)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Restaurant 99.8
Person 99.4
Human 99.4
Person 98.9
Chair 98.9
Furniture 98.9
Chair 97.9
Food 97.2
Meal 97.2
Person 95.5
Table 95.5
Dining Table 95.5
Chair 93.6
Person 91.9
Cafe 90
Cafeteria 88.8
Chair 85.3
Room 84.4
Indoors 84.4
Person 75.1
Dish 64.5
Dining Room 63.9
Food Court 63.3
Diner 58.5

Imagga
created on 2022-02-26

chair 51.2
table 45.7
restaurant 41.3
interior 38
room 32.3
cafeteria 29.4
furniture 28.4
house 27.6
shop 25.3
barbershop 23.2
building 22.5
dining 21.9
chairs 21.5
home 20.7
floor 20.5
modern 19.6
counter 19.2
structure 18.9
seat 18.7
salon 18.1
design 16.9
decor 16.8
mercantile establishment 16.8
indoors 16.7
wood 16.7
dinner 15.7
inside 14.7
glass 14.1
tables 13.8
style 13.3
sitting 12.9
kitchen 12.7
patio 12.4
window 12.2
coffee 12
empty 12
indoor 11.9
drink 11.7
comfortable 11.5
lunch 11.4
place of business 11.3
contemporary 11.3
plant 11.2
food 11
architecture 10.9
business 10.9
decoration 10.9
classroom 10.6
luxury 10.3
meal 10.2
bar 10.2
hall 10.1
hairdresser 10
office 10
work 9.6
urban 9.6
waiter 9.6
people 9.5
day 9.4
lifestyle 9.4
light 9.4
eat 9.2
stool 8.9
relax 8.4
relaxation 8.4
city 8.3
balcony 8.3
stylish 8.1
man 8.1
wooden 7.9
employee 7.9
male 7.8
scene 7.8
person 7.8
class 7.7
wall 7.7
residential 7.7
outdoor 7.6
decorate 7.6
study 7.5
service 7.4
life 7.3
door 7.2

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

table 98.4
furniture 97.4
chair 96.4
clothing 88.4
window 85.8
woman 81.5
person 80.8
black and white 77.5
white 72.7
kitchen & dining room table 63.4
text 61.2
fast food 52.2
food 50.9

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 81.1%
Calm 96.7%
Happy 1.2%
Sad 0.6%
Angry 0.4%
Disgusted 0.4%
Confused 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 54-64
Gender Male, 57.7%
Calm 99.1%
Sad 0.8%
Confused 0.1%
Happy 0%
Surprised 0%
Fear 0%
Angry 0%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Chair 98.9%

Captions

Microsoft

a group of people sitting at a table in front of a window 85.9%
a group of people sitting in front of a window 83.7%
a group of people standing in front of a window 83.6%

Text analysis

Amazon

ЛАСОХ
5-00m ЛАСОХ
5-00m