Human Generated Data

Title

Untitled (four men and one woman at buffet table in house)
Date

c. 1950
People

Artist: Jack Rodden Studio, American 1914 - 2016
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13734

Human Generated Data

Title

Untitled (four men and one woman at buffet table in house)

People

Artist: Jack Rodden Studio, American 1914 - 2016

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-04

Person 99.4
Human 99.4
Person 98.9
Person 98.9
Person 97.5
Interior Design 93.9
Indoors 93.9
Food 85.3
Sweets 85.3
Confectionery 85.3
Clothing 84.9
Apparel 84.9
Icing 83.7
Dessert 83.7
Cake 83.7
Cream 83.7
Creme 83.7
Poster 81.8
Advertisement 81.8
People 77.1
Dish 76.3
Meal 76.3
Furniture 75.6
Shop 74.8
Face 70.6
Room 66.4
Dress 66.1
Living Room 65.4
Female 59.8
Bakery 58.9
Shelf 58.2

Imagga
created on 2022-02-04

case 91.7
shop 56.2
mercantile establishment 40.1
place of business 26.7
old 21.6
vintage 21.5
toyshop 20
architecture 18
religion 17.9
barbershop 17.7
window 17.5
building 17
house 15.9
city 15.8
antique 14.3
art 14.3
ancient 13.8
decoration 13.8
home 13.5
establishment 13.4
retro 13.1
interior 12.4
door 12.4
church 12
historic 11.9
history 11.6
wall 11.1
tobacco shop 10.7
temple 10.4
china 10.3
religious 10.3
culture 10.2
god 9.6
glass 9.3
tradition 9.2
design 9
detail 8.8
shoe shop 8.8
urban 8.7
icon 8.7
prayer 8.7
travel 8.4
people 8.4
traditional 8.3
room 8.2
aged 8.1
brown 8.1
man 8.1
indoors 7.9
holiday 7.9
belief 7.8
person 7.8
entrance 7.7
worship 7.7
facade 7.7
texture 7.6
roof 7.6
stall 7.6
wood 7.5
symbol 7.4
street 7.4
inside 7.4
indoor 7.3
business 7.3
bakery 7.2
black 7.2

Google
created on 2022-02-04

Picture frame 94.2
Black 89.7
Table 81.8
Art 74.6
Font 74.2
Vintage clothing 72.1
Monochrome photography 71.6
Monochrome 71.3
Classic 71.1
Room 70.1
Shelf 68.1
Suit 67.9
Rectangle 65.4
Event 64.5
Antique 63
Stock photography 62.6
Painting 62.5
History 60.6
Collection 60.1
Visual arts 59.4

Microsoft
created on 2022-02-04

text 99.4
person 88.4
clothing 86.1
store 50.4
old 48.8

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 99.5%
Sad 96.9%
Confused 1%
Calm 1%
Angry 0.5%
Happy 0.2%
Disgusted 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 36-44
Gender Male, 67.9%
Calm 99.5%
Fear 0.1%
Sad 0.1%
Happy 0.1%
Surprised 0.1%
Disgusted 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 48-56
Gender Male, 95.7%
Sad 93.7%
Calm 3.6%
Confused 1.5%
Happy 0.4%
Surprised 0.3%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 14-22
Gender Male, 72.7%
Calm 78.8%
Sad 17.7%
Confused 1%
Surprised 0.6%
Angry 0.6%
Fear 0.5%
Happy 0.4%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Poster 81.8%

Captions

Microsoft

a person standing in front of a store window 59.5%
a person standing in front of a store window 49.4%
a person standing in front of a store 49.3%

Text analysis

Amazon

1
KODAK
SAFETY

Google

KODAK
KODAK SAFETY
SAFETY