Human Generated Data

Title

Untitled (three men sitting in country general store)
Date

c. 1960
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15411

Human Generated Data

Title

Untitled (three men sitting in country general store)

People

Artist: Jack Gould, American

Date

c. 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.5
Human 99.5
Person 99.1
Person 91.8
Confectionery 87.4
Food 87.4
Sweets 87.4
Chair 82.8
Furniture 82.8
Bazaar 78.6
Market 78.6
Shop 78.6
Building 75.9
Home Decor 64.1
Indoors 63.3
Living Room 63.3
Room 63.3
Outdoors 62.7
Architecture 61.6
Cushion 58.9
People 58.6
Nature 58.2
Chair 55.1

Imagga
created on 2022-03-05

wicker 34.1
interior 27.4
table 24.5
chair 23.1
restaurant 20.2
work 20.1
rattan 19.4
product 19
furniture 16.4
room 15.9
decor 15.9
traditional 15.8
dinner 15.5
architecture 14.9
switch 14.6
wood 14.2
food 14
old 13.9
home 13.5
house 13.5
glass 12.9
travel 12.7
style 12.6
creation 12.6
religion 12.5
stall 12.4
decoration 12.3
tourism 11.5
holiday 11.5
building 11.5
harp 11.2
instrument of punishment 11.1
inside 11
chairs 10.8
dining 10.5
wine 10.4
party 10.3
design 10.1
vintage 10.1
seat 10
gold 9.9
wooden 9.7
shop 9.6
luxury 9.4
lunch 9.4
tradition 9.2
eat 9.2
wedding 9.2
drink 9.2
vacation 9
city 8.4
place 8.4
brown 8.1
celebration 8
instrument 7.9
indoors 7.9
day 7.8
flowers 7.8
temple 7.8
device 7.7
service 7.4
sun 7.2
dress 7.2
art 7.1

Google
created on 2022-03-05

Hat 84.3
Chair 83.9
Tints and shades 76.5
Window 74.2
Wood 73.6
Event 70.2
Sun hat 68.4
Room 68
Vintage clothing 65.4
Art 64.9
Stock photography 63.8
History 59.5
Visual arts 59.1
Antique 55.9
Collection 55.8
Fedora 52.5
Classic 50.9

Microsoft
created on 2022-03-05

furniture 97.3
chair 93.2
text 91.5
table 91.4
building 68
items 54.9

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 97.1%
Calm 94.3%
Surprised 1.5%
Angry 1.4%
Confused 1.4%
Disgusted 0.6%
Happy 0.4%
Sad 0.2%
Fear 0.2%

AWS Rekognition

Age 48-54
Gender Male, 94.8%
Calm 99.7%
Happy 0.2%
Sad 0%
Angry 0%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 82.8%

Captions

Microsoft

a group of people sitting at a table in a restaurant 61.9%
a group of people sitting at a table 54.9%
a group of items on a table 54.8%

Text analysis

Amazon

Gloves
AC
-
BOSS
NDERED
- petas
G14
petas

Google

Boss Gloves
Boss
Gloves