Human Generated Data

Title

Untitled (North Side Grocery, customers shopping)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3591

Human Generated Data

Title

Untitled (North Side Grocery, customers shopping)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-04

Human 99.8
Person 99.8
Person 99.6
Person 99.5
Person 93.8
Person 89.4
Meal 87
Food 87
Person 83.2
Restaurant 76.3
Shop 75
Dish 74.4
Furniture 66
Cafeteria 65.1
Shelf 62.7
Face 61.3
Screen 56.6
Monitor 56.6
Electronics 56.6
Display 56.6
Person 47.5
Person 41.6

Imagga
created on 2022-02-04

shop 75.6
barbershop 61.6
mercantile establishment 55
place of business 36.1
building 22.8
salon 20
counter 19.6
people 19.5
business 18.2
interior 17.7
city 17.4
establishment 17.2
glass 17.1
architecture 16.4
man 15.4
modern 15.4
urban 14.8
restaurant 14.6
indoor 14.6
indoors 14
window 13.4
supermarket 12.9
mall 11.7
light 11.4
travel 11.3
equipment 11.2
inside 11
office 11
transportation 10.7
construction 10.3
black 10.2
chair 10.2
design 10.1
house 10
silhouette 9.9
technology 9.6
buy 9.4
industry 9.4
room 9.3
floor 9.3
shopping 9.2
center 8.9
working 8.8
men 8.6
old 8.4
transport 8.2
structure 8
steel 7.9
businessman 7.9
male 7.8
customer 7.6
lamp 7.6
finance 7.6
shoe shop 7.4
television 7.3
digital 7.3
lifestyle 7.2
computer 7.2
stall 7.1
adult 7.1
worker 7.1
information 7.1
furniture 7

Google
created on 2022-02-04

Black-and-white 85.5
Style 83.9
Retail 78.1
Font 76.5
Automotive design 75.6
Shelf 75.1
Display case 74.3
Art 72.7
Monochrome photography 71.7
Monochrome 70.3
Eyewear 69.2
Building 68.3
T-shirt 65.3
Glass 64.9
Rectangle 64.1
Customer 63.8
City 63.6
Visual arts 61.6
Room 60.7
Display window 60.2

Microsoft
created on 2022-02-04

text 93.4
black and white 90.7
clothing 90.5
indoor 90.4
person 90.3
man 64.9
ship 61
building 54
monochrome 52.3
street 51.9
store 45.1

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 96.8%
Sad 1.3%
Confused 0.8%
Happy 0.5%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 31-41
Gender Male, 70.1%
Calm 99.5%
Angry 0.2%
Confused 0.1%
Happy 0.1%
Sad 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Male, 70.6%
Calm 72.6%
Happy 13.9%
Sad 8.2%
Angry 2.9%
Confused 0.7%
Fear 0.6%
Disgusted 0.6%
Surprised 0.4%

AWS Rekognition

Age 42-50
Gender Female, 80.3%
Calm 85.1%
Sad 6.9%
Happy 3.8%
Confused 3.1%
Angry 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Female, 61.8%
Calm 78.7%
Confused 7.2%
Happy 4.3%
Surprised 2.2%
Sad 2.2%
Angry 2.1%
Fear 1.7%
Disgusted 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a person standing in front of a store window 75.1%
a person standing in front of a store window 67.9%
a person standing in front of a store 67.8%

Text analysis

Amazon

03
Brand
BROWN'S
Product
Soni Product
Soni
Red
ne
BAG
FER BAG
FER