Human Generated Data

Title

Bar – Louisville, Kentucky

Date

1974

People

Artist: Dennis Feldman, American born 1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist, 2018.291

Human Generated Data

Title

Bar – Louisville, Kentucky

People

Artist: Dennis Feldman, American born 1946

Date

1974

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist, 2018.291

Machine Generated Data

Tags

Amazon
created on 2023-01-24

Beer 99.6
Alcohol 99.6
Beverage 99.6
Person 99.3
Man 99.3
Adult 99.3
Male 99.3
Person 99
Man 99
Adult 99
Male 99
Pub 98.7
Restaurant 98.4
Indoors 98.4
Person 98.2
Man 98.2
Adult 98.2
Male 98.2
Face 96.2
Head 96.2
Wristwatch 92.8
Portrait 86.9
Photography 86.9
Stout 78.1
Person 71.9
Child 71.9
Girl 71.9
Female 71.9
Plate 65.8
Dining Table 57.2
Table 57.2
Furniture 57.2
Bar Counter 57.1
Bar 57.1
Liquor 57.1
Dining Room 56.8
Room 56.8
Building 56.8
Architecture 56.8
Finger 56.1
Hand 56.1
Body Part 56.1
Cafe 56.1
Diner 55.9
Food 55.9
Glass 55.5
Food Court 55.2
Smoke 55.2
Bottle 55.1

Clarifai
created on 2023-10-13

people 99.8
man 99.3
adult 98.5
portrait 97.5
monochrome 96.9
two 95.7
three 90.4
actor 89.4
sit 89.4
one 89.1
music 88.7
group 87.8
room 87.5
street 82.1
indoors 82
group together 80.4
furniture 80.2
musician 78.1
chair 78
administration 75.8

Imagga
created on 2023-01-24

barbershop 50
man 40.3
senior 39.4
shop 39.2
people 34.6
male 33.5
couple 33.1
elderly 31.6
mercantile establishment 30.3
home 30.3
old 28.6
grandfather 28.5
indoors 24.6
happy 24.4
retired 23.3
person 22.6
smiling 21.7
mature 21.4
family 21.3
lifestyle 21
adult 20.9
place of business 20.3
retirement 20.2
love 18.9
together 18.4
husband 18.1
grandmother 17.6
portrait 17.5
older 16.5
happiness 16.5
sitting 16.3
men 16.3
grandma 16.2
cheerful 15.4
married 15.3
child 14.7
aged 14.5
mother 14.3
wife 14.2
smile 13.5
70s 12.8
pensioner 12
casual 11.9
age 11.4
togetherness 11.3
table 11.3
glasses 11.1
parent 10.7
face 10.7
adults 10.4
establishment 10.2
horizontal 10
holding 9.9
care 9.9
patient 9.8
lady 9.7
interior 9.7
room 9.7
couch 9.7
kin 9.7
looking 9.6
father 9.5
center 9.1
life 8.9
kid 8.9
professional 8.8
restaurant 8.8
two people 8.7
aging 8.6
talking 8.6
relaxed 8.4
health 8.3
camera 8.3
leisure 8.3
inside 8.3
children 8.2
beverage 8.1
cup 8.1
chair 8.1
celebration 8
nurse 7.9
80s 7.9
grandparents 7.9
grandparent 7.9
boy 7.8
their 7.8
daughter 7.8
two 7.6
marriage 7.6
friends 7.5
fun 7.5
active 7.2
handsome 7.1
women 7.1
medical 7.1
day 7.1

Google
created on 2023-01-24

Photograph 94.2
Black-and-white 85.6
Style 84
Tableware 82.9
Table 75.2
Snapshot 74.3
Monochrome 74.2
Monochrome photography 73.7
Room 67.3
Event 66.3
Stock photography 65.3
Sitting 63.5
Recreation 61.4
Conversation 59.8
Fun 57.7
Games 53.8
Plate 53.6
Font 53.4
Street 52.5
Photography 52.1

Microsoft
created on 2023-01-24

text 99.4
person 97.8
human face 97.7
black and white 94.3
man 91.2
clothing 81
monochrome 70.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Fear 82.3%
Calm 35.3%
Surprised 6.3%
Sad 2.2%
Angry 0.1%
Confused 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 84.9%
Surprised 6.4%
Fear 6%
Sad 5.9%
Angry 5%
Confused 1.4%
Disgusted 0.6%
Happy 0.2%

AWS Rekognition

Age 42-50
Gender Female, 99.5%
Calm 98.8%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 0.5%
Confused 0.1%
Disgusted 0%
Angry 0%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Man 99.3%
Adult 99.3%
Male 99.3%
Wristwatch 92.8%
Child 71.9%
Girl 71.9%
Female 71.9%
Plate 65.8%

Categories

Captions

Microsoft
created on 2023-01-24

an old photo of a man 79.7%
a man sitting on a couch 58.2%
old photo of a man 58.1%

Text analysis

Amazon

Sterling
BEER
=
24
FaltsCity
the
the the
Rig
John

Google

AAAAAA MM- Sterling Sterling SKER PALL MALE
AAAAAA
MM
Sterling
SKER
PALL
MALE