Human Generated Data

Title

Untitled (three bar tenders behind the bar)
Date

1947
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7350
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (three bar tenders behind the bar)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7350

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.7
Human 99.7
Person 99.7
Person 99.6
Interior Design 99.5
Indoors 99.5
Person 97.5
Crowd 84.4
Person 74
Leisure Activities 70.9
Musician 63
Musical Instrument 63
Person 62
Building 60.7
Pub 60
Bar Counter 57.6
Room 57.6
Studio 57.4
Music Band 55.7

Clarifai
created on 2023-10-26

people 99.9
group together 99.2
group 99
adult 98.8
monochrome 98.7
man 98.4
woman 96.7
furniture 94.7
administration 92
many 89.8
sit 89.1
street 87.6
music 87.6
restaurant 87
recreation 86.6
indoors 85.6
several 83.8
two 80.9
three 80.3
vehicle 80.2

Imagga
created on 2022-01-15

blackboard 47.7
people 29
shop 28.4
man 28.2
classroom 27.1
person 24.8
student 24.7
male 24.1
education 23.4
mercantile establishment 22.5
school 19.7
teacher 19.4
class 18.3
counter 17.9
business 17.6
bartender 17.4
adult 17.3
businessman 16.8
happy 16.3
place of business 14.9
board 14.8
toyshop 14.7
smiling 13.7
room 13.6
teaching 13.6
portrait 13.6
group 12.9
barbershop 12.7
desk 12.5
chart 12.4
study 12.1
success 12.1
work 11.8
diagram 11.5
black 11.4
human 11.2
men 11.2
office 11.1
team 10.7
hand 10.6
modern 10.5
old 10.4
chalkboard 9.8
financial 9.8
teach 9.7
looking 9.6
college 9.5
smile 9.3
case 9.2
occupation 9.2
technology 8.9
job 8.8
lesson 8.8
boy 8.7
graph 8.6
studying 8.6
drawing 8.6
finance 8.4
senior 8.4
child 8.3
sign 8.3
indoor 8.2
lady 8.1
computer 8
table 8
women 7.9
design 7.9
couple 7.8
educate 7.8
standing 7.8
professional 7.8
knowledge 7.7
university 7.6
building 7.6
casual 7.6
two 7.6
learn 7.5
smart 7.5
silhouette 7.4
teamwork 7.4
back 7.3
establishment 7.2
lifestyle 7.2
market 7.1
to 7.1

Google
created on 2022-01-15

Photograph 94.2
White 92.2
Black 89.5
Black-and-white 85.3
Style 84
Music 78.2
Monochrome 76.6
Monochrome photography 76.2
Suit 75.7
Snapshot 74.3
T-shirt 74.2
Fast food 70.9
Billboard 70
Font 69.6
Room 67
Machine 65.5
Stock photography 63.2
Cooking 61.9
Advertising 61.2
Hat 58.1

Microsoft
created on 2022-01-15

text 100
person 98
clothing 92.3
man 89.7
concert 84.1
musical instrument 80.6
black and white 75.3
guitar 71.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 99.5%
Happy 47.4%
Surprised 26.4%
Calm 15.7%
Confused 6.4%
Sad 1.9%
Angry 0.9%
Disgusted 0.8%
Fear 0.4%

AWS Rekognition

Age 40-48
Gender Male, 98.2%
Happy 82.6%
Calm 6.5%
Sad 5.6%
Confused 1.6%
Angry 1.6%
Surprised 1.2%
Disgusted 0.6%
Fear 0.3%

AWS Rekognition

Age 40-48
Gender Male, 87.1%
Happy 95.5%
Calm 2.1%
Sad 0.7%
Surprised 0.7%
Confused 0.5%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Calm 55.2%
Sad 27.7%
Confused 13.5%
Surprised 1.4%
Disgusted 1%
Fear 0.5%
Angry 0.4%
Happy 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

text visuals 92.9%
streetview architecture 3.5%
paintings art 1.6%

Captions

Microsoft

text 22.1%

Text analysis

Amazon

KEY,
IMPERIAL
SIESTA
23175
J.
SARASOTA,
bottle
Masterpiece
THE
THE MANAGEMENT
MANAGEMENT
Blended
and
MADE
in
SCHENLEY
CREMI
skill
J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLAS
SPECIAL
BIG
Blended Whiskey
STEINMETZ,
REASONS
GREAT
SPECIAL TODAY
FOR
Whiskey
THREE
NLEY
THREE FEATHERS
TODAY
FEATHERS
experience
50
make
skill and 80 years experience
Walkers
Patience
Hiram Walkers
FLAS
de
80
Masterpiece in a bottle
GREAT FOR 2 BIG REASONS
Hiram
years
dweiser
RIGHT
MADE ESEMIES
-
a
RESERVESDE RIGHT
Lichelee de -
SLIEZ
GREAT FOR 2 BIE REASONS
THREE TEACHERS
2
make IMPERIAL manterpiece of Handing
SODA
RESERVESDE
MANHATIAN
SCOTOH the SODA
FESTMENT
SCOTOH
the
Our
Prink
FESTMENT MISITA
For
ESEMIES
TEACHERS
Zecheted For smootheres
MISITA
Our NATIONED
smootheres
Zecheted
You
peeked
of Handing
You Mother
manterpiece
TRENK
Rewer peeked
NATIONED
WITH
Mother
GREAT FOR 2 BIE
BO WITH
Rewer
Lichelee
BO
10000096

Google

FOR
2
BIG
REASONS
Reer
ecete
ke
FLATHERS
INPERIAL
2E
SPECIAL
in
skill
make
IMPERIALa
metpiece
ol
lending
OLD
OD
d
80
years
experience
NLEY
FEATERS
SCHENLEY
W
EY
SOR
Drink
adweiser
(REMT
KIDE
ENENVES
RTASHIRENK
THE
MANAGEMENT
RESERVES
E
RIGHT
TO
RFLSE
MHE
AS
DESIRED
STEINMETZ,
KEY,
FLA:
23175
MPERIAL IMPERIAL GREAT FOR 2 BIG REASONS Reer ecete ke Zeeted f er Hiram Watkers Blended Whiskey THRIE FLATHERS IMPERIAL INPERIAL REAT 2E PAR SPECIAL TODAT THREE HEAHERS Masterpiece in a bottle MANHATA Patience skill an make IMPERIALa metpiece ol lending OLD OD d 80 years experience NLEY FEATERS SCHENLEY W EY SOR Drink adweiser (REMT KIDE ENENVES RTASHIRENK THE MANAGEMENT RESERVES E RIGHT TO RFLSE MHE AS DESIRED J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA: 23175
MPERIAL
IMPERIAL
GREAT
Zeeted
f
er
Hiram
Watkers
Blended
Whiskey
THRIE
REAT
PAR
TODAT
THREE
HEAHERS
Masterpiece
a
bottle
MANHATA
Patience
an
J.
SIESTA
SARASOTA,