Human Generated Data

Title

Untitled (two couples sitting at restaurant counter, waiter and waitress standing behind counter)
Date

c. 1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4565
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two couples sitting at restaurant counter, waiter and waitress standing behind counter)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4565

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.7
Human 99.7
Person 99.6
Person 99.6
Person 99.5
Person 99.4
Clothing 93.7
Apparel 93.7
Person 90.8
Restaurant 88
Cafeteria 80.1
Sitting 76.3
Shorts 73.3
Text 63
Furniture 60.4
Cafe 59.6
Advertisement 57.1
Poster 56.1

Clarifai
created on 2023-10-15

people 99.9
monochrome 99.4
adult 99.1
man 97.4
woman 96.5
group together 95.6
group 90.6
wear 90.4
child 89.9
several 88.9
street 86.9
coverage 86.7
indoors 82.7
many 80.8
four 80.1
sit 79.9
side view 78.4
furniture 77.2
barber 76
three 74.8

Imagga
created on 2021-12-14

man 34.2
people 31.2
male 31.2
person 27.5
men 23.2
adult 19.7
room 16.5
smiling 15.2
happy 15
outdoors 14.2
sport 13.9
active 13.6
playing 12.8
patient 12.6
professional 12.4
holding 12.4
businessman 12.3
together 12.3
couple 12.2
senior 12.2
lifestyle 11.6
family 11.6
black 11.4
human 11.2
mature 11.1
portrait 11
business 10.9
exercise 10.9
teacher 10.5
group 10.5
boy 10.4
standing 10.4
sitting 10.3
work 10.3
wheelchair 10.3
love 10.2
chair 10.2
day 10.2
smile 10
sports equipment 9.9
office 9.8
old 9.7
summer 9.6
hands 9.5
happiness 9.4
two 9.3
teenager 9.1
health 9
fun 9
player 8.9
medical 8.8
looking 8.8
mother 8.7
retired 8.7
retirement 8.6
athlete 8.6
play 8.6
relaxed 8.4
teamwork 8.3
leisure 8.3
care 8.2
ball 8.2
clinic 8.1
father 8.1
handsome 8
life 8
brass 8
job 8
pensioner 7.9
women 7.9
building 7.8
nurse 7.8
motion 7.7
outside 7.7
son 7.6
hospital 7.6
hand 7.6
beach 7.6
equipment 7.5
back 7.3
new 7.3
wind instrument 7.2
home 7.2
team 7.2
child 7.1
cool 7.1
indoors 7
sky 7
modern 7

Google
created on 2021-12-14

Photograph 94.2
Black-and-white 85.4
Style 84
Monochrome 76.1
Monochrome photography 74.9
Snapshot 74.3
Room 67.4
Chair 67.2
Stock photography 65.4
Sitting 65.4
Font 65.3
Conversation 65
Motor vehicle 63.4
Art 61.3
History 60.9
Photo caption 60.6
Vintage clothing 57.1
Street 56.1
Suit 56.1
Photography 52.1

Microsoft
created on 2021-12-14

text 99.5
person 97.4
outdoor 95
clothing 94.8
man 85.9
woman 79.1
black and white 77
footwear 71.3
street 60.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-35
Gender Female, 56.9%
Happy 88.8%
Calm 9.7%
Sad 0.8%
Angry 0.3%
Surprised 0.2%
Confused 0.2%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 50-68
Gender Female, 96.1%
Sad 75.5%
Calm 23.5%
Happy 0.4%
Confused 0.4%
Angry 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 28-44
Gender Female, 61.7%
Calm 90.6%
Happy 5.3%
Sad 2.1%
Angry 1%
Confused 0.5%
Surprised 0.4%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 26-42
Gender Female, 62.1%
Calm 53.9%
Sad 32.6%
Happy 9.4%
Angry 1.2%
Disgusted 0.9%
Fear 0.9%
Surprised 0.7%
Confused 0.4%

AWS Rekognition

Age 39-57
Gender Male, 50.8%
Calm 73.1%
Surprised 20.3%
Fear 3.7%
Confused 1%
Sad 1%
Happy 0.6%
Angry 0.3%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

people portraits 93.4%
paintings art 3.4%

Text analysis

Amazon

SOUPS
COFFEE
JUICE
TOMATO JUICE
TOMATO
HEINZ SOUPS
HEINZ
VANILLA
BUTTER
CHOCOLATE
STRAWBERRY
BUTTER PECAN
PECAN
CREAM
Hot
ORANGE
RASPBERRY
119304.
CHICKEN
PEA
2
119304
COUNTRY
MOSHROOM
of
I
CREAM a MOSHROOM
ORANGE ICE
SF
TURTLE
CREAM OF
COUNTRY shut CHICKEN
VANILLA FUDGE
or
SEAN
Piping - Hot
CHERRY
VEGETABLE
OF
-
Paping la Hot 2 -
ICE
TV
RASPBERRY CE
VEGETABLE GLAM GEMUNE CREAM CHOWGER . TURTLE MOODLE PEA
a
Piping
FUDGE
CHERRY VEMELLA
VEGETABLE RASHIONED SEAN
2 -
.
Paping
LARGE
Baul
LARGE BOWL 15
. TOMATO ADAM I
BOWL 15
GRONDER
RECREAM
GEMUNE
GLAM
shut
CHOWGER
States CREAM of STYLE KUPIKOOM CHICKEN
VEMELLA
III
CLAIM
STYLE
ADAM
!!
faze Baul
DENUINE
III VEGETARIA CREAM CHOCOLATE DENUME CAR GRONDER or TURIS ... !!
CE
CHOWEAR
VEGETARIA
...
la
CHEAMOO DENUINE TURTIF
RASHIONED
Marchulter
ADODLE
CAR
KUPIKOOM
faze
MOODLE
TURIS
TURTIF
States
CHEAMOO
DAB
DENUME

Google

I19304. VANILLA FUOGI BUTTER PECAN VANILLA CHOCOLATE STRAWBERRY ORANGE ICE CHIRRY VANILLA RASPBERET ICE COFFEE HEINZ SOUPS HEINZ HEINZ SOUPS HEINZ TOMATO JUICE Hot ARGE BOWL 15 CREAM OF MOSHROOM O R MAN VEGETAALE Er CLAM CHO u GEME TUR I304 19364.
I19304.
VANILLA
FUOGI
BUTTER
PECAN
CHOCOLATE
ICE
RASPBERET
COFFEE
HEINZ
TOMATO
JUICE
Hot
ARGE
BOWL
15
CREAM
OF
MOSHROOM
O
R
MAN
Er
CHO
GEME
TUR
I304
STRAWBERRY
ORANGE
CHIRRY
SOUPS
VEGETAALE
CLAM
u
19364.