Human Generated Data

Title

Untitled (men and women conversing in bar with fish mounted on wall)

Date

1947

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7341

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women conversing in bar with fish mounted on wall)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.7
Human 99.7
Person 99.5
Person 99.1
Person 99
Person 98.9
Furniture 96.2
Chair 96.2
Person 95.6
Shop 94
Indoors 92.5
Apparel 80.9
Footwear 80.9
Shoe 80.9
Clothing 80.9
Chair 79.8
Person 71.8
Shoe 71.7
Person 71.6
Bookstore 67.2
Book 67.2
Interior Design 66.8
Room 64.3
Person 61.8
Animal 59.2
Fish 59.2
Restaurant 56.9
Cafeteria 55.2
Person 43.5

Imagga
created on 2022-01-15

cafeteria 47.7
restaurant 36.6
building 35.2
silhouette 24.8
structure 24.5
people 24
business 19.4
person 18.6
shop 18.4
crowd 18.2
room 17
lights 16.7
city 16.6
symbol 15.5
patriotic 15.3
flag 15.3
classroom 14.6
design 14.6
nation 14.2
newspaper 14
event 13.9
cheering 13.7
nighttime 13.7
audience 13.6
stadium 13.6
technology 13.3
modern 12.6
man 12.1
product 12
icon 11.9
mercantile establishment 11.7
architecture 11.7
sport 11.5
comic book 11.4
urban 11.3
player 11.3
shoe shop 10.9
versus 10.8
championship 10.7
financial 10.7
male 10.6
blackboard 10.6
match 10.6
businessman 10.6
skill 10.6
chart 10.5
muscular 10.5
success 10.5
skyline 10.4
athlete 10.4
training 10.2
finance 10.1
competition 10.1
bright 10
creation 9.9
digital 9.7
group 9.7
fight 9.7
dangerous 9.5
art 9.4
park 9.2
black 9
star 9
drawing 8.9
shorts 8.8
vibrant 8.7
diagram 8.6
travel 8.4
field 8.4
sign 8.3
human 8.2
place of business 8.1
graphic 8
light 8
computer 8
night 8
adult 7.9
book jacket 7.9
punch 7.9
work 7.8
education 7.8
scene 7.8
glass 7.8
office 7.8
men 7.7
construction 7.7
graph 7.7
grunge 7.7
musical 7.7
sky 7.6
house 7.5
vivid 7.4
glowing 7.4
music 7.2

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 100
person 86.9
cartoon 83.1
clothing 74.1

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 75.2%
Happy 39.7%
Sad 34.6%
Calm 16.9%
Fear 4.2%
Confused 2.2%
Angry 1%
Disgusted 0.8%
Surprised 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.7%
Chair 96.2%
Shoe 80.9%
Fish 59.2%

Captions

Microsoft

a group of people in a store 62.8%
a group of people sitting in front of a store 56.8%
a group of people riding on the back of a store 41.2%

Text analysis

Amazon

KEY,
SIESTA
DRINK
STEINMETZ,
J.
23248
SARASOTA,
the
J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA
18
FLA
Shortest BARV the Vallest DRINK
842EZ
Vallest
BARV
Shortest

Google

FLA:
KODVK-VEEIA
KEY,
J.
SIESTA
SARASOTA,
23248 J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA: KODVK-VEEIA
23248
STEINMETZ,