Human Generated Data

Title

Union Volunteer Refreshment Saloon

Date

1865

People

Artist: Edward Moran, American 1829 - 1901

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Suzanne and Terrence Murray in honor of President Drew Gilpin Faust, 2018.229

Human Generated Data

Title

Union Volunteer Refreshment Saloon

People

Artist: Edward Moran, American 1829 - 1901

Date

1865

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Suzanne and Terrence Murray in honor of President Drew Gilpin Faust, 2018.229

Machine Generated Data

Tags

Amazon
created on 2019-07-16

Person 99.8
Human 99.8
Person 99.7
Person 99.5
Person 99.5
Person 98.9
Person 98.7
Person 98.7
Person 98.4
Person 97.8
Painting 97.5
Art 97.5
Person 96.6
Person 94.6
Person 90.3
Flag 90.2
Symbol 90.2

Clarifai
created on 2019-07-16

people 99.2
group 97.2
building 97.2
home 96.6
flag 96.1
adult 95.9
house 95.5
architecture 95.4
daylight 93.2
military 92.9
outdoors 92.4
man 91.8
woman 89.7
town 89.3
calamity 89.2
competition 88.6
battle 88.6
war 88.5
landscape 86.1
museum 84.7

Imagga
created on 2019-07-16

building 59.1
architecture 54.6
church 50.9
tourist 40.9
religion 40.4
bell cote 32.8
old 32.8
monastery 31.1
traveler 28.4
temple 28.3
sky 27.5
history 26.9
shelter 26.1
tower 26
travel 25.4
house 23.7
city 23.3
cross 20.8
cathedral 20.6
protective covering 19.8
culture 19.7
ancient 19.1
facade 18.9
stone 18.6
faith 18.2
tourism 18.2
religious residence 18
religious 17.8
wall 17.5
historic 17.4
university 17.4
school 17.3
landmark 17.2
structure 16.9
residence 16.9
monument 16.8
god 16.3
brick 16.2
catholic 15.6
historical 15.1
palace 13.9
capital 13.3
museum 13.1
covering 13.1
person 12.9
chapel 12.8
saint 12.5
famous 12.1
square 11.8
st 11.7
worship 11.6
roof 11.6
medieval 11.5
town 11.1
construction 11.1
traditional 10.8
holy 10.6
place 10.3
exterior 10.2
landscape 9.7
dome 9.7
china 9.4
bell 8.6
art 8.5
clouds 8.5
tile 8.4
window 8.3
vacation 8.2
center 8.2
century 7.8
pray 7.8
arch 7.8
architectural 7.7
sculpture 7.7
outdoor 7.7
statue 7.6
buildings 7.6

Google
created on 2019-07-16

Building 70.7
Flag 69.3
Architecture 65.5
Visual arts 64.9
Illustration 57.7
Painting 54.7
Pole 53.7
Art 50.2

Microsoft
created on 2019-07-16

outdoor 99.7
painting 95.7
people 78.2
old 40.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-68
Gender Female, 54.9%
Calm 45.1%
Angry 52.9%
Disgusted 45.1%
Sad 45.2%
Confused 45.2%
Surprised 45.3%
Happy 46.3%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Sad 50.5%
Calm 49.5%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Angry 49.5%
Surprised 49.5%
Sad 50.5%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Calm 49.5%

AWS Rekognition

Age 29-45
Gender Male, 50.4%
Disgusted 49.7%
Angry 49.6%
Confused 49.5%
Sad 49.7%
Happy 49.8%
Calm 49.7%
Surprised 49.6%

AWS Rekognition

Age 35-52
Gender Male, 50.5%
Sad 49.7%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Calm 50.2%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Angry 49.7%
Sad 49.9%
Happy 49.6%
Calm 49.5%
Confused 49.6%
Disgusted 49.7%
Surprised 49.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Painting 97.5%

Categories

Captions

Azure OpenAI

Created on 2024-01-27

This is a historic oil painting depicting a scene with a red-brick two-story building prominently displaying two signs that read "UNION VOLUNTEER REFRESHMENT SALOON" and "WELCOME TO THE BRAVE VOLUNTEERS". An American flag waves atop a flagpole next to the building. The ground is snow-covered and several individuals in period attire engage near the entrance of the building and in the foreground. A woman holding a basket talks to a man in blue uniform, while other figures, including a few on horseback, appear engaged in conversation or walking towards the building. Bare trees and cloudy skies provide a backdrop to this wintry scene.

Text analysis

Amazon

WELCOME
VOLUNTEERS!
UNION
BRAVE
VOLUNTEER
THE
TO THE BRAVE VOLUNTEERS! CITIZENS
TO
REFR
VOLUNTEER REFR ESHMENT
CITIZENS
ESHMENT
YOU
the
SaLoon

Google

NTEE UNION VOLUNTEEKMESHMENT SALOON WELCOME TO THE BRAVE VOLUNTEERS! YOU COME AT OUR COUNTRY'S GALL THE UNION TO SAVE OR WITH IT FALL! THE CITIZENS OF PHILAOELPHIA Tauite you totheir Hospitality &wish you God Speed on gour marh to t he Union Army of the Capitole BE BRAVE YQUR DEEDS FOR LIBERTY WILLNEVER OIE! We aill print ysar AtMes n GOLD& enshrine your plory navr hearts you hake the pruyers of alt toyat honest hearis for your sutcess m arme-aoape relorn hysar friends cramnedwilA Hanars Clry Atrae col raitors e bets hae namg will e Thccribed fone Chas dowiu the posterily ftie Free m ait Aubake tinti Patist EaMoran si, A
NTEE
UNION
VOLUNTEEKMESHMENT
SALOON
WELCOME
TO
THE
BRAVE
VOLUNTEERS!
YOU
COME
AT
OUR
COUNTRY'S
GALL
SAVE
OR
WITH
IT
FALL!
CITIZENS
OF
PHILAOELPHIA
Tauite
you
totheir
Hospitality
&wish
God
Speed
on
gour
marh
to
t
he
Union
Army
of
the
Capitole
BE
YQUR
DEEDS
FOR
LIBERTY
WILLNEVER
OIE!
We
aill
print
ysar
AtMes
n
GOLD&
enshrine
your
plory
navr
hearts
hake
pruyers
alt
toyat
honest
hearis
for
sutcess
m
arme-aoape
relorn
hysar
friends
cramnedwilA
Hanars
Clry
Atrae
col
raitors
e
bets
hae
namg
will
Thccribed
fone
Chas
dowiu
posterily
ftie
Free
ait
Aubake
tinti
Patist
EaMoran
si,
A