Human Generated Data

Title

Scene at Indian Payment, Odanah, Wisconsin (734)
Date

c. 1866
People

Artist: Whitney & Zimmerman, American active 1860s-70s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.152

Human Generated Data

Title

Scene at Indian Payment, Odanah, Wisconsin (734)

People

Artist: Whitney & Zimmerman, American active 1860s-70s

Date

c. 1866

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 98.7
Human 98.7
Person 97.5
Rowboat 91.6
Boat 91.6
Vehicle 91.6
Transportation 91.6
Person 81
Advertisement 73.9
Person 72.8
Canoe 72.6
Poster 70.7
Art 59.5
Watercraft 55.4
Vessel 55.4
Person 46.8

Imagga
created on 2022-01-22

backboard 55.9
equipment 39.6
device 28.4
barrow 24.5
old 23.7
indicator 22.8
paper 22.7
handcart 19.6
money 17
finance 16.9
business 16.4
currency 16.1
wheeled vehicle 15.4
vintage 14.9
retro 13.9
financial 13.4
close 13.1
ancient 13
aged 11.8
wealth 11.7
bank 11.6
book jacket 11.1
banking 11
cash 11
symbol 10.8
black 10.2
grunge 10.2
dollar 10.2
page 10.2
note 10.1
vehicle 9.8
texture 9.7
antique 9.5
wall 9.4
card 9.3
ventilator 9.2
sundial 9.2
decoration 9.2
new 8.9
newspaper 8.8
textured 8.8
jacket 8.7
brass 8.6
holiday 8.6
exchange 8.6
timepiece 8.6
design 8.4
wood 8.3
investment 8.2
history 8
success 8
detail 8
art 7.8
bills 7.8
travel 7.7
blank 7.7
book 7.7
obsolete 7.7
bill 7.6
ribbon 7.4
closeup 7.4
product 7.4
gold 7.4
brown 7.4
architecture 7
seasonal 7

Google
created on 2022-01-22

Boat 96.3
Photograph 94.2
Boats and boating--Equipment and supplies 91.6
Paddle 91
Outdoor recreation 85.8
Oar 84.6
Vehicle 83.4
Recreation 80.2
Water 79.1
Watercraft rowing 78.2
Waterway 77.9
Watercraft 76.7
Art 75.6
Canoe 72.5
Water transportation 71.4
Vintage clothing 69.6
Skiff 69.3
Visual arts 68.1
Boating 64.7
Painting 64.4

Microsoft
created on 2022-01-22

text 99.9
book 96
person 93.2
clothing 76.8

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Female, 99.8%
Happy 87.1%
Calm 10.5%
Sad 0.8%
Disgusted 0.5%
Angry 0.3%
Confused 0.3%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 27-37
Gender Female, 98.1%
Happy 92.9%
Calm 4.8%
Surprised 0.6%
Angry 0.5%
Sad 0.4%
Fear 0.3%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 19-27
Gender Male, 90.4%
Calm 93.9%
Fear 1.6%
Happy 1.3%
Angry 1%
Confused 0.8%
Surprised 0.6%
Sad 0.5%
Disgusted 0.2%

AWS Rekognition

Age 28-38
Gender Female, 96.9%
Happy 95.6%
Disgusted 1.9%
Angry 1.4%
Calm 0.4%
Sad 0.3%
Surprised 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Female, 100%
Calm 96.6%
Confused 0.8%
Fear 0.7%
Happy 0.6%
Surprised 0.4%
Sad 0.4%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 28-38
Gender Male, 82.3%
Happy 99.5%
Calm 0.1%
Angry 0.1%
Sad 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

an old photo of a book 44.1%
a close up of a book 43.8%

Text analysis

Amazon

Indian
Scene
at
SAINT
LAKE
NORTH
SUPERIOR
WHITNEY
Wis.
Scene at Indian Payment,-Odanah, Wis.
LAKE SUPERIOR SCENERY,
&
SAINT PAUL
SCENERY,
WHITNEY & ZIMMERMAN Photo's
Payment,-Odanah,
PAUL
NORTH SHORE.
Photo's
ZIMMERMAN
SHORE.

Google

Indian Payment,-Odana LAKE SUPERIOR SCENERY, NORTH SHORE. SAINT PAUL. WIHITNEY & ZIMMERMAN, Photo's,
Indian
Payment,-Odana
LAKE
SUPERIOR
SCENERY,
NORTH
SHORE.
SAINT
PAUL.
WIHITNEY
&
ZIMMERMAN,
Photo's,