Human Generated Data

Title

Untitled (two men in gold miner costume for Alaskan gold rush, fake beards, dogsled and dog at New Year's party)

Date

1952

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9423

Human Generated Data

Title

Untitled (two men in gold miner costume for Alaskan gold rush, fake beards, dogsled and dog at New Year's party)

People

Artist: Martin Schweig, American 20th century

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.1
Person 99.1
Pet 97.5
Mammal 97.5
Animal 97.5
Canine 97.5
Dog 97.5
Person 96.9
Person 95.2
Person 94.9
Person 91.3
Art 86.7
Painting 82.4
Clothing 79.3
Apparel 79.3
Drawing 76.3
Person 75.9
Person 74.7
Person 74.6
People 64.6
Sketch 61
Nature 60.6
Leisure Activities 60.4
Plant 60.2
Flower 60.2
Blossom 60.2

Imagga
created on 2022-01-23

musical instrument 34.5
man 24.2
people 20.1
bowed stringed instrument 18.3
kin 17.5
person 17.4
stringed instrument 17.1
wind instrument 17.1
male 16.3
adult 15.2
women 13.4
city 13.3
black 13.2
urban 13.1
portrait 12.3
group 12.1
style 11.9
old 11.8
accordion 11.8
dark 11.7
hand 10.6
violin 10.6
keyboard instrument 10.3
business 10.3
men 10.3
teacher 10
sexy 9.6
window 9.3
trombone 9.2
street 9.2
brass 9.2
indoor 9.1
fashion 9
dirty 9
dress 9
holiday 8.6
youth 8.5
vintage 8.3
human 8.2
music 8.2
happy 8.1
room 8
interior 8
businessman 7.9
day 7.8
head 7.5
professional 7.5
smoke 7.4
cello 7.4
sax 7.4
musician 7.3
art 7.3
drawing 7.3
suit 7.2
percussion instrument 7.2
work 7.1
hair 7.1
face 7.1
working 7.1
modern 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 98.6
person 96.9
clothing 94.9
man 89.1
drawing 76
musical instrument 67.2
black and white 64.7
sketch 63.1
concert 52.2

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 51.8%
Calm 98.8%
Surprised 0.2%
Sad 0.2%
Disgusted 0.2%
Fear 0.2%
Angry 0.2%
Happy 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Dog 97.5%
Painting 82.4%

Captions

Microsoft

a group of people posing for a photo 79.8%
a group of people posing for the camera 79.7%
a group of people standing in front of a store 71.1%

Text analysis

Amazon

BY
98
LONDYKE
1
BOD
to 1
to
KODAK-SLA

Google

LOND
BY
YT37A2-XAGO
00 A LOND KE BY 98 YT37A2-XAGO
00
98
A
KE