Human Generated Data

Title

Untitled (girl posed sitting at piano surrounded by flowers)
Date

1937
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10190

Human Generated Data

Title

Untitled (girl posed sitting at piano surrounded by flowers)

People

Artist: Martin Schweig, American 20th century

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Plant 99.9
Flower 99.5
Blossom 99.5
Human 99.4
Person 99.1
Flower Bouquet 99.1
Flower Arrangement 99.1
Funeral 97
Rose 79.4
Floral Design 62.9
Art 62.9
Graphics 62.9
Pattern 62.9
Painting 60.2
Clothing 59.9
Apparel 59.9

Imagga
created on 2022-01-22

groom 54.7
bouquet 38.7
flowers 36.5
couple 31.4
bride 28.4
person 27.6
wedding 26.7
happiness 25.1
happy 24.4
people 24
flower 24
blackboard 23.2
love 20.5
man 20.2
adult 20
male 18.4
smiling 18.1
marriage 18
fan 17.5
home 16.7
two 16.1
outdoors 15.7
teacher 15.5
dress 14.5
married 14.4
follower 14.1
senior 14.1
portrait 13.6
women 13.4
family 13.3
cheerful 13
romance 12.5
wife 12.3
plant 12.1
arrangement 11.9
decoration 11.9
old 11.8
day 11.8
garden 11.7
gardening 11.4
men 11.2
mature 11.2
flower arrangement 11.1
rose 10.7
new 10.5
husband 10.5
summer 10.3
smile 10
gown 9.9
matrimony 9.8
wed 9.8
cemetery 9.7
educator 9.6
celebration 9.6
table 9.5
hobby 9.5
floral 9.4
future 9.3
pretty 9.1
handsome 8.9
romantic 8.9
together 8.8
bridal 8.8
life 8.7
hands 8.7
elderly 8.6
sitting 8.6
pair 8.5
attractive 8.4
joy 8.4
plants 8.3
camera 8.3
suit 8.1
world 7.9
wedded 7.9
newly 7.9
ceremony 7.8
human 7.5
holding 7.4
lifestyle 7.2

Google
created on 2022-01-22

Flower 98.1
Plant 97
Black 89.6
Botany 88.8
Petal 88
Art 81.2
Flower Arranging 80.5
Bouquet 77.8
Painting 76.7
Vintage clothing 76.1
Rose 75.9
Tree 75.5
Font 74.4
Snapshot 74.3
Room 71.8
Illustration 70.2
Floral design 70.1
Classic 70.1
Monochrome 69.4
Event 68.7

Microsoft
created on 2022-01-22

text 99.1
flower 98.1
person 92.3
white 87.9
clothing 87
black 85
posing 78.9
woman 71
wedding dress 67.4
old 51.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-22
Gender Female, 100%
Happy 95.6%
Calm 1.4%
Surprised 0.8%
Angry 0.6%
Confused 0.6%
Fear 0.4%
Disgusted 0.3%
Sad 0.2%

Microsoft Cognitive Services

Age 12
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 60.2%

Captions

Microsoft

a group of people posing for a photo 90.4%
a group of people posing for a picture 90.3%
a group of people posing for the camera 90%

Text analysis

Amazon

PROOF
SAINT
SAINT LOUIS
LOUIS
MARTIN
MARTIN SCHWEIG
SCHWEIG

Google

PROOF MARTIN SCHWEIG SAINT LÓUIS
PROOF
MARTIN
SCHWEIG
SAINT
LÓUIS