Human Generated Data

Title

Untitled (woman with large hat)
Date

c. 1910
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.695

Human Generated Data

Title

Untitled (woman with large hat)

People

Artist: Martin Schweig, American 20th century

Date

c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 100
Apparel 100
Hat 99.9
Person 99.2
Human 99.2
Sun Hat 89.4
Sombrero 76.1

Imagga
created on 2022-01-08

sombrero 100
hat 100
headdress 100
clothing 78.3
consumer goods 38.9
covering 38.6
portrait 27.2
fashion 25.6
model 24.1
sexy 23.3
person 23
hair 23
pretty 21.7
people 21.2
attractive 21
adult 20.7
cowboy 20.6
face 18.5
smile 17.8
dress 16.3
posing 16
black 15.6
lady 15.4
happy 15
kid 14.2
child 14.2
boy 13.9
sensual 13.6
western 13.6
human 13.5
male 13.5
style 13.4
lifestyle 13
cute 12.9
expression 12.8
man 12.8
skin 12.7
smiling 12.3
gorgeous 11.8
brunette 11.3
fun 11.2
old 11.2
straw 10.6
one 10.5
outdoors 10.5
shirt 10.3
children 10
sensuality 10
pose 10
blond 9.9
handsome 9.8
body 9.6
eyes 9.5
senior 9.4
head 9.2
hand 9.1
make 9.1
brown 8.8
looking 8.8
love 8.7
mystery 8.6
play 8.6
seductive 8.6
casual 8.5
beach 8.4
joy 8.4
studio 8.4
guy 8.3
interior 8
look 7.9
season 7.8
mysterious 7.8
costume 7.7
sitting 7.7
outside 7.7
married 7.7
serious 7.6
wearing 7.6
dark 7.5
vintage 7.4
long 7.3
holiday 7.2
romantic 7.1
women 7.1
happiness 7.1

Google
created on 2022-01-08

Hat 94.3
Sun hat 88.1
Flash photography 84.9
Tints and shades 76.9
Art 76.5
Beauty 74.8
Fashion design 73.1
Vintage clothing 72.8
Fashion accessory 66.8
Necklace 64.8
Visual arts 63.7
Stock photography 61.8
Monochrome photography 60.1
Victorian fashion 58.7
Monochrome 58.6
Sitting 55.6
Portrait photography 55.3
Retro style 54.8
Portrait 54.2
Room 53.4

Microsoft
created on 2022-01-08

fashion accessory 98.5
clothing 98.4
human face 97.7
person 97.5
wall 96.4
indoor 96.2
hat 93.3
text 91
woman 83.6
dress 79.8
girl 57.4
smile 51.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Female, 100%
Calm 99.8%
Confused 0.1%
Sad 0.1%
Surprised 0%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 31
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.9%
Person 99.2%

Captions

Microsoft

a person wearing a hat 62.9%
a person wearing a dress 62.8%
a person wearing a dress and a hat 60.6%