Human Generated Data

Title

Untitled (portrait of a boy and girl)
Date

c. 1945
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1440

Human Generated Data

Title

Untitled (portrait of a boy and girl)

People

Artist: Martin Schweig, American 20th century

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.8
Apparel 99.8
Person 99.8
Human 99.8
Female 99.5
Person 96.2
Skirt 93.8
Woman 92
Dress 89.2
Girl 86.1
Shoe 80.3
Footwear 80.3
Shoe 71.7
Blonde 63.4
Kid 63.4
Teen 63.4
Child 63.4
Portrait 60
Photography 60
Face 60
Photo 60
Shorts 56.6

Imagga
created on 2022-01-22

bride 48.1
wedding 42.3
groom 41.8
dress 40.7
married 37.4
love 36.3
couple 33.1
happiness 32.9
bouquet 30.2
people 29.6
kin 28.8
portrait 24.6
fashion 24.1
marriage 22.8
happy 22.6
person 22.2
adult 22
gown 20.5
bridal 20.4
veil 18.6
model 17.9
human 17.2
wed 16.7
face 16.3
man 16.2
attractive 16.1
two 16.1
flowers 15.6
romance 15.2
wife 15.2
romantic 15.1
world 15
sexy 14.5
celebration 14.4
together 14
flower 13.8
smiling 13.7
male 13.6
smile 13.5
husband 12.9
hair 12.7
style 12.6
clothing 12.6
elegance 12.6
lifestyle 12.3
cheerful 12.2
studio 12.2
pretty 11.9
women 11.9
matrimony 11.8
joy 11.7
engagement 11.6
summer 11.6
ceremony 10.7
hand 10.6
day 10.2
gorgeous 10
old 9.8
life 9.5
party 9.5
youth 9.4
clothes 9.4
child 9.3
black 9.2
outdoor 9.2
holding 9.1
pose 9.1
outdoors 9
posing 8.9
art 8.9
commitment 8.9
mother 8.7
blond 8.6
holiday 8.6
expression 8.5
pair 8.5
passion 8.5
future 8.4
church 8.3
joyful 8.3
park 8.2
girls 8.2
sensuality 8.2
family 8
body 8
newly 7.9
cute 7.9
statue 7.8
formal 7.6
loving 7.6
skin 7.6
fun 7.5
traditional 7.5
suit 7.4
lady 7.3
new 7.3
looking 7.2
sibling 7.2
costume 7

Google
created on 2022-01-22

Sleeve 87.2
Gesture 85.3
Dress 83.7
One-piece garment 75.7
Tints and shades 74.9
Classic 74.8
Vintage clothing 68.9
Event 68.7
Monochrome photography 67.3
Pattern 65.3
Monochrome 64
Stock photography 62
Fashion design 58.6
Room 58.6
Portrait 54.9
History 54.4
Photographic paper 52.2
A-line 51.7
Visual arts 51.5
Sibling 51.4

Microsoft
created on 2022-01-22

posing 99.3
standing 98.5
dress 98.3
clothing 97.7
racket 97.7
wall 95.5
text 93.2
person 91.6
smile 88.7
black 87.9
footwear 79.2
woman 78.4
player 76.6
vintage clothing 72.2
human face 69.9
old 66
white 62.6
retro style 57
dressed 26.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 99.2%
Happy 72.6%
Calm 24.1%
Confused 0.8%
Disgusted 0.7%
Surprised 0.6%
Sad 0.6%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 4-10
Gender Female, 70.4%
Happy 95.9%
Confused 1%
Calm 0.9%
Surprised 0.6%
Angry 0.6%
Disgusted 0.4%
Fear 0.4%
Sad 0.2%

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 11
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 80.3%

Captions

Microsoft

a man and a woman posing for a photo 89%
a man and woman posing for a photo 86.1%
a vintage photo of a person standing in front of a building 86%