Human Generated Data

Title

Untitled (boy with book)
Date

c. 1925
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.730

Human Generated Data

Title

Untitled (boy with book)

People

Artist: Martin Schweig, American 20th century

Date

c. 1925

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 96.2
Clothing 95.1
Apparel 95.1
Shoe 92.1
Footwear 92.1
Person 91.9
Furniture 89.4
Suit 88.7
Overcoat 88.7
Coat 88.7
Shelf 87.8
Door 76.6
Shoe 67.9
Flooring 60.9
Bookcase 60.4
Officer 59.1
Military 59.1
Military Uniform 59.1
Performer 56
Man 55.6

Imagga
created on 2022-01-08

military uniform 94.8
uniform 74.7
clothing 56.8
covering 39.2
consumer goods 39.1
commodity 18.3
man 17.5
people 17.3
city 15.8
statue 15.6
old 15.3
architecture 14.9
person 14.8
adult 13
male 12.9
building 12.7
sculpture 11.5
historical 11.3
portrait 11
tourism 10.7
boy 10.4
standing 10.4
monument 10.3
historic 10.1
vintage 9.9
travel 9.9
fashion 9.8
urban 9.6
kin 9.5
black 9.2
street 9.2
dark 9.2
attractive 9.1
posing 8.9
ancient 8.6
child 8.5
happy 8.1
dress 8.1
family 8
business 7.9
sepia 7.8
suit 7.7
world 7.6
stone 7.6
human 7.5
holding 7.4
style 7.4
lady 7.3
lifestyle 7.2
sexy 7.2
landmark 7.2
body 7.2
history 7.2
women 7.1
face 7.1

Google
created on 2022-01-08

Standing 86.4
Style 83.8
Tints and shades 77.3
Vintage clothing 76.6
Art 76.6
Monochrome 74.5
Building 73.1
Bookcase 73.1
Fashion design 72.9
Monochrome photography 71.9
Shelf 69.1
Door 67.8
Picture frame 67.5
Curtain 66.9
Wood 66.4
Visual arts 65.7
Room 65.5
White-collar worker 62.7
Stock photography 61.7
Formal wear 60.7

Microsoft
created on 2022-01-08

text 99.9
clothing 98.8
suit 94.9
man 92.2
standing 91.8
indoor 89.4
person 89.2
coat 82
posing 70.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Male, 100%
Calm 99.7%
Confused 0.1%
Surprised 0.1%
Happy 0%
Angry 0%
Disgusted 0%
Sad 0%
Fear 0%

Microsoft Cognitive Services

Age 20
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 92.1%
Person 91.9%
Suit 88.7%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 64.7%
a person standing posing for the camera 64.6%
a man that is standing in front of a mirror posing for the camera 52.8%

Text analysis

Amazon

SCHWEIG

Google

SCHWEIG
SCHWEIG