Human Generated Data

Title

Untitled (two children in overalls)
Date

c. 1930
People

Artist: Curtis Studio, American active 1891 - 1935
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1247

Human Generated Data

Title

Untitled (two children in overalls)

People

Artist: Curtis Studio, American active 1891 - 1935

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.9
Clothing 99.9
Human 95.3
Person 95.3
Person 95.2
Art 93.2
Hat 91.4
Painting 87
Hat 69.3
Sun Hat 63.3
Bonnet 59.8
Person 48.8

Imagga
created on 2022-01-23

statue 48.7
sculpture 41.8
art 27.8
old 26.5
monument 25.2
history 22.3
ancient 21.6
religion 21.5
architecture 21.1
catholic 19.4
historical 18.8
antique 18.8
stone 18.5
hat 17.9
church 17.6
culture 16.2
religious 15.9
clothing 15.8
marble 15.8
city 15
tourism 14.8
historic 14.7
god 14.3
private 13.8
building 13.5
saint 13.5
faith 13.4
vintage 13.2
detail 12.9
figure 12.8
military uniform 12.7
travel 12
landmark 11.7
holy 11.6
man 11.5
face 11.4
famous 11.2
decoration 11.1
uniform 10.7
spirituality 10.6
symbol 10.1
people 10
roman 9.9
helmet 9.7
person 9.7
portrait 9.7
museum 9.7
artistic 9.6
headdress 9.5
dress 9
fountain 9
carving 8.9
style 8.9
covering 8.7
spiritual 8.6
cathedral 8.6
traditional 8.3
cowboy hat 8.3
consumer goods 8.2
tourist 8.2
statues 7.9
costume 7.8
golden 7.7
black 7.5
lady 7.3

Google
created on 2022-01-23

Hat 87.4
Art 84.1
Sleeve 82.9
Painting 82.8
Vintage clothing 74
Illustration 73.4
Drawing 72
Sun hat 70.2
Visual arts 70
Uniform 67.1
Fashion design 64.1
Victorian fashion 61.8
Formal wear 58.2
Costume hat 57.5
Child 56.1
Cowboy hat 55.6
Portrait 54.7
Paint 53.2
Retro style 52.9
Sketch 52.5

Microsoft
created on 2022-01-23

building 99.1
hat 97.8
human face 95.1
drawing 93.9
old 93.1
clothing 91.4
sketch 90.9
painting 89.9
person 87.5
fashion accessory 80.7
black 74.4
text 69.4
fedora 67.9
cowboy hat 62.9
sun hat 62.1
stone 60.7
sculpture 55.9
posing 49
dressed 35
building material 33.5
clothes 26.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 81.2%
Calm 35.6%
Fear 24.4%
Surprised 14.3%
Confused 10.8%
Sad 9.8%
Angry 2.1%
Disgusted 1.7%
Happy 1.2%

AWS Rekognition

Age 6-14
Gender Male, 92.2%
Calm 49.8%
Confused 18%
Fear 13%
Surprised 6.8%
Angry 5.3%
Sad 4%
Disgusted 1.8%
Happy 1.2%

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.3%
Hat 91.4%
Painting 87%

Captions

Microsoft

a statue of a man and woman posing for a photo 54.5%
a statue of a man and a woman posing for a photo 54.4%
a person standing in front of a statue 54.3%