Human Generated Data

Title

Untitled (boy in cowboy outfit)

Date

1949

People

Artist: Harry Annas, American 1897 - 1980

Artist: Marjorie Mae Iliff Annas, American 1912 - 1991

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.757.1

Human Generated Data

Title

Untitled (boy in cowboy outfit)

People

Artist: Harry Annas, American 1897 - 1980

Artist: Marjorie Mae Iliff Annas, American 1912 - 1991

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Clothing 100
Apparel 100
Sun Hat 93.4
Person 93.1
Human 93.1
Cowboy Hat 92.7
Footwear 86.2
Pants 80.4
Boot 79.7
Shoe 74.9
Hat 64.3

Imagga
created on 2022-05-28

hat 100
headdress 100
sombrero 99.3
cowboy hat 98
clothing 81.5
consumer goods 39.1
covering 38.9
person 27.7
portrait 27.2
people 26.8
cowboy 24.7
smile 24.2
child 23.3
happy 22.6
kid 21.3
face 19.9
smiling 19.5
male 19.2
cute 18.7
hair 18.2
western 17.4
fashion 16.6
boy 16.5
man 16.1
adult 15.5
fun 15
shirt 14.9
outdoors 14.2
happiness 14.1
model 14
attractive 14
pretty 13.3
lifestyle 13
sexy 12.9
expression 12.8
children 12.8
handsome 12.5
cheerful 12.2
playing 11.9
childhood 11.6
straw 11.6
summer 11.6
little 11.5
holiday 11.5
human 11.3
looking 11.2
guy 11
casual 11
cowgirl 10.9
leisure 10.8
costume 10.5
one 10.5
eyes 10.3
outside 10.3
joy 10
blond 9.9
vacation 9.8
lady 9.7
country 9.7
look 9.6
black 9.6
play 9.5
two 9.3
field 9.2
outdoor 9.2
posing 8.9
together 8.8
jeans 8.6
wearing 8.6
horse 8.5
travel 8.5
beach 8.4
hand 8.4
style 8.2
gorgeous 8.2
old 7.7
youth 7.7
enjoy 7.5
girls 7.3
pose 7.3
dress 7.2
farm 7.1
worker 7.1
work 7.1

Google
created on 2022-05-28

Tartan 91.6
Dress shirt 88.8
Hat 88.8
Sleeve 87.2
Gesture 85.3
Collar 83.5
People in nature 82.8
Plaid 81.8
Wood 81.3
Headgear 81.2
Sun hat 80.9
Waist 79
People 78.5
Denim 76.1
Cowboy hat 73.6
Pattern 72.1
Vintage clothing 71.6
Grass 69.9
Happy 67.9
Toy 64.8

Microsoft
created on 2022-05-28

toddler 99
person 97.2
clothing 97.2
boy 95.5
hat 94.6
human face 92.9
fashion accessory 88.3
baby 85.6
sun hat 80.8
text 78.8
child 78.1
cowboy hat 52.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-6
Gender Male, 98.8%
Calm 70%
Angry 16.4%
Sad 9.5%
Surprised 6.4%
Fear 6%
Confused 1.4%
Disgusted 0.3%
Happy 0.3%

Microsoft Cognitive Services

Age 3
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 93.1%
Shoe 74.9%
Hat 64.3%

Captions

Microsoft

a young boy wearing a hat 62.9%
a little boy wearing a hat 60.3%
a small boy wearing a hat 57.4%

Text analysis

Amazon

Manas

Google

2 Annas 49
2
Annas
49