Human Generated Data

Title

Untitled (children playing cowboy in bedroom)
Date

February 1953, printed later
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.170

Human Generated Data

Title

Untitled (children playing cowboy in bedroom)

People

Artist: Lucian and Mary Brown, American

Date

February 1953, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.5
Clothing 99.5
Human 99.1
Person 99.1
Person 97.3
Furniture 80.4
Hat 73.2
Bonnet 68.6
Shorts 65.6
Advertisement 65.2
Room 62.9
Living Room 62.9
Indoors 62.9
Poster 62.4
Sitting 61
Girl 60.8
Female 60.8
Bed 58.2
Shelf 58.1
Couch 57.1
Bedroom 56.6
Kid 56
Child 56

Imagga
created on 2022-01-23

home appliance 41.6
appliance 35.1
adult 29.8
person 25.2
home 23.1
pretty 23.1
iron 22
durables 21.9
device 20.4
people 20.1
sewing machine 19.4
smile 19.2
fashion 18.8
lady 18.7
sexy 18.5
house 18.4
attractive 18.2
portrait 18.1
interior 17.7
indoors 17.6
lifestyle 17.3
cute 17.2
model 17.1
happy 16.9
women 15.8
one 15.7
textile machine 15.5
shopping cart 15.3
kitchen 14.3
hair 14.3
holding 14
indoor 13.7
container 13.5
machine 13.4
happiness 13.3
handcart 13.3
smiling 13
looking 12.8
face 12.8
casual 12.7
youth 11.9
room 11.8
sitting 11.2
style 11.1
sensual 10.9
consumer goods 10.6
cheerful 10.6
modern 10.5
human 10.5
bag 10.5
furniture 10.2
child 10.2
black 10.2
domestic 10.1
blond 10
joy 10
dress 9.9
wheeled vehicle 9.8
look 9.6
brunette 9.6
standing 9.6
elegance 9.2
shopping 9.2
white goods 8.9
drawing 8.9
elegant 8.6
sketch 8.5
inside 8.3
body 8
clothing 7.9
luxury 7.7
studio 7.6
hot 7.5
chair 7.5
dishwasher 7.5
floor 7.4
window 7.4
20s 7.3
alone 7.3
musical instrument 7.3
sensuality 7.3
make 7.3
life 7.2
gorgeous 7.2
male 7.1
kid 7.1

Google
created on 2022-01-23

Style 83.9
Art 79.9
Monochrome photography 72
Vintage clothing 70.2
Child 70
Monochrome 69.2
Room 68.4
Toddler 68.4
Fashion design 67.3
Visual arts 64
Sitting 63.8
Stock photography 63.7
Photographic paper 60.1
Illustration 60.1
Rectangle 58.3
Chair 56.8
Pattern 55.7
Picture frame 54
Painting 50.8

Microsoft
created on 2022-01-23

text 97.1
wall 95.7
gallery 95.5
clothing 94.9
person 93.1
toddler 88.5
child 88.5
human face 84.9
black 76.2
baby 74.8
girl 64.8
footwear 61.8
room 60.7
drawing 60.5
smile 60.4
boy 56.5
black and white 54.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 100%
Happy 59.3%
Surprised 19.6%
Confused 9.5%
Calm 5.4%
Fear 4.9%
Sad 0.7%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 2-10
Gender Male, 97.9%
Happy 97.5%
Calm 2.1%
Confused 0.1%
Sad 0.1%
Fear 0.1%
Disgusted 0.1%
Surprised 0%
Angry 0%

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a person standing in front of a window 75.1%
a person standing in a room 75%
a person posing for a photo 74.9%