Human Generated Data

Title

Untitled (little boy lying on chaise)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17239

Human Generated Data

Title

Untitled (little boy lying on chaise)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Furniture 100
Couch 99.6
Bed 93.1
Person 80.5
Human 80.5
Home Decor 75.6

Imagga
created on 2022-02-26

shoe 62.1
footwear 54.1
shoes 50.9
leather 46
foot 41
pair 38.7
lace 35.2
fashion 34.7
conveyance 32.6
sidecar 31.5
seat 30.9
boot 29.4
clothing 27.7
rubber 25
wear 24
sport 23.9
style 23
black 22.8
boots 21.5
device 21.3
cockpit 20.7
modern 20.3
support 19.7
running shoe 19.5
male 19.1
object 19.1
training 18.5
feet 18.4
running 18.2
lifestyle 18.1
walking 18
new 17.8
laces 16.8
furniture 16.3
sofa 16
jogging 15.7
comfortable 15.3
bobsled 15.3
casual 15.3
vehicle 13.9
shoelace 13.8
foot gear 13.8
sled 13.8
sneakers 13.8
rest 13.6
elegance 13.4
relaxation 13.4
room 13.3
interior 13.3
men 12.9
home 12.8
accessory 12.4
sports 12
covering 11.3
floor 11.2
luxury 11.1
shiny 11.1
house 10.9
fitness 10.8
sole 10.8
heels 10.8
design 10.7
classic 10.2
exercise 10
shop 9.9
couch 9.7
athletic 9.6
person 9.5
two 9.3
relax 9.3
sandal 9
accessories 8.7
comfort 8.7
track 8.6
gym 8.6
worn 8.6
equipment 8.5
leisure 8.3
armchair 8.2
shoe shop 8.1
brown 8.1
activity 8.1
decor 8
objects 7.8
pillow 7.8
elegant 7.7
canvas 7.6
people 7.2
stylish 7.2
color 7.2
women 7.1
indoors 7

Google
created on 2022-02-26

White 92.2
Black 89.6
Style 83.9
Black-and-white 82.1
Comfort 81.7
Automotive design 78.8
Monochrome photography 75.2
Rectangle 70.9
Window 70.5
Monochrome 69.2
Room 67.7
Composite material 63.9
Stock photography 63.1
Still life photography 62.1
Elbow 55.7
Recreation 54.8
Human leg 54.2
Photography 51.6
Plastic 50.6

Microsoft
created on 2022-02-26

wall 99
indoor 96.6
black and white 89.1
bed 87.5
footwear 70.3
bedroom 45.6

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Female, 95.4%
Fear 54.4%
Surprised 14.5%
Happy 10.3%
Calm 7%
Angry 4.8%
Sad 4.8%
Confused 2.4%
Disgusted 1.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Bed 93.1%
Person 80.5%

Captions

Microsoft

a person sitting on a bed 87.1%
a bedroom with a bed and a window 87%
a person sitting on a bed 81.6%

Text analysis

Amazon

25

Google

25
25