Human Generated Data

Title

Untitled (boy reading book on couch)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16819

Human Generated Data

Title

Untitled (boy reading book on couch)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Furniture 99.9
Person 99.1
Human 99.1
Chair 98.3
Lamp 78.7
Table Lamp 78.7
Couch 71.2
Indoors 63.1
Living Room 63.1
Room 63.1
Photography 61.6
Photo 61.6
Portrait 61.6
Face 61.6
Armchair 57.3
People 57

Imagga
created on 2022-02-26

percussion instrument 60.7
musical instrument 43.8
marimba 42.7
grand piano 36.8
piano 34
keyboard instrument 26.4
stringed instrument 26.2
water 20
snow 17.2
people 16.2
barrow 15.7
outdoor 15.3
tree 14.8
cold 14.6
landscape 13.4
handcart 13.1
tool 13.1
park 12.8
winter 12.8
outdoors 12.7
shovel 12.6
season 12.5
river 12.5
forest 12.2
man 12.1
black 12
old 11.8
fountain 11.7
thatch 11.6
trees 11.6
men 11.2
wheeled vehicle 10.9
roof 10.8
male 10.6
structure 10.6
day 10.2
lake 10.1
travel 9.9
building 9.7
summer 9.6
sky 9.6
grass 9.5
person 9.2
squeegee 9.2
leisure 9.1
human 9
working 8.8
rake 8.7
weather 8.6
sitting 8.6
fun 8.2
cleaning implement 8.1
activity 8.1
lifestyle 7.9
rural 7.9
two 7.6
beach 7.6
friendship 7.5
city 7.5
protective covering 7.3
work 7.3
adult 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 94.8
black and white 93.7
man 92.6
indoor 89.5
person 73.2
monochrome 54.4

Face analysis

Amazon

Google

AWS Rekognition

Age 18-24
Gender Female, 62.1%
Happy 99.8%
Sad 0.1%
Surprised 0%
Calm 0%
Angry 0%
Confused 0%
Fear 0%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Couch 71.2%

Captions

Microsoft

a man sitting in front of a window 58.1%
an old photo of a man 58%
a man sitting in a room 57.9%

Text analysis

Amazon

RODAK