Human Generated Data

Title

Untitled (girl sitting in front of window)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17898

Human Generated Data

Title

Untitled (girl sitting in front of window)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Home Decor 99.7
Human 99.4
Person 99.4
Chair 98.6
Furniture 98.6
Apparel 93.7
Clothing 93.7
Person 93.6
Table 76.1
Female 71.3
Indoors 69.7
Art 68.1
Drawing 68.1
Room 67.3
Girl 64.3
Window 64.3
Building 62.4
Housing 62.4
Living Room 62.4
Kid 60.2
Child 60.2
Sleeve 59.9
Dining Table 59.1
Bed 58.9
Bedroom 58.2
Cushion 58
Shorts 57.4
Plant 55.8
Curtain 55.1

Imagga
created on 2022-02-26

window shade 32.3
building 27.9
window blind 25.8
architecture 24.1
modern 23.1
interior 21.2
blind 21.1
structure 21
urban 18.3
protective covering 17.5
business 15.8
window 15.6
home 14.4
house 14.2
room 14
door 13.4
office 12.8
city 12.5
balcony 12.2
steel 11.5
device 11.4
metal 11.3
sliding door 11.2
corporate 11.2
industry 11.1
construction 10.3
design 10.1
guillotine 10.1
lifestyle 10.1
light 10
covering 9.8
prison 9.6
people 9.5
furniture 9.2
industrial 9.1
stairs 9
black 9
new 8.9
success 8.8
newspaper 8.8
skyscraper 8.8
indoors 8.8
windows 8.6
person 8.6
glass 8.6
travel 8.4
movable barrier 8.4
portrait 8.4
sky 8.3
work 8.2
outdoors 8.2
instrument of execution 8.1
barrier 8.1
gate 8.1
adult 7.8
outdoor 7.6
man 7.4
exterior 7.4
curtain 7.3
dress 7.2

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 96.2
black and white 86.4
clothing 82
person 75.8

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 72.4%
Calm 88%
Happy 10%
Sad 0.6%
Confused 0.3%
Disgusted 0.3%
Fear 0.3%
Surprised 0.2%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a person sitting on a bed 26.5%
a person sitting on a bed 26.4%

Text analysis

Amazon

6
Ban
KACOX
YE33AS

Google

6.
6.