Human Generated Data

Title

Untitled (boy outside house)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17942

Human Generated Data

Title

Untitled (boy outside house)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Clothing 98.7
Apparel 98.7
Person 98.7
Human 98.7
Shorts 93
Outdoors 90.4
Home Decor 89.2
Nature 89.1
Brick 86.3
Pants 86
Wall 81.8
Face 76.7
Housing 73.8
Building 73.8
Rural 73.6
Countryside 73.6
Shelter 73.6
Window 71.3
Yard 68.5
Plant 58.8
Jeans 57.7
Denim 57.7
Female 55.1

Imagga
created on 2022-03-04

cleaner 23.3
outdoors 21
dress 20.8
groom 18.2
people 17.8
man 16.8
adult 15.6
bride 15.3
portrait 14.9
person 14.4
happiness 14.1
building 14
wedding 13.8
day 13.3
pretty 13.3
happy 13.2
lifestyle 13
outdoor 13
architecture 12.8
fashion 12.8
wall 12.7
city 12.5
park 12.3
male 12.1
love 11.8
leisure 11.6
summer 11.6
smile 11.4
fun 11.2
attractive 11.2
house 10.9
face 10.6
married 10.5
sidewalk 10.5
urban 10.5
hair 10.3
sport 10.1
tool 10
lady 9.7
marriage 9.5
outside 9.4
door 9.4
alone 9.1
exercise 9.1
couple 8.7
standing 8.7
cute 8.6
model 8.6
device 8.3
street 8.3
cheerful 8.1
active 8.1
looking 8
veil 7.8
walking 7.6
joy 7.5
traditional 7.5
teenager 7.3
smiling 7.2
sexy 7.2
romantic 7.1
life 7.1
lawn mower 7.1
to 7.1
travel 7
step 7

Google
created on 2022-03-04

Window 94.1
Building 89.6
Black-and-white 82.9
Door 78.6
Tints and shades 77.3
Monochrome 75.7
House 74.7
Monochrome photography 74.3
Vintage clothing 73.2
Brick 72.2
Wood 67.3
Room 65.8
Art 58.1
Brickwork 53.9
History 53.8
Stairs 52.7
Siding 51.7
Retro style 50.4

Microsoft
created on 2022-03-04

house 93.1
outdoor 92
text 86.6
window 85.7
black and white 74.6
clothing 66.2
wedding dress 63.4

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Female, 96.8%
Calm 90%
Happy 3.5%
Sad 2.7%
Surprised 1%
Angry 0.9%
Disgusted 0.7%
Confused 0.7%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a person standing in front of a brick building 75.8%
a person standing in front of a building 75.7%
a person standing in front of a brick building 72.2%