Human Generated Data

Title

Untitled (family outside of house in snow)

Date

1965

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16773

Human Generated Data

Title

Untitled (family outside of house in snow)

People

Artist: Lucian and Mary Brown, American

Date

1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 98.8
Human 98.8
Person 97.4
Nature 97.1
Outdoors 95.6
Person 95.6
Person 94.6
Person 90.3
Person 86
Person 85.9
People 75.8
Home Decor 75.3
Snow 65
Path 63.9
Ice 62.5
Brick 62.5
Weather 59.4
Road 59.2
Transportation 55.5
Walkway 55.3

Imagga
created on 2022-02-26

building 34.1
garage 28.2
structure 27
school 23.6
architecture 21.2
house 18.6
sky 17.8
old 14.6
window 14.3
city 14.1
urban 13.1
construction 12.8
roof 12.7
home 12
wood 11.7
door 11.6
tree 11.5
park 10.9
clouds 10.1
outdoor 9.9
transportation 9.9
outdoors 9.8
interior 9.7
people 9.5
man 9.4
patio 9.3
modern 9.1
office 8.8
wooden 8.8
adult 8.6
business 8.5
travel 8.4
street 8.3
style 8.2
new 8.1
trees 8
rural 7.9
scenic 7.9
scene 7.8
empty 7.7
estate 7.6
center 7.6
room 7.6
field 7.5
chair 7.5
life 7.4
inside 7.4
warehouse 7.3
light 7.3
history 7.2
grass 7.1
summer 7.1
day 7.1
country 7

Google
created on 2022-02-26

Building 95.1
Black-and-white 85.9
Door 85.4
Style 83.8
House 82.8
Adaptation 79.3
Window 78.2
Tints and shades 77.2
Monochrome 75.9
Monochrome photography 75.8
Facade 73.7
Porch 72.3
Cottage 70.7
Room 69.5
History 66.7
Art 64.4
Vintage clothing 63.5
Siding 62.7
Chair 55.3
Street 55.2

Microsoft
created on 2022-02-26

text 98.8
black and white 95
outdoor 94.3
street 92.2
monochrome 78.7
house 73.2
building 59

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 99.2%
Calm 82.7%
Happy 7.9%
Sad 7.5%
Disgusted 0.6%
Surprised 0.4%
Fear 0.3%
Confused 0.3%
Angry 0.3%

AWS Rekognition

Age 48-56
Gender Female, 62.9%
Calm 71.8%
Happy 14.9%
Sad 5.3%
Angry 2.7%
Surprised 1.9%
Confused 1.7%
Disgusted 1.3%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a person standing in front of a building 70.2%
a person standing in front of a brick building 63.8%
a person that is standing in front of a building 63.7%

Text analysis

Amazon

4
KODAK--EEA-I

Google

-XAg
MJI7--YTEA2- -XAg
MJI7--YTEA2-