Human Generated Data

Title

Untitled (courtyard, ruined building to right, intact building to rear, woman with two children in right foreground, man with seven children in front of intact building, Mattersburg, Austria)
Date

c. 1890 - c. 1915
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4254

Human Generated Data

Title

Untitled (courtyard, ruined building to right, intact building to rear, woman with two children in right foreground, man with seven children in front of intact building, Mattersburg, Austria)

People

Artist: Unidentified Artist,

Date

c. 1890 - c. 1915

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4254

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Nature 99.6
Person 99.1
Human 99.1
Person 99.1
Outdoors 99
Person 98.7
Person 98.3
Person 97.3
Person 96.8
Building 96.7
Person 96.4
Countryside 95.2
Person 94.6
Person 93.5
Shelter 91
Rural 91
Hut 86.6
Person 84.3
Housing 84
Person 82.1
Shack 82
House 66.1
Road 60.3
Urban 59.8
Wall 57.3

Clarifai
created on 2023-10-27

street 99.7
decay 99.1
vintage 98.8
people 98.2
town 98
old 98
abandoned 97.8
sepia 97.8
monochrome 97.3
no person 96.1
house 96
ghost 95.5
black and white 95.3
architecture 95
building 94.7
derelict 93.9
art 92.5
window 91.4
home 88.8
shed 88.6

Imagga
created on 2022-01-29

house 51.4
building 40.2
structure 36.9
architecture 36.6
old 35.6
home 32.8
hut 32.4
roof 26.9
railway station 25.8
shelter 24.9
village 23.5
rural 21.2
terminal 20.6
sky 20.4
country 20.2
door 20.1
wall 19.8
window 19.2
brick 18.4
windows 17.3
farm 17
wood 16.7
hovel 16.4
barn 16.2
construction 15.4
history 15.2
estate 15.2
station 15.2
countryside 14.6
wooden 14.1
church 13.9
cottage 13.8
snow 13.6
residence 12.4
tree 12.3
ancient 12.1
street 12
historic 11.9
winter 11.9
property 11.6
trees 11.6
grass 11.1
dwelling 11.1
warehouse 10.9
travel 10.6
residential 10.5
real 10.5
landscape 10.4
facility 10.3
town 10.2
clouds 10.2
housing 9.8
abandoned 9.8
houses 9.7
rustic 9.6
exterior 9.2
tile 9.2
graffito 8.8
center 8.6
garage 8.5
stone 8.4
public house 8.2
new 8.1
work 7.9
scene 7.8
yard 7.8
outdoor 7.7
garden 7.6
city 7.5

Google
created on 2022-01-29

Photograph 94.2
Building 93
Window 89.8
Black 89.7
House 86.3
Tints and shades 77.3
Monochrome 73
Monochrome photography 71.7
Sky 70.1
Working animal 69.6
History 65.8
Vintage clothing 65.7
Stock photography 64.4
Rectangle 62.5
Landscape 62.4
Village 59.5
Room 59.3
Street 59.2
Door 58.1
Art 57.3

Microsoft
created on 2022-01-29

building 99.7
outdoor 99.6
old 93.7
house 90.5
text 86.1
sky 79.8
black and white 66.6
farm building 61
barn 56.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 6-16
Gender Female, 96.5%
Calm 95.5%
Sad 1.1%
Confused 1%
Happy 0.8%
Disgusted 0.5%
Surprised 0.4%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 1-7
Gender Male, 99.7%
Happy 80.2%
Angry 16.9%
Calm 1.2%
Sad 0.5%
Confused 0.5%
Fear 0.4%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-30
Gender Female, 73.8%
Calm 80.4%
Angry 5.4%
Disgusted 5.3%
Sad 3.3%
Happy 2.5%
Fear 1.3%
Confused 1.3%
Surprised 0.5%

AWS Rekognition

Age 10-18
Gender Female, 58.3%
Disgusted 77.8%
Calm 6.9%
Sad 5.1%
Confused 3.3%
Fear 2.7%
Surprised 2.3%
Angry 1.3%
Happy 0.6%

AWS Rekognition

Age 6-12
Gender Female, 99.2%
Sad 44.5%
Calm 30.6%
Fear 12.4%
Happy 5.9%
Angry 4.5%
Confused 0.8%
Disgusted 0.6%
Surprised 0.6%

AWS Rekognition

Age 4-12
Gender Female, 98.2%
Calm 66.9%
Fear 9.7%
Sad 9.3%
Surprised 4.2%
Angry 4.2%
Confused 3%
Disgusted 1.4%
Happy 1.3%

AWS Rekognition

Age 4-12
Gender Male, 63.8%
Angry 80.6%
Sad 6.6%
Confused 3.2%
Fear 2.9%
Happy 2.5%
Surprised 2.2%
Disgusted 1.2%
Calm 0.8%

Feature analysis

Amazon

Person
Person 99.1%
Person 99.1%
Person 98.7%
Person 98.3%
Person 97.3%
Person 96.8%
Person 96.4%
Person 94.6%
Person 93.5%
Person 84.3%
Person 82.1%

Captions

Microsoft
created on 2022-01-29

a vintage photo of an old building 93.3%
a vintage photo of a house 93.2%
an old barn in front of a house 93.1%