Human Generated Data

Title

Untitled (photograph of large group standing in debris filled yard)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3771

Human Generated Data

Title

Untitled (photograph of large group standing in debris filled yard)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Nature 99.8
Outdoors 99.5
Person 99.4
Human 99.4
Person 99.2
Person 99.2
Person 98.6
Person 98.1
Snow 97.6
Person 97
Person 96.7
Winter 93.9
Storm 93.6
Blizzard 93.6
Person 91.4
Person 89.5
Person 88.3
Person 84.8
Person 79.5

Clarifai
created on 2019-06-01

people 99.9
adult 98.9
group 98.1
man 96.9
wear 95.5
group together 94.2
many 94
woman 93.5
veil 93
snow 92.1
child 89.9
military 87.5
war 87.3
several 86.6
vehicle 85.6
winter 84.3
home 82.2
administration 78.8
four 77.2
outfit 75.6

Imagga
created on 2019-06-01

snow 60.7
winter 51.1
building 36.1
picket fence 34.5
architecture 31.6
cold 30.1
cemetery 29.6
hovel 29.6
fence 28
ice 24.7
history 23.3
church 23.1
sky 23
city 20.8
barrier 20.6
tourism 19.8
old 19.5
religion 18.8
travel 18.3
structure 18.2
landscape 17.9
landmark 17.2
historic 16.5
season 16.4
frost 16.3
temple 15.9
weather 15.7
mountain 15.1
trees 15.1
tree 14.6
house 14.3
stone 13.8
obstruction 13.8
wall 13.7
frozen 13.4
forest 12.2
mosque 12
tower 11.6
cross 11.3
mountains 11.1
street 11
brick 10.4
famous 10.2
cathedral 10.2
outdoor 9.9
park 9.9
dome 9.9
film 9.8
snowy 9.7
outdoors 9.7
rock 9.6
ancient 9.5
historical 9.4
culture 9.4
town 9.3
sun 8.9
negative 8.8
holiday 8.6
capital 8.5
place of worship 8.2
national 8.2
ski 8.1
glacier 8
crystal 8
freeze 7.9
urban 7.9
day 7.9
storm 7.7
god 7.7
window 7.6
clouds 7.6
tourist 7.3
column 7.1
seasonal 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

snow 99.1
clothing 89.7
person 85.7
old 56.2

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 52.1%
Happy 45.1%
Surprised 45.1%
Calm 46%
Sad 53.5%
Disgusted 45.1%
Angry 45.1%
Confused 45.1%

AWS Rekognition

Age 23-38
Gender Male, 51.4%
Sad 52.6%
Surprised 45.5%
Happy 45%
Angry 45.5%
Calm 45.5%
Confused 45.7%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Female, 52.8%
Angry 45.7%
Disgusted 46.4%
Happy 46.5%
Sad 50.1%
Surprised 45.4%
Calm 45.6%
Confused 45.3%

AWS Rekognition

Age 15-25
Gender Male, 50.7%
Angry 45.5%
Surprised 45.3%
Calm 48.9%
Sad 48.6%
Confused 45.6%
Disgusted 45.4%
Happy 45.8%

AWS Rekognition

Age 26-43
Gender Female, 53.5%
Confused 45.5%
Angry 49.1%
Sad 46.5%
Calm 46.7%
Disgusted 46%
Happy 45.5%
Surprised 45.8%

AWS Rekognition

Age 20-38
Gender Female, 52.4%
Sad 48.1%
Angry 46.3%
Calm 46.1%
Confused 46%
Disgusted 46%
Happy 46.6%
Surprised 45.9%

AWS Rekognition

Age 35-55
Gender Female, 51.4%
Surprised 45.5%
Confused 45.6%
Disgusted 45.3%
Happy 45.6%
Sad 51.3%
Calm 46.3%
Angry 45.4%

AWS Rekognition

Age 30-47
Gender Male, 54.5%
Confused 45.3%
Angry 45.7%
Sad 45.3%
Calm 46.4%
Disgusted 51.8%
Happy 45.3%
Surprised 45.3%

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people that are standing in the snow 49.1%
a group of people posing for a photo 49%
a group of people standing in the snow 48.9%